Search Results for "safety"
Sort By:
Showing 674 open source projects for "safety"
View related business solutions-
Go From AI Idea to AI App FastAccess Gemini 3 and 200+ models. Build chatbots, agents, or custom models with built-in monitoring and scaling.
-
Forever Free Full-Stack Observability | Grafana CloudBuilt on open standards like Prometheus and OpenTelemetry, Grafana Cloud includes Kubernetes Monitoring, Application Observability, Incident Response, plus the AI-powered Grafana Assistant. Get started with our generous free tier today.
-
1
Claude Code Safety Net
A Claude Code plugin that acts as a safety net
Claude Code Safety Net is a safety-oriented framework and example set designed to help developers integrate runtime checks, guardrails, and defensible constraints into agentic systems powered by Claude Code, with the goal of reducing unsafe outputs, erroneous actions, and harmful behaviors in production scenarios. The repository defines patterns and reusable components for validating agent decisions, sanitizing user inputs, and enforcing operational boundaries, making it easier to design fail-safe integrations with both internal toolchains and external APIs. ... -
2
Safety-Prompts
Chinese safety prompts for evaluating and improving the safety of LLMs
Safety-Prompts is an open-source repository that provides a curated collection of prompts designed to evaluate and improve the safety behavior of large language models. The project focuses primarily on safety testing scenarios relevant to Chinese language models, though the concepts can be applied to other languages and systems. The prompts are structured to test whether models generate outputs that align with human values and safety guidelines when faced with potentially harmful or sensitive requests. ... -
3
Nightingale OS
A small operating system where I experiment and learn osdev
nightingale is a modern hobby operating system developed in Rust, focusing on safety, simplicity, and minimalism. It aims to be a clean platform for experimentation and learning, implementing a small kernel with core features like multitasking, memory protection, and a minimal filesystem. Its use of Rust provides strong guarantees around memory safety and eliminates common bugs found in low-level C-based systems. nightingale is ideal for those seeking to study OS development using a modern language with a strong safety model. -
4
PKU Beaver
Constrained Value Alignment via Safe Reinforcement Learning
PKU Beaver is an open-source research project focused on improving the safety alignment of large language models through reinforcement learning from human feedback under explicit safety constraints. The framework introduces techniques that separate helpfulness and harmlessness signals during training, allowing models to optimize for useful responses while minimizing harmful behavior. To support this process, the project provides datasets containing human-labeled examples that encode both performance preferences and safety constraints across multiple dimensions. ... -
Try Google Cloud Risk-Free With $300 in CreditUse your credit across every product. Compute, storage, AI, analytics. When it runs out, 20+ products stay free. You only pay when you choose to.
-
5
Ruffle
A Flash Player emulator written in Rust
...On the web side, Ruffle is embedded into pages or installed as a browser extension; in the desktop version, it can open .swf files directly or embed them in applications. Because it’s built with memory safety in mind, Ruffle helps avoid many of the security vulnerabilities that plagued classic Flash (buffer overflows, use-after-free, etc.). It strives to support multiple versions of ActionScript (1, 2 and parts of 3) and a wide swath of the Flash API so as much content as possible works unchanged. -
6
gpt-oss-safeguard
Safety reasoning models built-upon gpt-oss
gpt-oss-safeguard is an open-weight reasoning model family released by OpenAI designed specifically for content safety and moderation tasks. Rather than just outputting a numeric “safety score,” it is trained to reason about content with respect to a user-provided policy, allowing flexible, customizable moderation definitions rather than fixed rules — ideal when different platforms have different safety standards. The model comes in at least two variants: a large 120B-parameter version for heavy-duty, high-accuracy reasoning, and a 20B-parameter version optimized for lower latency or smaller compute resources. ... -
7
Purple Llama
Set of tools to assess and improve LLM security
Purple Llama is an umbrella safety initiative that aggregates tools, benchmarks, and mitigations to help developers build responsibly with open generative AI. Its scope spans input and output safeguards, cybersecurity-focused evaluations, and reference shields that can be inserted at inference time. The project evolves as a hub for safety research artifacts like Llama Guard and Code Shield, along with dataset specs and how-to guides for integrating checks into applications. ... -
8
Obtainium
Get Android app updates straight from the source
Obtainium is an Android app for installing and updating apps directly from their release pages (GitHub, GitLab, F-Droid, APKMirror, etc.). Users can subscribe to custom sources, receive notifications on updates, verify APK safety (using AppVerifier), and import/export app lists. It's designed to bypass Play Store restrictions and keep apps up to date independently. -
9
Slonik
A Node.js PostgreSQL client with runtime and build time type safety
Slonik is a PostgreSQL client for Node.js that ensures safe and efficient query execution by using tagged template literals, preventing SQL injection attacks and promoting better query structure. -
Enterprise-grade ITSM, for every businessFreshservice is an intuitive, AI-powered platform that helps IT, operations, and business teams deliver exceptional service without the usual complexity. Automate repetitive tasks, resolve issues faster, and provide seamless support across the organization. From managing incidents and assets to driving smarter decisions, Freshservice makes it easy to stay efficient and scale with confidence.
-
10
better-sqlite3
The fastest and simplest library for SQLite3 in Node.js
The fastest and simplest library for SQLite3 in Node.js. Full transaction support. High performance, efficiency, and safety. Easy-to-use synchronous API (better concurrency than an asynchronous API... yes, you read that correctly). Support for user-defined functions, aggregates, virtual tables, and extensions. 64-bit integers (invisible until you need them). Worker thread support (for large/slow queries). Help this project stay strong! better-sqlite3 is used by thousands of developers and engineers on a daily basis. ... -
11
OCaml
The core OCaml system: compilers, runtime system, base libraries
OCaml is a general-purpose, industrial-strength programming language with an emphasis on expressiveness and safety. OCaml’s powerful type system means more bugs are caught at compile-time, and large, complex codebases are easier to maintain. This makes it a good language for running critical code. At the same time, sophisticated inference makes the type system unobtrusive, creating a smooth developer experience. OCaml has two compilers. One is a bytecode compiler that generates small, portable executables and is very fast. ... -
12
In-The-Wild Jailbreak Prompts on LLMs
A dataset consists of 15,140 ChatGPT prompts from Reddit
In-The-Wild Jailbreak Prompts on LLMs is an open-source research repository that provides datasets and analytical tools for studying jailbreak prompts used to bypass safety restrictions in large language models. The project is part of a research effort to understand how users attempt to circumvent alignment and safety mechanisms built into modern AI systems. The repository includes a large collection of prompts gathered from real-world platforms such as Reddit, Discord, prompt-sharing communities, and other public sources. ... -
13
rustix
Safe Rust bindings to POSIX-ish APIs
rustix provides efficient memory-safe and I/O-safe wrappers to POSIX-like, Unix-like, Linux, and Winsock syscall-like APIs, with configurable backends. It uses Rust references, slices, and return values instead of raw pointers, and I/O safety types instead of raw file descriptors, providing memory safety, I/O safety, and provenance. It uses Results for reporting errors, bitflags instead of bare integer flags, an Arg trait with optimizations to efficiently accept any Rust string type, and several other efficient conveniences. rustix is low-level and, and while the net API supports Windows Sockets 2 (Winsock), the rest of the APIs do not support Windows; for higher-level and more portable APIs built on this functionality, see the cap-std, memfd, timerfd, and io-streams crates. -
14
tsafe
The missing TypeScript utils
Tsafe is a lightweight TypeScript utility library designed to improve type safety and code clarity. It provides helpers for runtime type assertions, exhaustive type checking, and ensuring strict type constraints. -
15
ODMantic
Sync and Async ODM (Object Document Mapper) for MongoDB
Odmantic is an Object-Document Mapper (ODM) for MongoDB, designed for Python applications using Pydantic models, providing a seamless integration with type safety and validation. -
16
URL Routing
A bidirectional router with more type safety and less fuss
swift-url-routing is a bidirectional router with more type safety and less fuss. This library is built with Parsing. -
17
Crosvm
The Chrome OS Virtual Machine Monitor
...Unlike general-purpose emulators like QEMU, crosvm avoids full hardware emulation and focuses on modern paravirtualized I/O using the virtio standard, reducing complexity and attack surface. Written in Rust, it emphasizes memory safety and modularity, allowing sandboxed device emulation with fine-grained privilege separation. crosvm underpins several ChromeOS subsystems, including Android Runtime for Chrome (ARCVM) and Crostini Linux containers, enabling rich application compatibility within a tightly controlled environment. -
18
Phan
Phan is a static analyzer for PHP
...Phan 5 depends on PHP 7.2+ with the php-ast extension (1.0.16+ is preferred) and supports analyzing PHP version 7.0-8.1 syntax. Check that all methods, functions, classes, traits, interfaces, constants, properties and variables are defined and accessible. Check for type safety and arity issues on method/function/closure calls. -
19
NautilusTrader
A high-performance algorithmic trading platform
...This helps to address the parity challenge of keeping the Python research/backtest environment, consistent with the production live trading environment. NautilusTraders design, architecture and implementation philosophy holds software correctness and safety at the highest level, with the aim of supporting Python native, mission-critical, trading system backtesting and live deployment workloads. -
20
FuzzyAI Fuzzer
A powerful tool for automated LLM fuzzing
...FuzzyAI provides testing tools, datasets, and evaluation workflows that help researchers measure how well models resist harmful instructions or attempts to bypass safety mechanisms. -
21
Nothing Ever Happens
Focused async Python bot for Polymarket
...Its core concept is based on statistical observations that a majority of prediction market outcomes resolve negatively, and it attempts to exploit this base-rate bias through systematic participation rather than predictive modeling. The bot includes a safety-oriented design with explicit environment variable requirements to enable live trading, ensuring that users consciously opt into real financial risk, along with a paper trading mode for testing without capital exposure. -
22
System Prompts Leaks
Collection of extracted System Prompts from popular chatbots
System Prompts Leaks is a curated repository that collects known leaked or publicly exposed system prompts used by large language models, organized so researchers, developers, and AI safety advocates can analyze them in one place. The project highlights how system prompts — instructions that strongly influence model behavior — have been inadvertently shared in forums, datasets, and open repositories, illustrating common patterns and potential vulnerabilities in prompt design and deployment. By aggregating these prompts, the repository serves as a valuable resource for understanding how widely different models are being guided in the wild, which helps with comparative analysis across architectures and service providers. ... -
23
Pumpkin
Empowering everyone to host fast and efficient Minecraft servers
Pumpkin is an open-source Minecraft server implementation written entirely in the Rust programming language with the goal of delivering high performance, efficiency, and modern architecture for hosting multiplayer worlds. Unlike the original Java-based server, Pumpkin focuses on leveraging Rust’s memory safety and performance advantages to create a fast and stable server environment. The project aims to replicate the core mechanics and gameplay of Minecraft while providing a flexible foundation for customization and optimization. Its architecture emphasizes efficient networking, resource management, and scalability, allowing servers to handle more players with reduced system overhead. ... -
24
Concurrent Ruby
Modern concurrency tools including agents, futures, promises, etc.
...Keeps the semantics as idiomatic Ruby as possible, supports features that make sense in Ruby. Excludes features that don't make sense in Ruby. It is small, lean, and loosely coupled, thread-safety, and with backward compatibility. Concurrent Ruby makes one of the strongest thread safety guarantees of any Ruby concurrency library, providing consistent behavior and guarantees on all four of the main Ruby interpreters (MRI/CRuby, JRuby, Rubinius, TruffleRuby). -
25
COSMIC Desktop
Next generation Cosmic desktop environment
COSMIC Desktop is the next-generation desktop environment developed by System76 as a complete rewrite of their COSMIC interface, built entirely from scratch using the Rust programming language. It represents a major shift away from GNOME-based customization toward a fully independent desktop stack designed for performance, memory safety, and long-term maintainability. The environment is based on Wayland and uses the Iced GUI toolkit, providing a modern rendering pipeline and a cohesive set of native applications. COSMIC Epoch introduces advanced window management features, including optional tiling, workspaces, and keyboard-driven navigation, while still supporting traditional desktop workflows. ...
