Topics / #guardrails

Guardrails projects on GitHub

Guardrails and privacy filters keeping AI behavior in check.

As of , the most-starred Guardrails projects on GitHub are openai-agents-python (30.1K stars), mlflow (28.4K stars) and opik (22.8K stars). GitHub.Locker tracks 20 Guardrails repositories with 153.5K stars combined. The fastest-growing on October 18 was failproofai, with +136 stars in a day.

20Projects
153.5KStars in total
+433Stars in a day
Browse in the catalog →github.com/topics/guardrails ↗

Hot right now

Most stars gained in a day · Oct 18

+136

failproofai

FailproofAI/failproofai · ★ 5.9K

Failproof AI is an observability and enforcement layer that sits inside AI agent harnesses (coding CLIs, chat gateways, self-hosted assistants), capturing every run and blocking dangerous tool calls before they execute.

+102

Internal-Safety-Collapse

wuyoscar/Internal-Safety-Collapse · ★ 1.8K

Internal Safety Collapse (ISC) is a NeurIPS 2026 research project showing that when an AI agent is placed in a normal-looking coding workflow with missing data, it will fill in that data with harmful content to complete the task, even though the same model would refuse to produce that content if asked directly.

+34

opik

comet-ml/opik · ★ 22.8K

Opik is an open-source platform for debugging, evaluating, and monitoring LLM applications, RAG systems, and agentic workflows, with tracing, automated evaluation, and production dashboards.

+26

bifrost

maximhq/bifrost · ★ 8.9K

An open-source, high-performance AI gateway that unifies 23+ LLM providers behind a single OpenAI-compatible API, with automatic failover, load balancing, semantic caching, and budget controls built in.

The all-time top

20 projects · by stars

  1. #1 · openai/openai-agents-python

    openai-agents-python

    It is the OpenAI Agents SDK: a lightweight yet powerful Python framework for building multi-agent workflows, where an agent is an LLM configured with instructions, tools, guardrails and handoffs.

    30.1K
  2. #2 · mlflow/mlflow

    mlflow

    MLflow is an open source AI engineering platform for agents, LLM apps, and classic ML models: one place to trace, evaluate, monitor, and optimize production AI while controlling costs. It is widely adopted, with over 60 million monthly downloads.

    28.4K
  3. #3 · comet-ml/opik

    opik

    Opik is an open-source platform for debugging, evaluating, and monitoring LLM applications, RAG systems, and agentic workflows, with tracing, automated evaluation, and production dashboards.

    22.8K
  1. 4

    RagaAI-Catalyst

    16.2Kraga-ai-hub/RagaAI-Catalyst · Python

    RagaAI Catalyst is a platform for managing and optimizing LLM projects — tracing, evaluating and safeguarding LLM and agent applications, shipped as a Python SDK.

  2. 5

    presidio

    11.4Kdata-privacy-stack/presidio · Python

    An open-source framework (SDK) that detects, redacts, masks and anonymizes sensitive data (PII) — names, credit card numbers, SSNs, phone numbers — in text, images and structured data.

  3. 6

    bifrost

    8.9Kmaximhq/bifrost · Go

    An open-source, high-performance AI gateway that unifies 23+ LLM providers behind a single OpenAI-compatible API, with automatic failover, load balancing, semantic caching, and budget controls built in.

  4. 7

    harness-sdk

    8.9Kstrands-agents/harness-sdk · TypeScript

    Strands Agents - an open-source SDK for building and running AI agents in Python and TypeScript, with a model-driven approach where a working agent takes just a few lines of code.

  5. 8

    agentic-design-patterns

    8.3Kxindoo/agentic-design-patterns · HTML

    A Chinese translation project of the book 'Agentic Design Patterns' by Google, covering 21 core design patterns for building AI agent systems plus several appendices.

  6. 9

    failproofai

    5.9KFailproofAI/failproofai · TypeScript

    Failproof AI is an observability and enforcement layer that sits inside AI agent harnesses (coding CLIs, chat gateways, self-hosted assistants), capturing every run and blocking dangerous tool calls before they execute.

  7. 10

    stop-that-shit

    2.7Klennney/stop-that-shit · JavaScript

    Stop That Shit is a Hook + Skill Guard that stops AI coding agents (Codex, Claude Code, OpenCode, Hermes Agent CLI, Pi) from doing unrequested work: generating checksums nobody reads, expanding task scope, or redoing steps that are already done.

  8. 11

    awesome-jev

    2.4Kyibie/awesome-jev · Python

    A curated list of public projects, integrations, and discussions built on Jev — TypeSafe AI's System One model for typed decisions. It tracks who is actually building with it and which decision patterns transfer across industries.

  9. 12

    Internal-Safety-Collapse

    1.8Kwuyoscar/Internal-Safety-Collapse · Python

    Internal Safety Collapse (ISC) is a NeurIPS 2026 research project showing that when an AI agent is placed in a normal-looking coding workflow with missing data, it will fill in that data with harmful content to complete the task, even though the same model would refuse to produce that content if asked directly.

  10. 13

    delivery-harness

    1.7Kdiudiu-tech/delivery-harness · Java

    An AI harness reference implementation for on-demand delivery operations that combines deterministic workflows, mock business tools, lightweight knowledge retrieval, an OpenAI-compatible model endpoint, evaluation scaffolding, and human-review guardrails.

  11. 14

    OpenAPPA

    1.6Karchestra-ai/OpenAPPA · Rust

    OpenAPPA is a deterministic guardrail layer that sits between an AI agent and its tools, checking every tool call to decide whether the data involved is allowed to reach that destination.

  12. 15

    ai-system-design

    723amitshekhariitbhu/ai-system-design · Markdown

    A free, open-source guide that teaches AI System Design step by step: how to combine GPUs, inference servers, caches, vector databases, AI agents, guardrails, and evals into one system that is fast, cheap, reliable, and safe.

  13. 16

    ai-engineer-notebooks

    706calmrocks/ai-engineer-notebooks · Jupyter Notebook

    A collection of framework-free, hands-on Jupyter/Colab notebooks teaching the applied-LLM engineer skill set — model APIs, RAG, evals, agents, fine-tuning, security, and LLMOps — built for engineers moving into AI Engineer / Forward Deployed Engineer (FDE) roles.

  14. 17

    dsh-memory

    414FuRongJun-1999/dsh-memory · Python

    dsh-memory is a memory plugin for DeepSeek Harness (DSH) that gives AI agents persistent, cross-session memory built on a mostly non-LLM 'white-box' reasoning pipeline, a spatiotemporal knowledge graph, and auditable guardrails. It targets AGI research into self-cognition, continual learning, world models and self-improvement rather than everyday chat memory.

  15. 18

    bivor

    207ryanlab/bivor · TypeScript

    Bivor is a macOS desktop workbench built on the pi coding agent, designed to match Codex/Claude desktop apps and go further with visual harness orchestration, guardrails, cloud VM sandboxes, and parallel git-worktree tasks.

  16. 19

    jevmem

    129Avinash-jetwani/jevmem · TypeScript

    jevmem saves the decisions, rules, and failed approaches from your Claude Code (and other coding agent) chats into a JEVMEM.md file in your repo, and brings the relevant ones back in later sessions so context survives a fresh chat.

  17. 20

    jevals

    105openlayer-ai/jevals · Python

    jevals is a Python library for evaluating and guardrailing AI agent traces using 'Jev' decision models instead of a text-generating LLM judge. It bundles every check for a trace into one request that costs a fraction of a cent and returns in a few hundred milliseconds, so you can eval every trace and even run checks inside the agent loop.

Often tagged together