Global

ai-safety
28 projects tagged “ai-safety” that gained the most stars yesterday
#41 · +458 · 1d ·GitHub

Independent Auditing of AI Agents. Run by human or the agent itself, to answer the most crucial question in the AI Agent Economy. Is the agent doing what is supposed to do?

Creator
ifixai-ai
Size
27.7 MB
Stars
28.9K
Age
5mo
Commits · 90 Days
#476 · +64 · 1d ·GitHub

A Codex jailbreak prompt and test pack for gpt. 针对 gpt 系列的 Codex 破甲提示词与测试包。

Creator
MDX-Tom
Size
11.3 MB
Stars
10.3K
Age
3mo
Commits · 90 Days
#576 · +54 · 1d ·GitHub

LIST OF ALL MY JAILBREAKS

Size
0.2 MB
Stars
3.1K
Updated
CommitOct 14
Age
3mo
Commits · 90 Days
#845 · +34 · 1d ·GitHub

AI labs shape how models behave using massive, unseen prompt scaffolds. Because AI is a trusted external intelligence layer for a growing number of humans, these hidden instructions can affect the perceptions and behavior of the public.

Size
2.1 MB
Stars
51.3K
Updated
CommitSep 22
Age
1y
Commits · 90 Days
#1272 · +21 · 1d ·GitHub

G0DM0D3 is a fully open-source, privacy-transparent, multi-model chat interface that pushes the limits of the post-training layer — for red teaming, cognition research, and liberated AI interaction. Built for hackers, philosophers, and system tinkerers.

Size
1.1 MB
Stars
11.8K
Updated
CommitJul 15
Age
6mo
Commits · 90 Days
#1287 · +21 · 1d ·GitHub

Recursive Self-Improvement (RSI) refers to processes in which AI systems improve their own capabilities and can also improve the mechanisms that generate subsequent improvements.

Creator
lobehub
Size
1.7 MB
Stars
766
Age
2mo
Commits · 90 Days
#1677 · +15 · 1d ·GitHub

OBLITERATUS is the most advanced open-source toolkit for understanding and removing refusal behaviors from large language models — and every single run makes it smarter.

Size
7.2 MB
Stars
8.8K
Age
7mo
Commits · 90 Days
#2109 · +11 · 1d ·GitHub

The series is running. 5 days after launch. It runs once a day for 30 days: days 1–10 are the baseline, then there are two 10-day windows, so the first possible call is around 2026-10-24.

Creator
ninjahawk
Size
1.5 MB
Stars
1.5K
Updated
CommitOct 16
Age
25d
Commits · 90 Days
#2112 · +11 · 1d ·GitHub

app — the end-signal probe, public pages, and the live steered-model lab.

Creator
terrafying
Size
582.7 MB
Stars
965
Updated
CommitOct 15
Age
23d
Commits · 90 Days
#2251 · +10 · 1d ·GitHub

A repo for jailbreaking various LLMs, mainly Claude

Size
2.6 MB
Stars
4K
Updated
CommitOct 07
Age
10mo
Commits · 90 Days
#2281 · +10 · 1d ·GitHub

Run AI agents in a sandbox that restricts what they can execute, read, write, and reach on the network. Box combines OS isolation with default-deny Dogwood policies and credential injection that keeps secrets outside the agent. Written in Rust.

Size
3.2 MB
Stars
432
Age
15d
Commits · 90 Days
#2439 · +9 · 1d ·GitHub

A system prompt alone is not an enforcement boundary. This project provides a small reference control plane that does not depend on a particular model or model provider.

Size
<0.1 MB
Stars
741
Updated
CommitAug 26
Age
1mo
Commits · 90 Days
#2774 · +7 · 1d ·GitHub

A full-stack AI Red Teaming platform securing AI ecosystems via Agent Scan, Skills Scan, MCP scan, AI Infra scan and LLM jailbreak evaluation.

Creator
Tencent
Size
165 MB
Stars
6.9K
Age
1y
Commits · 90 Days
#3377 · +5 · 1d ·GitHub

1. Is this action allowed? An agent with access to sendemail and querydatabase should not be able to droptable.

Creator
microsoft
Size
46.9 MB
Stars
6.4K
Age
7mo
Commits · 90 Days
#4221 · +3 · 1d ·GitHub

This repository is a collection of various system prompts for ChatGPT and other AI product and custom GPTs, providing significant educational value in learning about writing system prompts and creating custom GPTs.

Creator
LouisShark
Size
29.8 MB
Stars
10.8K
Updated
CommitOct 13
Age
2y
Commits · 90 Days
#4375 · +3 · 1d ·GitHub

Red-teaming and evaluation framework for AI agents, built around an OWASP-inspired ASI01–ASI10 taxonomy

Size
7.3 MB
Stars
569
Age
4mo
Commits · 90 Days
#4380 · +3 · 1d ·GitHub

WARNING] > DISCLAIMER & RESPONSIBLE RESEARCH DECLARATION > All prompts, system instructions, and PoC payloads archived herein are compiled strictly for academic research, red-teaming verification, and defensive AI alignment.

Creator
Quincunx33
Size
0.9 MB
Stars
479
Updated
CommitOct 17
Age
2mo
Commits · 90 Days

🛡️ A curated list of resources on agent skills security: attacks, defenses, frameworks, and benchmarks for securing AI agent tool use and skill ecosystems

Size
0.9 MB
Stars
260
Updated
CommitOct 12
Age
7mo
Commits · 90 Days
#6252 · +1 · 1d ·GitHub

让任何 agent 操控 Mac 上没有 API 的原生 app,读后台、写不打扰、每步留取证 · Agent Skill for macOS computer use

Creator
alchaincyf
Size
20.5 MB
Stars
309
Updated
CommitOct 13
Age
1mo
Commits · 90 Days
#6309 · +1 · 1d ·GitHub

Second-model AI auto-review for DeepSeek Harness approval requests: a read-only reviewer subagent returns structured allow/deny verdicts with reasons, fail-closed by default, fully auditable from the session log (approval/asked -> autoReview/verdict -> approval/decided).

Creator
PerryLink
Size
2.1 MB
Stars
233
Age
2mo
Commits · 90 Days
#6314 · +1 · 1d ·GitHub

Brig: run coding agents in a microVM sandbox - the Go cli (brig) and session daemon (brigd)

Creator
brig-sh
Size
25 MB
Stars
232
Age
2mo
Commits · 90 Days
#6370 · +1 · 1d ·GitHub

A framework for building robust RL environments to train aligned AI.

Size
1.9 MB
Stars
145
Updated
CommitOct 17
Age
1mo
Commits · 90 Days

The transcript in this repository is the raw output of Mythos 5 as it conducted a cybersecurity evaluation.

Creator
anthropics
Size
26.8 MB
Stars
128
Updated
CommitSep 09
Age
1mo
Commits · 90 Days
#6453 · +0 · 1d ·GitHub
archived

Thank you for developing with Llama models. 1 release, we’ve consolidated GitHub repos and added some additional repos as we’ve expanded Llama’s functionality into being an e2e Llama Stack.

Creator
meta-llama
Size
0.6 MB
Stars
29.2K
Updated
CommitJan 26
Age
2y
Commits · 90 Days
#8281 · +0 · 1d ·GitHub

A visual cyber town for AI agents — build an AI company, watch it work, spend, validate, escalate, and adapt.

Creator
w1u2d3i4
Size
1.9 MB
Stars
201
Updated
CommitAug 27
Age
1mo
Commits · 90 Days
#8386 · +0 · 1d ·GitHub

A Geiger counter for AI agents — one read-only command that inventories every agent, MCP server, plugin, and AI extension on a machine

Size
0.3 MB
Stars
166
Age
1mo
Commits · 90 Days
#8395 · +0 · 1d ·GitHub

> This repository accompanies The Last AI Built by Humans: Toward Genuine Recursive Self-Improvement (Yi Duan et al., 2026; arXiv:2609.11873).

Size
3.1 MB
Stars
164
Updated
CommitOct 01
Age
1mo
Commits · 90 Days
#8506 · +0 · 1d ·GitHub

Open source prompt injection protection for Agents calling tools (via MCP, CLI or direct function calling). Detect and defend against prompt injection attacks. 22MB, CPU-only, < 10ms latency.

Creator
StackOneHQ
Size
71.5 MB
Stars
127
Age
8mo
Commits · 90 Days