Topics / #llm-observability

LLM observability projects on GitHub

Tracing, monitoring, and evaluating LLM application behavior.

As of , the most-starred LLM observability projects on GitHub are langfuse (35.9K stars), signoz (32.4K stars) and opik (22.7K stars). GitHub.Locker tracks 12 LLM observability repositories with 146.2K stars combined. The fastest-growing on October 16 was cost-xray, with +206 stars in a day.

12Projects
146.2KStars in total
+514Stars in a day
Browse in the catalog →github.com/topics/llm-observability ↗

Hot right now

Most stars gained in a day · Oct 16

+206

cost-xray

tigerless-labs/cost-xray · ★ 5.4K

cost-xray is a local tool that captures the raw API traffic between Claude Code or Codex and their providers, then breaks down exactly what's in each request and what each part costs — system prompts, tool schemas, MCP blocks, cached vs fresh tokens, and more.

+104

ThinkWatch-Lite

ThinkWatchProject/ThinkWatch-Lite · ★ 824

ThinkWatch Lite is a local gateway that sits between AI coding clients (Claude Code, Codex, and others) and their upstream providers, letting you switch providers and models without reconfiguring each client, while tracking request cost and blocking malicious tool calls.

+54

langfuse

langfuse/langfuse · ★ 35.9K

Langfuse is an open source LLM engineering platform for tracing, evaluating, and debugging LLM and agent applications, with prompt management and a playground built in.

+52

failproofai

FailproofAI/failproofai · ★ 5.6K

Failproof AI is an observability and enforcement layer that sits inside AI agent harnesses (coding CLIs, chat gateways, self-hosted assistants), capturing every run and blocking dangerous tool calls before they execute.

The all-time top

12 projects · by stars

  1. #1 · langfuse/langfuse

    langfuse

    Langfuse is an open source LLM engineering platform for tracing, evaluating, and debugging LLM and agent applications, with prompt management and a playground built in.

    35.9K
  2. #2 · SigNoz/signoz

    signoz

    SigNoz is an open-source observability platform built on OpenTelemetry: logs, metrics, traces, alerts, and dashboards in one tool for debugging production apps and monitoring AI agents.

    32.4K
  3. #3 · comet-ml/opik

    opik

    Opik is an open-source platform for debugging, evaluating, and monitoring LLM applications, RAG systems, and agentic workflows, with tracing, automated evaluation, and production dashboards.

    22.7K
  1. 4

    openobserve

    22.4Kopenobserve/openobserve · TypeScript

    OpenObserve is an open-source, cloud-native observability platform for logs, metrics, traces, frontend monitoring (RUM), session replay and AI/LLM observability — a cost-effective alternative to Datadog, Splunk and Elasticsearch.

  2. 5

    voltagent

    10.8KVoltAgent/voltagent · TypeScript

    VoltAgent is an end-to-end AI agent engineering platform: an open-source TypeScript framework for building agents with memory, tools, RAG, workflows and voice, plus the VoltOps Console for observability and operations.

  3. 6

    bifrost

    8.9Kmaximhq/bifrost · Go

    An open-source, high-performance AI gateway that unifies 23+ LLM providers behind a single OpenAI-compatible API, with automatic failover, load balancing, semantic caching, and budget controls built in.

  4. 7

    failproofai

    5.6KFailproofAI/failproofai · TypeScript

    Failproof AI is an observability and enforcement layer that sits inside AI agent harnesses (coding CLIs, chat gateways, self-hosted assistants), capturing every run and blocking dangerous tool calls before they execute.

  5. 8

    cost-xray

    5.4Ktigerless-labs/cost-xray · Python

    cost-xray is a local tool that captures the raw API traffic between Claude Code or Codex and their providers, then breaks down exactly what's in each request and what each part costs — system prompts, tool schemas, MCP blocks, cached vs fresh tokens, and more.

  6. 9

    Tracely-ai

    829jwuthri-cloud/Tracely-ai · Python

    Tracely is a trace-native CI/CD platform for AI agents: it grades every production agent trace, clusters failures into issues, freezes bad runs into hermetic regression tests, blocks the PR that would ship them again, and alerts you when it happens.

  7. 10

    ThinkWatch-Lite

    824ThinkWatchProject/ThinkWatch-Lite · TypeScript

    ThinkWatch Lite is a local gateway that sits between AI coding clients (Claude Code, Codex, and others) and their upstream providers, letting you switch providers and models without reconfiguring each client, while tracking request cost and blocking malicious tool calls.

  8. 11

    OrcaReplay

    285Continuum-AI-Corp/OrcaReplay · TypeScript

    OrcaReplay records a coding agent's entire run (model calls, tool calls, shell commands, file changes), then lets you replay that exact run offline with no model called, fork it from any checkpoint onto a different model, and compare models side by side on the same task.

  9. 12

    dsh-plugin-agent-workflow

    255xuanyuanzhifeng/dsh-plugin-agent-workflow · TypeScript

    It is a web UI plugin for DeepSeek Harness (DSH) that adds a new 'Workflow' tab, turning each user conversation turn into a clear execution chain of the agent's model requests, model responses, and tool calls.

Often tagged together