What is this?
Egma is an open-source platform for testing voice agents before you ship them and monitoring them in production — simulated regression suites plus live analytics of real conversations.
Egma is an open-source platform for testing voice agents before you ship them and monitoring them in production — simulated regression suites plus live analytics of real conversations.Is this a cloud service or something I host myself?Either: use hosted Egma Cloud or self-host it on your own machine and open it in the browser. Your test suites live in the agent's own repository and run through the Egma CLI or a coding agent.
Either: use hosted Egma Cloud or self-host it on your own machine and open it in the browser. Your test suites live in the agent's own repository and run through the Egma CLI or a coding agent.How do I run my first test?Open your voice agent's repo in your coding agent and paste the setup prompt from the README — the first simulation takes about five minutes. To self-host instead, configure .env, start Egma and create your account at localhost:3101.
Open your voice agent's repo in your coding agent and paste the setup prompt from the README — the first simulation takes about five minutes. To self-host instead, configure .env, start Egma and create your account at localhost:3101.Which voice agent platforms does it work with?Right now only agents built on LiveKit (JS/TS) or Retell are supported; other platforms can be requested on Discord. You also plug in your own model-provider API keys.
Right now only agents built on LiveKit (JS/TS) or Retell are supported; other platforms can be requested on Discord. You also plug in your own model-provider API keys.What can't it do yet?Self-hosting takes extra time for installation and the first build, and automatic fixes are still just a roadmap idea — today Egma covers testing and production monitoring only.
Self-hosting takes extra time for installation and the first build, and automatic fixes are still just a roadmap idea — today Egma covers testing and production monitoring only.What does Egma cost, and how is it licensed?The repository is MIT-licensed except for the ee folders, and self-hosting is free; on model usage you pay providers directly, with no Egma markup.
The repository is MIT-licensed except for the ee folders, and self-hosting is free; on model usage you pay providers directly, with no Egma markup.What does an Egma test actually simulate?Suites of simulated voice and text conversations with mocked tool responses. You can customize caller personas, pick the models used, and set grading instructions and pass thresholds for the behavior you want to verify.
Suites of simulated voice and text conversations with mocked tool responses. You can customize caller personas, pick the models used, and set grading instructions and pass thresholds for the behavior you want to verify.Does it only test voice, or text agents too?Both: regression suites mix simulated voice and text conversations, so text-based agents get the same treatment as voice ones.
Both: regression suites mix simulated voice and text conversations, so text-based agents get the same treatment as voice ones.What does production monitoring show me?Real conversations, tool calls and metrics from live traffic. Graders check your agent's behavior so you can investigate failures.
Real conversations, tool calls and metrics from live traffic. Graders check your agent's behavior so you can investigate failures.What's on the roadmap?Automatic fixes: Egma plans to take a production failure, propose a change to your voice agent's harness, test it, and open a pull request for you to review.
Automatic fixes: Egma plans to take a production failure, propose a change to your voice agent's harness, test it, and open a pull request for you to review.What are similar projects?voltagent, testsprite-cli, agenttrail, hive, mission-control, dsh-plugin-agent-workflow, Tracely-ai, agents-cli
voltagent, testsprite-cli, agenttrail, hive, mission-control, dsh-plugin-agent-workflow, Tracely-ai, agents-cliWhich topics is it in?agent-monitoring, agent-evaluation, self-improving, voice-agent, agent-observability, voice-ai, conversational-ai, test-automation, byok, voice, ci, observability
agent-monitoring, agent-evaluation, self-improving, voice-agent, agent-observability, voice-ai, conversational-ai, test-automation, byok, voice, ci, observability