Show HN: Apgar – Catch agent regressions without an LLM judge
Hey HN, We build financial AI agents, and Apgar is the tool we wrote to see whether a harness change made an agent better or worse in production. Our offline evals can't cover every kind of question or session real users bring, and the LLM judge we run in Langfuse is too expensive to use on more than a small slice of traffic, so some failures get through. Apgar is a small release health checker that sits on top of our Langfuse data. It picks up the release from the production traces, and for the
阅读原始来源
来源记录
指标快照
points · 3 votes
2026-10-30 15:00:05.255Z
cumulative since publication
研究分析
项目记录
仓库：oimo-ai/apgar。 来源描述：Hey HN, We build financial AI agents, and Apgar is the tool we wrote to see whether a harness change made an agent better or worse in production. Our offline evals can't cover every kind of question or session real users bring, and the LLM judge we run in Langfuse is too expensive to use on more than a small slice of traffic, so some failures get through. Apgar is a small release health checker that sits on top of our Langfuse data. It picks up the release from the production traces, and for the
采用记录与比较对象
来源票数: 3 votes (2026年10月30日 UTC; cumulative since publication)；前次同口径记录为 3（2026年10月30日 UTC），两个观测值不等于需求增长。 可供比较的近期同类记录：“google/skills” (GitHub Trending, 2026年11月6日)；“mattpocock/skills” (GitHub Trending, 2026年11月6日)。主题相近仅用于导航，未核验其是否属于同一需求或独立证据。
采用判断
应与它要替代的工具或人工流程比较。现有记录支持发现项目，尚不能确认可靠性、运行成本优势或商业采用。
尚未核验的门槛
尚未核验：许可证权限、硬件要求、安装步骤、维护状态，以及包含失败样例的代表性任务。
下一步试验
选择一个真实任务和现有替代方案，记录 commit、环境、输入、输出、耗时与失败行为；保留结果后再给出采用建议。