SynthCorp: A Platform for Creating Benchmarks for Data Agents
arXiv:2611.14765v1 Announce Type: new Abstract: Current benchmarks for LLM-driven data agents saturate quickly and cannot target specific capabilities. We present SynthCorp, a platform that creates customizable data estates and benchmarks by simulating how business events produce and modify corporate data over time. Each data estate combines relational databases, a document store, and a data catalog, paired with evaluation tasks and executable gold programs. First, given a scenario and target co
阅读原始来源
来源记录
项目分析
暂无五维分析，可先查看上方来源资料。