WeWorkBuddy

BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions

arXiv:2406.15877v5 Announce Type: replace-cross Abstract: Task automation has been greatly empowered by the recent advances in Large Language Models (LLMs) via Python code, where the tasks ranging from software engineering development to general-purpose reasoning. While current benchmarks have shown that LLMs can solve tasks using programs like human developers, the majority of their evaluations are limited to short and self-contained algorithmic tasks or standalone function calls. Solving chall

阅读原始来源
来源参考:BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions。暂未取得截图。
来源记录 · 预览待采集 · arxiv.org打开来源查看完整网页。

来源记录

项目分析

暂无五维分析,可先查看上方来源资料。