WeWorkBuddy

BigCodeArena: Unveiling More Reliable Human Preferences in Code Generation via Execution

arXiv:2510.08697v3 Announce Type: replace-cross Abstract: Crowdsourced model evaluation platforms, such as Chatbot Arena, enable real-time evaluation from human perspectives to assess the quality of model responses. In the coding domain, manually examining the quality of LLM-generated content is extremely challenging, as it requires understanding long chunks of raw code and deliberately simulating code execution. To this end, we introduce BigCodeArena, an open human evaluation platform for code

Read original source
Source reference for BigCodeArena: Unveiling More Reliable Human Preferences in Code Generation via Execution. Screenshot not yet available.
Source record · preview pending · arxiv.orgOpen the source for the full page.

Source record

Project analysis

Project analysis is not yet available. See the source record above.