BigCodeArena: Unveiling More Reliable Human Preferences in Code Generation via Execution
arXiv:2510.08697v3 Announce Type: replace-cross Abstract: Crowdsourced model evaluation platforms, such as Chatbot Arena, enable real-time evaluation from human perspectives to assess the quality of model responses. In the coding domain, manually examining the quality of LLM-generated content is extremely challenging, as it requires understanding long chunks of raw code and deliberately simulating code execution. To this end, we introduce BigCodeArena, an open human evaluation platform for code
Read original sourceSource record
Project analysis
Project analysis is not yet available. See the source record above.