Leaderboard Hacking: Preference-Based Model Evaluations are Vulnerable to Manipulation
arXiv:2611.14769v1 Announce Type: new Abstract: Arena-style rankings of language models are a widely used evaluation framework in online leaderboards, research papers, and model evaluation in production. These rankings aim to realistically assess model performance using pairwise comparisons of anonymous models on user prompts, aggregating votes via the Bradley-Terry model to produce the final ranking. However, we find that these leaderboards are highly vulnerable to several manipulation strategi
阅读原始来源
来源记录
项目分析
暂无五维分析，可先查看上方来源资料。