But what is your honest answer? Aiding LLM-judges with honest alternatives using steering vectors
arXiv:2505.17760v4 Announce Type: replace-cross Abstract: LLM-as-a-judge is widely used as a scalable substitute for human evaluation, yet judges are least reliable on subtle dishonesty such as sycophancy and manipulation, where a judge scoring a response in isolation lacks a reference point. We introduce Judge Using Safety-Steered Alternatives (JUSSA), a framework that reduces this evaluator uncertainty using the assessed model's own internal representations. An honesty-promoting steering vecto
Read original sourceSource record
Project analysis
Project analysis is not yet available. See the source record above.