WeWorkBuddy

But what is your honest answer? Aiding LLM-judges with honest alternatives using steering vectors

arXiv:2505.17760v4 Announce Type: replace-cross Abstract: LLM-as-a-judge is widely used as a scalable substitute for human evaluation, yet judges are least reliable on subtle dishonesty such as sycophancy and manipulation, where a judge scoring a response in isolation lacks a reference point. We introduce Judge Using Safety-Steered Alternatives (JUSSA), a framework that reduces this evaluator uncertainty using the assessed model's own internal representations. An honesty-promoting steering vecto

Read original source
Source reference for But what is your honest answer? Aiding LLM-judges with honest alternatives using steering vectors. Screenshot not yet available.
Source record · preview pending · arxiv.orgOpen the source for the full page.

Source record

Project analysis

Project analysis is not yet available. See the source record above.