Criterion-Activated Preference Synthesis: Attribution-Preserving Preference Data from Explicit Standards
arXiv:2611.18663v1 Announce Type: new Abstract: Direct Preference Optimization (DPO) is notoriously sensitive to attribution ambiguity: when chosen and rejected responses differ along multiple entangled dimensions, the model cannot identify which behavior the preference label teaches. We propose Criterion-Activated Preference Synthesis (CAPS), a criterion-first framework that turns explicit quality standards into attribution-verified preference pairs. CAPS synthesizes contexts and responses from
阅读原始来源来源记录
项目分析
暂无五维分析,可先查看上方来源资料。