Criterion-Activated Preference Synthesis: Attribution-Preserving Preference Data from Explicit Standards
arXiv:2611.18663v1 Announce Type: new Abstract: Direct Preference Optimization (DPO) is notoriously sensitive to attribution ambiguity: when chosen and rejected responses differ along multiple entangled dimensions, the model cannot identify which behavior the preference label teaches. We propose Criterion-Activated Preference Synthesis (CAPS), a criterion-first framework that turns explicit quality standards into attribution-verified preference pairs. CAPS synthesizes contexts and responses from
Read original sourceSource record
Project analysis
Project analysis is not yet available. See the source record above.