WeWorkBuddy

Criterion-Activated Preference Synthesis: Attribution-Preserving Preference Data from Explicit Standards

arXiv:2611.18663v1 Announce Type: new Abstract: Direct Preference Optimization (DPO) is notoriously sensitive to attribution ambiguity: when chosen and rejected responses differ along multiple entangled dimensions, the model cannot identify which behavior the preference label teaches. We propose Criterion-Activated Preference Synthesis (CAPS), a criterion-first framework that turns explicit quality standards into attribution-verified preference pairs. CAPS synthesizes contexts and responses from

Read original source
Source reference for Criterion-Activated Preference Synthesis: Attribution-Preserving Preference Data from Explicit Standards. Screenshot not yet available.
Source record · preview pending · arxiv.orgOpen the source for the full page.

Source record

Project analysis

Project analysis is not yet available. See the source record above.