ProcessPrefBench: Evaluating Cross-Task Transfer of Individual Process Preferences from Naturalistic Human-AI Interaction
arXiv:2611.06065v1 Announce Type: new Abstract: In natural human-AI dialogue, users' corrections, requests, and self-descriptions carry reusable signals about how they want work to be done. These signals reveal individual process preferences, user-specific standards for evidence, depth, analytical focus, procedure, and delivery. We ask whether a preference revealed in one dialogue can shape an assistant's later answer when the task does not restate it. ProcessPrefBench uses three months of natur
阅读原始来源来源记录
研究分析
研究主张
论文标识:2611.06065。 来源描述:arXiv:2611.06065v1 Announce Type: new Abstract: In natural human-AI dialogue, users' corrections, requests, and self-descriptions carry reusable signals about how they want work to be done. These signals reveal individual process preferences, user-specific standards for evidence, depth, analytical focus, procedure, and delivery. We ask whether a preference revealed in one dialogue can shape an assistant's later answer when the task does not restate it. ProcessPrefBench uses three months of natur
评测与比较记录
尚未提取结构化结果表、数据集、比较基线和评测预算。来源描述中的性能数字仍属于原作者主张。
结论适用范围
结论只能在所述模型版本、任务、数据与推理预算内解释。社区票数、下载量或榜单位置不能证明另一工作流中的可靠性。
有效性与复现缺口
需核对样本选择、基线配置、不确定性、数据污染风险、负面结果以及代码或权重可获取性;此处没有本站复现实验记录。
复核路线
阅读论文或模型卡及评测附录,针对明确基线复现一个有限结论,再测试代表性用户任务并记录结论失效的场景。