See Every Block Once: Variance-Reduced Post-Training for Masked Diffusion Language Models
arXiv:2611.17754v1 Announce Type: new Abstract: Policy gradient methods are widely used to align large language model outputs with human preferences, but the log-likelihoods they require cannot be directly computed in Masked Diffusion Language Models (MDLMs). MDLM post-training therefore relies on a surrogate objective based on the Evidence Lower Bound (ELBO), and recent work estimates a blockwise variant of this objective via Monte Carlo methods to support blockwise generation. However, existin
阅读原始来源来源记录
项目分析
暂无五维分析,可先查看上方来源资料。