WeWorkBuddy

See Every Block Once: Variance-Reduced Post-Training for Masked Diffusion Language Models

arXiv:2611.17754v1 Announce Type: new Abstract: Policy gradient methods are widely used to align large language model outputs with human preferences, but the log-likelihoods they require cannot be directly computed in Masked Diffusion Language Models (MDLMs). MDLM post-training therefore relies on a surrogate objective based on the Evidence Lower Bound (ELBO), and recent work estimates a blockwise variant of this objective via Monte Carlo methods to support blockwise generation. However, existin

Read original source
Source reference for See Every Block Once: Variance-Reduced Post-Training for Masked Diffusion Language Models. Screenshot not yet available.
Source record · preview pending · arxiv.orgOpen the source for the full page.

Source record

Project analysis

Project analysis is not yet available. See the source record above.