AutoEMatic: Runtime-Adaptive Mixed-Precision LLM Inference via Automatic Exponent-Mantissa Refinement
arXiv:2611.10165v1 Announce Type: new Abstract: Existing LLM post-training quantization techniques determine precision before inference begins, yet the precision a model requires varies dynamically across prompts, layers, and inference phases. We present AutoEMatic, a full-stack co-design that adapts the precision of weights, activations, and the KV cache at runtime. A lightweight policy selects each layer's precision at every prefill and decode step from two runtime signals: the entropy of the
Read original source
Source record
Research analysis
Research claim
Paper identifier: 2611.10165. Source account: arXiv:2611.10165v1 Announce Type: new Abstract: Existing LLM post-training quantization techniques determine precision before inference begins, yet the precision a model requires varies dynamically across prompts, layers, and inference phases. We present AutoEMatic, a full-stack co-design that adapts the precision of weights, activations, and the KV cache at runtime. A lightweight policy selects each layer's precision at every prefill and decode step from two runtime signals: the entropy of the
Evaluation record
Recent records to compare: “Conformal Fair Decoding for Large Language Model Recommenders” (arXiv, Nov 10, 2026); “The Infrastructure Divide: Analyzing Community Stance on Data Center Development via Reddit” (arXiv, Nov 10, 2026). Shared themes are navigation hints; they have not been verified as the same need or independent corroboration.
What the result supports
Interpret results only for the reported model version, task, data and inference budget. Community votes, downloads or a benchmark position do not establish reliability in a different workflow.
Validity gaps
Check sample selection, baseline configuration, uncertainty, contamination risk, negative results and access to code or weights. No reproduction by WeWorkBuddy is recorded here.
Verification plan
Read the paper or model card and its evaluation appendix. Reproduce one bounded result against the stated baseline, then test a representative user task and record where the conclusion fails.