Train on prefill, monitor at decode: Using sparse autoencoders for topic monitoring
arXiv:2611.12935v1 Announce Type: new Abstract: Topic monitoring is the task of labelling the topic of each token in a model's response during generation. Activation-based monitors that run at generation time have so far been trained to detect harmful content and are limited to two or three classes. We introduce TopicScope, a framework for training causal topic classifiers on SAE features that assign a topic to every token, so that the label can change partway through a response. We train three
Read original source
Source record
Research analysis
Research claim
Paper identifier: 2611.12935. Source account: arXiv:2611.12935v1 Announce Type: new Abstract: Topic monitoring is the task of labelling the topic of each token in a model's response during generation. Activation-based monitors that run at generation time have so far been trained to detect harmful content and are limited to two or three classes. We introduce TopicScope, a framework for training causal topic classifiers on SAE features that assign a topic to every token, so that the label can change partway through a response. We train three
Evaluation record
Recent records to compare: “Multi-Future Drafting: Mixture Block Drafters for Tree-Verified Speculative Decoding” (arXiv, Nov 11, 2026); “Understanding-First AI Engineering: Purposes, Reference Architecture, and Architectural Patterns for Human Understanding” (arXiv, Nov 11, 2026). Shared themes are navigation hints; they have not been verified as the same need or independent corroboration.
What the result supports
Interpret results only for the reported model version, task, data and inference budget. Community votes, downloads or a benchmark position do not establish reliability in a different workflow.
Validity gaps
Check sample selection, baseline configuration, uncertainty, contamination risk, negative results and access to code or weights. No reproduction by WeWorkBuddy is recorded here.
Verification plan
Read the paper or model card and its evaluation appendix. Reproduce one bounded result against the stated baseline, then test a representative user task and record where the conclusion fails.