Pretty Linear Liars: Unregularized Probes Favor Intervention-Unfaithful Features
arXiv:2611.20371v1 Announce Type: cross Abstract: Linear probing is a common technique in mechanistic interpretability despite the fact that the decodability of a given feature does not necessarily imply the network uses that feature. Intervention faithfulness, not merely decodability, is the appropriate criterion for whether a feature serves a defined active role in the model. Meanwhile, probe regularization has been used for feature discovery, but the impact of regularization on feature causal
Read original sourceSource record
Project analysis
Project analysis is not yet available. See the source record above.