WeWorkBuddy

Pretty Linear Liars: Unregularized Probes Favor Intervention-Unfaithful Features

arXiv:2611.20371v1 Announce Type: cross Abstract: Linear probing is a common technique in mechanistic interpretability despite the fact that the decodability of a given feature does not necessarily imply the network uses that feature. Intervention faithfulness, not merely decodability, is the appropriate criterion for whether a feature serves a defined active role in the model. Meanwhile, probe regularization has been used for feature discovery, but the impact of regularization on feature causal

Read original source
Source reference for Pretty Linear Liars: Unregularized Probes Favor Intervention-Unfaithful Features. Screenshot not yet available.
Source record · preview pending · arxiv.orgOpen the source for the full page.

Source record

Project analysis

Project analysis is not yet available. See the source record above.