Pretty Linear Liars: Unregularized Probes Favor Intervention-Unfaithful Features
arXiv:2611.20371v1 Announce Type: cross Abstract: Linear probing is a common technique in mechanistic interpretability despite the fact that the decodability of a given feature does not necessarily imply the network uses that feature. Intervention faithfulness, not merely decodability, is the appropriate criterion for whether a feature serves a defined active role in the model. Meanwhile, probe regularization has been used for feature discovery, but the impact of regularization on feature causal
阅读原始来源来源记录
项目分析
暂无五维分析,可先查看上方来源资料。