Uncovering Faithfulness Gaps in VLMs via Explanation-Driven Counterfactual Testing
arXiv:2609.17953v2 Announce Type: replace-cross Abstract: Vision-Language Models (VLMs) can produce Natural Language Explanations (NLEs) that sound plausible yet remain inconsistent with the visual evidence they cite. We present Explanation-Driven Counterfactual Testing (EDCT), an intervention-based protocol that extracts visual concepts cited in a model's explanation, applies verified minimal edits to them, and tests whether the resulting answer and explanation remain consistent with the edited
Read original sourceSource record
Project analysis
Project analysis is not yet available. See the source record above.