V-JEPA-LM: Video-Language Models That Read Dynamics Beyond Static, Text-Aligned Representations
arXiv:2611.17831v1 Announce Type: cross Abstract: World-model video encoders such as V-JEPA learn how scenes change (direction, speed, order, state) from video alone. To answer questions, they are joined to a language model trained on captions and question-answer pairs. But each caption or question names only a few attributes of a clip, so the model learns to retrieve those attributes rather than to read the clip, and the dynamics the encoder carries go unused: on the same items, a linear probe
阅读原始来源来源记录
项目分析
暂无五维分析,可先查看上方来源资料。