WeWorkBuddy

V-JEPA-LM: Video-Language Models That Read Dynamics Beyond Static, Text-Aligned Representations

arXiv:2611.17831v1 Announce Type: cross Abstract: World-model video encoders such as V-JEPA learn how scenes change (direction, speed, order, state) from video alone. To answer questions, they are joined to a language model trained on captions and question-answer pairs. But each caption or question names only a few attributes of a clip, so the model learns to retrieve those attributes rather than to read the clip, and the dynamics the encoder carries go unused: on the same items, a linear probe

阅读原始来源
来源参考:V-JEPA-LM: Video-Language Models That Read Dynamics Beyond Static, Text-Aligned Representations。暂未取得截图。
来源记录 · 预览待采集 · arxiv.org打开来源查看完整网页。

来源记录

项目分析

暂无五维分析,可先查看上方来源资料。