Show HN: AI Vision Index, private tests of how well 36 AI models see
I wanted to know for my work which model is best at vision tasks (using both llms like claude and smaller models like YOLO - smaller specialist models are still not finished testing). I found that none of the public benchmarks were reliable: datasets were available (so they could have been used for training), and not precise enough tests. So we built our own tests, with a mix of rendered images, ai generated images, photos and videos. Every question & image pair has a specific answer, and we
Read original source
Source record
Recorded metrics
points · 1 votes
2026-11-10 13:00:31.075Z
cumulative since publication
Research analysis
What changed
Source account: I wanted to know for my work which model is best at vision tasks (using both llms like claude and smaller models like YOLO - smaller specialist models are still not finished testing). I found that none of the public benchmarks were reliable: datasets were available (so they could have been used for training), and not precise enough tests. So we built our own tests, with a mix of rendered images, ai generated images, photos and videos. Every question & image pair has a specific answer, and we
Version & cost evidence
Source votes: 1 votes (Nov 10, 2026 UTC; cumulative since publication) Recent records to compare: “Show HN: Deep Cuts – music discovery via credits instead of algorithms” (Show HN, Nov 10, 2026); “[分享创造] 自己攒了个 AI 说唱站，从 topic 到词、歌、视频都能走” (V2EX, Nov 10, 2026). Shared themes are navigation hints; they have not been verified as the same need or independent corroboration.
Who is affected
Identify the existing workflow this change affects before recommending an upgrade. Launch attention does not establish improvement; an API, pricing or availability change may instead create migration work.
Missing comparison points
Missing checks: old versus new behavior, affected plans and regions, availability date, compatibility, rollback path and cost under the same workload.
Migration check
Save the release or policy notice, run the same task on the old and new option, and compare outputs and the full bill. For retirement notices, verify the deadline before scheduling migration.