JustVugg/colibri
A hierarchical inference engine for frontier MoE models: hot experts on the GPU (CUDA, Vulkan), warm ones in RAM, cold ones streamed from NVMe. Written in C, runs on the hardware you already own.
Read original source
Source record
Recorded metrics
daily_stars · 802 stars today
2026-11-04 06:15:22.667Z
GitHub daily Trending window; attention only
Research analysis
Project record
Repository: JustVugg/colibri. Source account: A hierarchical inference engine for frontier MoE models: hot experts on the GPU (CUDA, Vulkan), warm ones in RAM, cold ones streamed from NVMe. Written in C, runs on the hardware you already own.
Observed adoption & comparisons
Stars in source daily window: 802 stars today (Nov 4, 2026 UTC; GitHub daily Trending window; attention only); previous same-scope observation: 802 (Nov 4, 2026 UTC). These observations do not establish demand growth. Recent records to compare: “FareedKhan-dev/kimi-k3-in-c” (GitHub Trending, Nov 5, 2026); “Open source AI is booming. Hugging Face explains who profits.” (TechCrunch, Nov 4, 2026). Shared themes are navigation hints; they have not been verified as the same need or independent corroboration.
Adoption decision
Evaluate it against the tool or manual workflow it would replace. The stored record supports discovery; it does not yet establish reliability, lower operating cost or commercial adoption.
Unverified requirements
Not verified: license permissions, required hardware, installation steps, maintenance status and a representative task with its failure cases.
Next test
Choose one real task and a current alternative. Record the commit, environment, input, output, elapsed time and failure behavior; retain the result before recommending adoption.