Show HN: An immutable local inference appliance with routing capability
Hey HN I’ve been working on a little side project after spending a bunch of time customising my inference stack at home. I figured it’d be nice to have something relatively portable, easily maintainable and configurable through a UI. It’s early days, there is built support for Vulkan, HIP and CUDA but I’ve only really tested it on AMD (that’s what I’ve got). So more hardware exposure would be awesome along with feedback and the like. At the moment there is no commercial model. Just wanting to ge
阅读原始来源
来源记录
指标快照
points · 1 votes
2026-11-08 05:15:12.370Z
cumulative since publication
研究分析
项目记录
仓库：diffsec/sibyl。 来源描述：Hey HN I’ve been working on a little side project after spending a bunch of time customising my inference stack at home. I figured it’d be nice to have something relatively portable, easily maintainable and configurable through a UI. It’s early days, there is built support for Vulkan, HIP and CUDA but I’ve only really tested it on AMD (that’s what I’ve got). So more hardware exposure would be awesome along with feedback and the like. At the moment there is no commercial model. Just wanting to ge
采用记录与比较对象
来源票数: 1 votes (2026年11月8日 UTC; cumulative since publication) 可供比较的近期同类记录：“Show HN: Maple – Sub-2-BPW Moe Pruning to Run Gemma 4 26B at 45 TPS on a 6GB GPU” (Show HN, 2026年11月8日)；“Show HN: LLM weight editing tool made by a 15-year-old” (Show HN, 2026年11月8日)。主题相近仅用于导航，未核验其是否属于同一需求或独立证据。
采用判断
应与它要替代的工具或人工流程比较。现有记录支持发现项目，尚不能确认可靠性、运行成本优势或商业采用。
尚未核验的门槛
尚未核验：许可证权限、硬件要求、安装步骤、维护状态，以及包含失败样例的代表性任务。
下一步试验
选择一个真实任务和现有替代方案，记录 commit、环境、输入、输出、耗时与失败行为；保留结果后再给出采用建议。