WeWorkBuddy

Show HN: TrnRT – An open-source LLM inference engine for AWS Trainium

Hi HN, Sanchit here from RunAnywhere (YC W26). We just open-sourced TrnRT: Trainium RunTime, our inference engine for AWS Trainium. We started 3 weeks back, and currently we’re able to serve and run GLM 5.3 flash (FP8) on AWS trn2.48xlarge, and will bring more models support soon. It’s open to contributions :) What it does today: - Serves 2 instances of GLM-5.3 flash on a single box, 8 trn2 with a cache aware router. - Can process 3.57M TPM (tokens per minute) on SemiAnalysis's AgentX benchmarks

Read original source
Source reference for Show HN: TrnRT – An open-source LLM inference engine for AWS Trainium. Screenshot not yet available.
Source record · preview pending · news.ycombinator.comOpen the source for the full page.

Source record

Recorded metrics

points · 42 votes
2026-11-18 00:29:12.837Z
cumulative since publication

Research analysis

Project record

Repository: RunanywhereAI/trnrt. Source account: Hi HN, Sanchit here from RunAnywhere (YC W26). We just open-sourced TrnRT: Trainium RunTime, our inference engine for AWS Trainium. We started 3 weeks back, and currently we’re able to serve and run GLM 5.3 flash (FP8) on AWS trn2.48xlarge, and will bring more models support soon. It’s open to contributions :) What it does today: - Serves 2 instances of GLM-5.3 flash on a single box, 8 trn2 with a cache aware router. - Can process 3.57M TPM (tokens per minute) on SemiAnalysis's AgentX benchmarks

Observed adoption & comparisons

Source votes: 42 votes (Nov 18, 2026 UTC; cumulative since publication); previous same-scope observation: 42 (Nov 18, 2026 UTC). These observations do not establish demand growth. Recent records to compare: “alicebrown323/pro-tools-desktop” (Trendshift, Nov 18, 2026); “jingyaogong/minimind” (Trendshift, Nov 18, 2026). Shared themes are navigation hints; they have not been verified as the same need or independent corroboration.

Adoption decision

Evaluate it against the tool or manual workflow it would replace. The stored record supports discovery; it does not yet establish reliability, lower operating cost or commercial adoption.

Unverified requirements

Not verified: license permissions, required hardware, installation steps, maintenance status and a representative task with its failure cases.

Next test

Choose one real task and a current alternative. Record the commit, environment, input, output, elapsed time and failure behavior; retain the result before recommending adoption.