Show HN: TheoremSmith: Mass-Producing Hard Proof Problems to Train LLMs
Making models better at formal verification will help push the boundaries of math research and significantly reduce the number of bugs in our code. Recently, training models on RL environments (tasks paired with verifiers that reward correct solutions) has driven big gains in model performance, and proofs are unusually easy to verify. Here we introduce TheoremSmith, a pipeline for generating synthetic formal verification environments. It reliably creates multi-hour, frontier-difficulty tasks and
Read original source
Source record
Recorded metrics
points · 4 votes
2026-11-10 19:15:20.659Z
cumulative since publication
Research analysis
What changed
Source account: Making models better at formal verification will help push the boundaries of math research and significantly reduce the number of bugs in our code. Recently, training models on RL environments (tasks paired with verifiers that reward correct solutions) has driven big gains in model performance, and proofs are unusually easy to verify. Here we introduce TheoremSmith, a pipeline for generating synthetic formal verification environments. It reliably creates multi-hour, frontier-difficulty tasks and
Version & cost evidence
Source votes: 4 votes (Nov 10, 2026 UTC; cumulative since publication) Recent records to compare: “Show HN: A sanctions and PEP screening API” (Show HN, Nov 10, 2026); “Show HN: You can now train your own LLMs with less memory, on your consumer GPUs” (Hacker News, Nov 10, 2026). Shared themes are navigation hints; they have not been verified as the same need or independent corroboration.
Who is affected
Identify the existing workflow this change affects before recommending an upgrade. Launch attention does not establish improvement; an API, pricing or availability change may instead create migration work.
Missing comparison points
Missing checks: old versus new behavior, affected plans and regions, availability date, compatibility, rollback path and cost under the same workload.
Migration check
Save the release or policy notice, run the same task on the old and new option, and compare outputs and the full bill. For retirement notices, verify the deadline before scheduling migration.