稍候片刻，月出文自明。

AI Infra 学习资源

·(已編輯)·· 閱讀手作

摘要：

学习 LLM 过程中，发现的不错的资料; 持续更新

URL	备注	Add_time
Modular Handbook	llm 推理手册, 配图很不错覆盖面比较全, 适合入门	2026-09-23
Inference Engineering	绿皮书覆盖面很广, 适合入门附录资料很好	2026-09-23
https://github.com/lilinji/ai-infra-odyssey	还在学习，看起来有 AI 生成的内容	2026-09-23
zero-to-sglang 《从零手搓SGLang》—— 从零构建 LLM 推理引擎 datawhalechina.github.io	datawhale 出品的sglang 学习课程目前还在更新中	2026-10-12
Introduction - How to Write an Inference Engine The Muser book — a zero-to-hero guide to Muse Glimmer on Apple Metal, kvpack, and disaggregated NVFP4 prefill. High Performance AI Lab	作者用 rust 写的 1 个开源的推理引擎，配套写了本书详细讲解了实现原理	2026-10-12
https://github.com/patchy631/time-to-first-token	10 周系统学习推理工程	2026-10-18
PaperLeet - LeetCode for AI Researchers PaperLeet - LeetCode for AI Researchers. Implement 105 Python exercises from research papers and prepare for machine learning interviews. PaperLeet	一个中文版的手动实现 LLM 相关细节的网站	2026-10-19
TrenTorch \| Free ML practice problems: build PyTorch from scratch 1647 free machine learning practice problems. Build PyTorch from scratch in Python and run the tests in your browser: classical ML, deep learning, transformers, inference, and more. TrenTorch	英文站点，类似 leetcode, 题目更多覆盖更广	2026-10-19