The silent page awaits the waking dawn.

AI Infra Learning Resources

·(edited)·· readsHandmade

AI TranslationSimplified ChineseEnglish

Summary:

A running list of resources I've found useful while learning about LLMs; updated regularly

URL	Notes	Add_time
Modular Handbook	LLM inference handbook; the diagrams are great. Fairly comprehensive coverage — good for beginners.	2026-09-23
Inference Engineering	The green book covers a lot of ground — good for beginners. The appendix materials are excellent.	2026-09-23
https://github.com/lilinji/ai-infra-odyssey	Still working through it; some of the content looks AI-generated.	2026-09-23
zero-to-sglang 《从零手搓SGLang》—— 从零构建 LLM 推理引擎 datawhalechina.github.io	A SGLang course from datawhale. Still being updated.	2026-10-12
Introduction - How to Write an Inference Engine The Muser book — a zero-to-hero guide to Muse Glimmer on Apple Metal, kvpack, and disaggregated NVFP4 prefill. High Performance AI Lab	The author wrote an open-source inference engine in Rust and paired it with a book that explains how it works in detail.	2026-10-12
https://github.com/patchy631/time-to-first-token	A 10-week structured course in inference engineering.	2026-10-18
PaperLeet - LeetCode for AI Researchers PaperLeet - LeetCode for AI Researchers. Implement 105 Python exercises from research papers and prepare for machine learning interviews. PaperLeet	A Chinese-language site of hands-on LLM implementation exercises.	2026-10-19
TrenTorch \| Free ML practice problems: build PyTorch from scratch 1647 free machine learning practice problems. Build PyTorch from scratch in Python and run the tests in your browser: classical ML, deep learning, transformers, inference, and more. TrenTorch	English site, similar to LeetCode — more problems and broader coverage.	2026-10-19