The silent page awaits the waking dawn.

AI Infra Learning Resources

·(edited)·· readsHandmade

AI TranslationSimplified ChineseEnglish

Summary:

A running list of resources I've found useful while learning about LLMs; updated regularly

URL	Notes	Add_time
Modular Handbook	LLM inference handbook — the illustrations are really nice. Fairly comprehensive coverage, great for beginners.	2026-09-23
Inference Engineering	The green book covers a lot of ground and is great for beginners. The appendix material is excellent.	2026-09-23
https://github.com/lilinji/ai-infra-odyssey	Still working through it; some of it looks AI-generated.	2026-09-23
Redirecting… datawhalechina.github.io	A SGLang course from Datawhale. Still being updated.	2026-10-12
Introduction - How to Write an Inference Engine The Muser book — a zero-to-hero guide to Muse Glimmer on Apple Metal, kvpack, and disaggregated NVFP4 prefill. High Performance AI Lab	An open-source inference engine written in Rust by the author, with a companion book that walks through how it works in detail.	2026-10-12