AI Infra Learning Resources

Modular Handbook

• The LLM Inference Handbook — the diagrams are excellent.
• Broad coverage, good for beginners.

2026-09-23

Inference Engineering

• The green book ("Green Book") covers a wide range of topics and is a good starting point.
• The appendix material is great.

2026-09-23

https://github.com/lilinji/ai-infra-odyssey

• Still working through it — looks like it contains some AI-generated content.

2026-09-23