My roadmap to learning LLMs:

• electrons
• circuits
• logic
• transistors
• comp arch
• CPUs
• GPUs
• linear algebra
• probability
• machine learning
• optimization
• optimizers
• tokenization
• transformers
• pretraining
• distributed training
• RL
• post training
• distillation
• quantization
• inference
• prompting

Useful Links:

• https://aman.ai/primers/ai/top-30-papers/
• https://www.linkedin.com/posts/ajay-halthor-477974bb_here-are-25-papers-to-get-you-up-to-speed-activity-7256666061343793154-DRso/
• https://www.linkedin.com/posts/ajay-halthor-477974bb_here-are-25-papers-to-get-you-up-to-speed-activity-7256666061343793154-DRso/