Some materials for self-study

Sep 21, 2025

I consider all the materials below excellent as an introduction to the subject.

On LLMs, the best source is https://karpathy.ai/ He has a series of lectures on YouTube there about how they work.

Read the OpenAI and Anthropic blogs; there is a lot of good information there on the latest progress of frontier models.

Some videos I highly recommend watching:

• The moment we stopped understanding AI [AlexNet]
• Ilya Sutskever: “Sequence to sequence learning with neural networks: what a decade”

• [Visualizing transformers and attention

  Talk for TNG Big Tech Day ‘24](https://www.youtube.com/watch?v=KJtZARuO3JY&ab_channel=GrantSanderson)

• [Attention in transformers, step-by-step

  DL6](https://www.youtube.com/watch?v=eMlx5fFNoYc)

• A Survey of Techniques for Maximizing LLM Performance
• The New Stack and Ops for AI
• How do Graphics Cards Work? Exploring GPU Architecture

• [AI Semiconductor Landscape feat. Dylan Patel

  BG2 w/ Bill Gurley & Brad Gerstner](https://www.youtube.com/watch?v=QVcSBHhcFbg)

Originally posted in Russian on my telegram. This is a translation.

← all posts