← All frontier topics

Foundations · Beginner

How modern AI works

Tokens, embeddings, attention and scaling: the mechanics underneath every current model.

Why it matters

Every frontier technique is a variation on a few ideas. Knowing them lets you read new releases critically instead of taking claims on trust.

Key ideas

  1. Tokens and next-token prediction
  2. Embeddings
  3. Self-attention and the transformer
  4. Pre-training and scaling laws
  5. Context windows

You will be able to

  • Explain how an LLM produces text
  • Estimate cost from token counts
  • Read a model card

Primary reading

Learn it here

beginnerOnline course

Introduction to LLMs

A beginner-friendly course covering the fundamentals of Large Language Models — what they are, how they work, and how to use them effectively.

By Admin
Free courseView course

Related terms