AI / Machine Learning
Software that learns patterns from data instead of following hand-written rules.
Classical programming maps rules to answers. Machine learning maps examples to a model that then produces answers on new inputs.
Neural Network
Layers of simple numeric units that learn to transform inputs into outputs.
Each connection has a weight; training nudges weights so the network's outputs match the examples. Depth lets later layers combine simple features into complex ones.
A relay team where each runner slightly reshapes the baton before passing it on.
LLM — Large Language Model
A very large network trained to predict the next token of text.
Because next-token prediction over huge corpora requires modelling grammar, facts, and reasoning patterns, LLMs generalise to summarising, coding, translation, and dialogue.
Transformer
The architecture behind modern LLMs, built on attention.
Attention lets every token look at every other token and weigh which ones matter, so context is captured in parallel rather than word-by-word.
In a meeting, everyone hears everyone and decides who to listen to.
Token
The chunk of text a model actually reads and writes.
Roughly 3–4 characters of English. Pricing, context limits, and speed are all measured in tokens.
Context Window
How many tokens the model can consider at once.
Everything the model 'knows' in a turn — system prompt, history, retrieved documents, and its own answer — must fit inside this budget.
Parameters / Weights
The learned numbers inside a model.
Parameter count is a rough proxy for capacity, but data quality and training method matter as much as size.
Multimodal Model
A model that handles more than text — images, audio, or video.
Multimodal models encode different media into a shared representation, so you can ask questions about a picture or generate an image from a sentence.
Diffusion Model
The technique behind most image generators.
The model learns to reverse a noising process: starting from static, it repeatedly denoises toward an image matching your prompt.