AI - LLM - What word comes next

Seed text → Predict next word


Read input (does not have to be purely text, could be any input including sound, images).

Lookup Table

Weights = which words are associated with other words.

Activation

Aim for low cost; in determining the next word.