"Generative AI" covers chatbots, image makers, voice clones and coding assistants. Strip away the branding and they share one mechanism: a model that has learned the shape of its training data well enough to produce convincing new samples of it.
01Beyond the hype
It helps to separate two kinds of AI. Discriminative models tell things apart — spam or not, cat or dog. Generative models create new things that resemble their training data. The leap of the last few years is that generation reached a quality where the output is genuinely useful.
02Recognising vs creating
A discriminative model learns a boundary: where does "cat" end and "dog" begin? A generative model learns something harder — the whole distribution of what cats look like — so it can draw a new, never-seen cat. Learning to recognise is easier than learning to create, which is why generation took longer to crack.
Both learn from the same kind of data, but answer different questions. Generative AI is the harder, newer of the two to do well.
03Learn, then sample
Training teaches the model the statistical patterns of the data. Generation then samples from those patterns, usually one piece at a time: a language model predicts the next token, an image model refines noise into a picture step by step. Randomness in the sampling is why you get a different result each time — and why the same prompt can be creative or generic.
04One idea, many media
The same learn-then-sample principle spans every medium. Only the data and the architecture change.
Text, images, audio and code are all generated by learning a distribution and sampling from it. The unifying idea is older than the products built on it.
05Practical uses
For most organisations the value is mundane and real: drafting and summarising, translating, brainstorming, generating first-draft images and code, and answering questions over internal documents. Treated as a fast junior assistant whose work you check, it is transformative. Treated as an oracle, it disappoints.
06Creativity & trust
Generative AI raises genuine questions: it can fabricate facts, reproduce biases, blur authorship and enable convincing fakes. None of this is reason to avoid it, but all of it is reason to keep a human in the loop, label AI-generated content, and verify anything that matters. The skill is no longer producing content — it is judging it.
What to remember
- Generative AI learns the patterns of data, then samples new examples.
- Discriminative models recognise; generative models create.
- Generation usually proceeds one step at a time, with randomness for variety.
- The same learn-then-sample idea spans text, images, audio and code.
- It is most valuable as a checkable assistant, not an oracle.
- Fabrication, bias and authorship demand a human in the loop.
