How ChatGPT Actually Works
You are about to do the same thing it does.
01
Start here
Can you do what ChatGPT does?
Spoiler: you already can.
fill in the blank
02
Think about it
What just happened?
Less than you think.
the tiny move
03
Take it further
But how does a whole answer appear?
Watch closely.
building the answer
04
How it trained
How did it learn to guess well?
The hard way.
the training loop
05
The training data
What did it learn from?
From lots of human writing.
training data
06
Context
Does it remember what came before?
Further back than you'd expect.
find the connection
07
The catch
It doesn't know when it's wrong.
The wording that sounds most certain is the one to watch.
fact check
08
The short version
So what actually is it?
You've been doing it this whole time.
Read the full article →
the full picture