Member-only story
ChatGPT explained..
History of Chat GPT evolution, how ChatGPT works..
Everyone is talking about ChatGPT these days. Everyone is asking about, how it works? how the magic happens? These curious questions are being asked by lot of non-technical background peoples around me. I will try to explain here how ChatGPT works without going into technical details.
Since the release of ChatGPT from last year (Nov 2022), it has been wildly successful launch, that forces even tech giant like Google to rush to release of its version of GPT called Google Bard.
History of Chat GPT evolution:
Let's start with timeline of evolution of GPT and different versions of language transformer models.
ChatGPT launched by OpenAI, founded in 2015 for the purpose of Research in field of AI. Here is the brief history of evolution of GPT (Generative Pre-Trained Transformer).
As you can see from above timelines, that GPT evolved from transformer architecture and gained its abilities through many iterations.
How it works:
What ChatGPT does, it’s always fundamentally trying to do is to produce a “reasonable continuation” of whatever text it’s got so far, by “reasonable” we mean “what one might expect someone to write after seeing what people have written on billions of webpages, etc.”
A language model uses machine learning to conduct a probability distribution over words used to predict the most likely next word in a sentence based on the previous entry.
Language models learn from library of text (called corpus) and predict words or sequences of words with probabilistic distributions, i.e. how likely a word or sequence can occur.
So, let’s say we’ve got the text “AI has the ability to”. Imagine scanning billions of pages of human-written text (say on the web and in digitized books) and finding all instances of this text — then seeing what word comes next what fraction of the time. ChatGPT effectively does something like this, except that, it doesn’t look at literal text; it looks for things that in a certain sense “match in meaning”. But the end result is that it produces a ranked list of words that might follow, together with “probabilities”.
