From the course: ChatGPT for Work: Bite-Sized Strategies

Understanding generative AI

So, you've tried ChatGPT, sometimes it's amazing, sometimes it completely fails. Why is it so inconsistent? Well, here's the thing. Understanding how ChatGPT actually works will help you get better, more consistent results, and it's not as complicated as you might think. ChatGPT is powered by something called GPT. That stands for Generative Pre-trained Transformer. Let me break that down. So first, generative means that it generates new text. Pre-trained means that it learns from massive amounts of text before you've ever even used it. And Transformer is the technical architecture, which you don't need to know the details of that. But what you do need to know is how it works. GPT is what we like to think of as a pattern prediction AI. Think of it like autocomplete on your phone, but on steroids. So you know how when you type in see you on your phone and their phones adjusts tomorrow or soon. So your phone has basically learned that pattern from your past messages and GPT works the same way, but at a massive scale. So instead of just your messages, GPT was trained on billions and billions of text examples. Think books, articles, websites, conversations. And from all of that text, it has learned a bunch of patterns. So basically whenever it's predicting, what it's trying to do is look at, if I see this phrase, then these are the words that typically follow. Or after this sentence structure, this type of response typically comes next. So when you type in a prompt into ChatGPT, the GPT is predicting the most likely next words based on all of those patterns that it's learned word by word. So it's not searching, it's not knowing facts, it's just predicting patterns.

Contents