From the course: Generative AI: Introduction to Large Language Models

Unlock this course with a free trial

Join today to access over 25,500 courses taught by industry experts.

Challenges with large language models

Challenges with large language models

- [Instructor] The arrival of ChatGPT in November 2022 marked a new era in conversational AI. ChatGPT was trained using a variant of the Transformer model on a diverse range of texts from the internet. However, unlike the models that came before it, ChatGPT was also fine-tuned using human feedback. This allowed it to do a better job of learning the nuances of human conversation. The simplicity with which users could interact with the model meant that anyone, regardless of technical ability, could now engage effectively with a powerful large language model. This led to a blend of excitement and apprehension due to the potential implications of such a powerful AI tool. As large language models grow in size, capability, and popularity, we have to be clear-eyed about their ethical implications and potential for misuse. One area of concern is regard to bias and prejudice. AI models are only as good as the data they are trained…

Contents