From the course: Oracle Cloud Infrastructure AI Foundations Cert Prep
Join today to access over 25,500 courses taught by industry experts.
Transformers: Part one - Oracle Cloud Infrastructure Tutorial
From the course: Oracle Cloud Infrastructure AI Foundations Cert Prep
Transformers: Part one
(gentle music) - [Instructor] Hello and welcome. Until now, we have looked at generative AI and large language models. In the next two lessons, we are going to dive deeper into the transformer architecture. So this is the part one of the transformer architecture series. Now understanding language for machines can be tricky. Let's look at a different example than what we have been using until now and see why this is the case. So we have a sentence here, which is very simple, and it says, Jane threw the frisbee and her dog fetched it. Now it's a very simple sentence for a human to comprehend. Jane is doing the throwing, dog is doing the fetching, and the frisbee is being thrown, and it in this sentence refers to the frisbee. Now as a human, we understand easily that it refers to the frisbee, but for a machine, this can be quite tricky. We have used a kind of an architecture called recurrent neural networks, RNN, for handling this kind of data. RNNs are a class of neural network…
Download courses and learn on the go
Watch courses on your mobile device without an internet connection. Download courses using your iOS or Android LinkedIn Learning app.