From the course: NVIDIA Certified Associate AI Infrastructure and Operations (NCA-AIIO) Cert Prep

Unlock this course with a free trial

Join today to access over 25,500 courses taught by industry experts.

NVIDIA technology stack

NVIDIA technology stack

There are so many technologies developed by NVIDIA in terms of hardware and software, it is impossible to cover everything in one single training. And it is impossible to put them together into a layered format. What I tried to do here, I have created this six-layer architectural diagram for you to understand how these components fit together. Obviously, this is not an exhaustive list. I tried to focus on the most important concept to get started with and then also which are important for exam. We would first start by understanding physical layer. All the physical component, those CPUs and systems and node and network architectures and network component. Then we'll talk about data movement, how these devices communicate with each other, what technologies NVIDIA has developed for faster and efficient communication, which are NVLink, RDMA, InfiniBand. Then comes operating system for these nodes, that is DGX-OS, GPU drivers are there, virtualization technologies for GPU exists, so we'll…

Contents