From the course: Handling Sensitive Data with Cloud and Local AI
Unlock this course with a free trial
Join today to access over 25,500 courses taught by industry experts.
Deploying an on-premise assistant
From the course: Handling Sensitive Data with Cloud and Local AI
Deploying an on-premise assistant
In this one, we're going to deploy an on-premise assistant that is gonna be somewhat similar to ChatGPT or Cloud. Now, when you deploy such an assistant, there are some things to keep in mind. First of all, regardless of whether this assistant has an authentication system or not, you don't wanna just put it on the internet without any mechanisms to secure it in place. And what you'd wanna do is use a local network, a virtual private network or VPN, or a secure tunnel in order to provide access to this assistant. Finally, you wanna make sure you harden whatever components serve this assistant. So from the operating system onwards, you wanna make sure all components are audited and secured, and you wanna make sure that the physical hardware is secure as well. Now, some tools I've used to add security to assistants like this in the past include Tailscale, which is a virtual private network. It has some free tier, but if you're gonna be using this for enterprise, you wanna make sure you…