Method 4: Run O.S. Models on the Cloud
Method 4: Run O.S. Models on the Cloud
Embedded Files
Please read About Open-Source AI Models first
This method is one of the best to use but a little clunky as well.
In the published example we are using Google’s Colab servers to run a script that allows the user to chat with an open source model.
This uses resources from Google’s servers, which is not cost free for Google’s, allowing us to run complex and intelligent models for free.
First step: Install dependencies.
Second step: pick an AI model
Third step: chat!
Click on the Google Colab logo to see method 4's example.
Another way to do this is to setup Ollama, like in method 3, but on a private server like a VPS.
I suggest getting a VPS from OVH Cloud and setting up an ollama instance on that.
Its cheaper than most AI plans and it gives you full privacy while using way smarter models that you would on local hardware.
P.S.: that's one of my setups ;)
Page updated
Google Sites
Report abuse