FREE: Any Ollama A.I. Model On n8n Self-Hosted!🦙🤖 Llama 3.1 – Docker, Coolify, Portainer🐋 (Make.com)

Would it be easier to use docker compose?

would it run 70b for free? btw, if you haven't tried it already, I'd recommend checking out Open-Interpreter, it's like AI for your OS. I use it with gpt-4o-mini often and it will do things for you like enter all those docker commands: github OpenInterpreter/open-interpreter. The same dev has another project called '01' (OpenInterpreter/01) which is like Interpreter with a voice, but I haven't been able to run it on Windows successfully, I wouldn't mind seeing a video on that sometime