ai server
-
Proxmox
REFLECTION Llama3.1 70b Tested on Ollama Home Ai Server – Best Ai LLM?
The buzz about the new Reflection Llama 3.1 Fine Tune being the worlds best LLM is all over the place, and today I am testing it out with you on the Home Ai Server that we put together recently. Running in Docker on a LXC in proxmox on my Epyc quad 3090 GPU Ai Rig. Ollama got out support for…
Read More » -
Proxmox
Proxmox Ai Homelab all-in-one Home Server – Docker Dockge LXC with GPU Passthrough
One server for the ultimate Homelab, multi 3090 GPU LXC and Docker host has turned into a really cool rig. I show you here the complete step by step setup from Proxmox to Nvidia Drivers to Nvidia Container Toolkit and then we setup a LXC to house a docker that handles GPU passthru with bare metal speeds. Then I install…
Read More »
