vllm

Proxmox

REFLECTION Llama3.1 70b Tested on Ollama Home Ai Server – Best Ai LLM?

The buzz about the new Reflection Llama 3.1 Fine Tune being the worlds best LLM is all over the place, and today I am testing it out with you on the Home Ai Server that we put together recently. Running in Docker on a LXC in proxmox on my Epyc quad 3090 GPU Ai Rig. Ollama got out support for…