ai server
-
Proxmox
SUPER Cheap Ai PC – Low Wattage, Budget Friendly, Local Ai Server with Vision
Exploring the cheap end of AI we end up testing M2000 or K2200 and P2000s against CPU inference to see what local Ai performance looks like in the mid $100 price range. I thought going in it would be the K2200, but there is a twist to this so make sure you watch! SUPER BUDGET AI RIG Dell Optiplex 7050…
Read More » -
Proxmox
Qwen QwQ 2.5 32B Ollama Local AI Server Benchmarked w/ Cuda vs Apple M4 MLX
The new Qwen with Questions aka QwQ LLM fine tune based off the popular Qwen 2.5 32B base is a unique step in chain of though and reasoning which really is impressive! I was lucky enough to find some stats from a X poster about their Apple Q8 M4 Max Tokens per second also to compare against for all those…
Read More » -
Proxmox
Insane Homelab is a MESS!
Bugs, cables, obsolete hardware and even snakes have taken up residence in my homelab errr garage datacenter. You tell me. I’m spending my weekend cleaning up this mess and doing a few upgrades to hardware while I am at it! And if you wanna see more check out some videos below. Homelab Storage Server All About NetApp DE6600 JBODS $350…
Read More » -
Proxmox
Homelab Al Server Multi GPU Benchmarks – Multiple 3090s and 3060ti mixed PCIe VRAM Performance
Looking for information on what performance you can expect on your Homelab OpenwebUI and Ollama based Ai Home server? This is the video! We will be using Llama3.1 70b and assessing Tokens per Second on many model variations. Have questions about mixed VRAM setups? Need to run your GPU on a smaller PCIe slot than a full 16x? I dive…
Read More » -
Proxmox
Shocking Claims: Is the New AI Model Reflection 70B a Total Scam?
Your Queries: llama, llm, ollama, reflection, reflection ai, reflection llama ai, ai, huggingface, claude 3.5 sonnet benchmarks, open ai chatgpt new features, reflection 70b, llama reflection, llama reflection 70b, reflection tuning, reflection llama 70b, reflection 405b, reflection ai, claude 3.5 opus, chatgpt memory, ai news, gpt5, llama, llm, ollama, proxmox, ai server, home ai server, home ai, ai home server,…
Read More » -
Proxmox
Proxmox Ai Homelab all-in-one Home Server – Docker Dockge LXC with GPU Passthrough
One server for the ultimate Homelab, multi 3090 GPU LXC and Docker host has turned into a really cool rig. I show you here the complete step by step setup from Proxmox to Nvidia Drivers to Nvidia Container Toolkit and then we setup a LXC to house a docker that handles GPU passthru with bare metal speeds. Then I install…
Read More »
