local ai
-
Proxmox
SUPER Cheap Ai PC – Low Wattage, Budget Friendly, Local Ai Server with Vision
Exploring the cheap end of AI we end up testing M2000 or K2200 and P2000s against CPU inference to see what local Ai performance looks like in the mid $100 price range. I thought going in it would be the K2200, but there is a twist to this so make sure you watch! SUPER BUDGET AI RIG Dell Optiplex 7050…
Read More » -
Linux
M4 Mac Mini CLUSTER π€―
The M4 Mac Mini working together as a cluster. β‘ M4 Mac Mini on sale NOW: Run Windows on a Mac FREE TRIAL: Use COUPON: ZISKIND10 π Gear Links π πͺπͺHighly rated precision driver kit: β¨οΈπ’ Keyboard for office (heavy): β¨οΈβ Keyboard for cafe (light): π»β Favorite 15″ display with magnet: π§β‘ Great 40Gbps T4 enclosure: π οΈπ My nvme ssd:…
Read More » -
Proxmox
Qwen QwQ 2.5 32B Ollama Local AI Server Benchmarked w/ Cuda vs Apple M4 MLX
The new Qwen with Questions aka QwQ LLM fine tune based off the popular Qwen 2.5 32B base is a unique step in chain of though and reasoning which really is impressive! I was lucky enough to find some stats from a X poster about their Apple Q8 M4 Max Tokens per second also to compare against for all those…
Read More » -
Proxmox
Llama 3.2 Vision 11B LOCAL Cheap AI Server Dell 3620 and 3060 12GB GPU
We are testing a killer cheap AI home server off a single 3060 GPU and a 3620, a very low cost and surprisingly capable when paired with the new Llama 3.2 11B LLM powered by Ollama, OpenWEBUI and LCX containers in Proxmox. Cheap AI Server Dell Precision 3620 Tower 3060 12GB GPU GPU 6 to 8 pin Power Adapter Ai…
Read More » -
Proxmox
How to Use Bolt.new for FREE with Local LLMs (And NO Rate Limits)
Over the last month, together as a community we started oTToDev, a fork of Bolt.new that aims to add a bunch of much needed functionality like being able to use any LLM you want, including local ones with Ollama. In this video I give some super important tips and tricks for using local LLMs with oTToDev, some of which can…
Read More » -
Linux
Interview with Artyom Zorin of Zorin OS
Support the show by becoming a patron at or get some swag at SHOW NOTES βΊβΊ Hosted by: Michael Tunnell = Jill Bryant = Ryan (DasGeek) = — Chapters: 00:00:00 Intro 00:01:11 Interview begins 00:01:32 Open Source Origin Story for Artyom Zorin 00:05:12 The Target Audience of Zorin OS 00:07:34 Why Zorin OS Shines Among Giants 00:09:39 Why choose Gnome?…
Read More »