ollama
-
Proxmox
SUPER Cheap Ai PC – Low Wattage, Budget Friendly, Local Ai Server with Vision
Exploring the cheap end of AI we end up testing M2000 or K2200 and P2000s against CPU inference to see what local Ai performance looks like in the mid $100 price range. I thought going in it would be the K2200, but there is a twist to this so make sure you watch! SUPER BUDGET AI RIG Dell Optiplex 7050…
Read More » -
Proxmox
Qwen QwQ 2.5 32B Ollama Local AI Server Benchmarked w/ Cuda vs Apple M4 MLX
The new Qwen with Questions aka QwQ LLM fine tune based off the popular Qwen 2.5 32B base is a unique step in chain of though and reasoning which really is impressive! I was lucky enough to find some stats from a X poster about their Apple Q8 M4 Max Tokens per second also to compare against for all those…
Read More » -
Virtualization
How is Apple M4 Mac Mini for Programming – AI – Coding – React JS
I tried Apple’s new M4 Mac Mini for my daily programming tasks where I create websites, code, do some web design etc. The Mac Mini is the newest product from Apple with the new M4 Chip and it’s meant to be a powerhouse, but how does it stack up when doing things like running AI models, coding in vs code,…
Read More » -
Proxmox
Llama 3.2 Vision 11B LOCAL Cheap AI Server Dell 3620 and 3060 12GB GPU
We are testing a killer cheap AI home server off a single 3060 GPU and a 3620, a very low cost and surprisingly capable when paired with the new Llama 3.2 11B LLM powered by Ollama, OpenWEBUI and LCX containers in Proxmox. Cheap AI Server Dell Precision 3620 Tower 3060 12GB GPU GPU 6 to 8 pin Power Adapter Ai…
Read More » -
Proxmox
How to Use Bolt.new for FREE with Local LLMs (And NO Rate Limits)
Over the last month, together as a community we started oTToDev, a fork of Bolt.new that aims to add a bunch of much needed functionality like being able to use any LLM you want, including local ones with Ollama. In this video I give some super important tips and tricks for using local LLMs with oTToDev, some of which can…
Read More » -
Virtualization
Practical Experience: How to setup Open-Source Software Safely
Are you ready to level up your tech skills and dive into the world of virtualization? In this video, Ricardo from *lessonswithricardo* shows you how to get hands-on experience with real-world software, all while keeping your computer safe! ππ» We’ll cover four key steps: 1. Finding open-source software using GitHub ( and tools like Olama. 2. Understanding virtualization and why…
Read More »