llm
-
Virtualization
AWS Trainium2-powered Amazon EC2 Trn2 Instancess and Trn2 UltraServers | Amazon Web Services
AWS Trainium2-powered Amazon EC2 Trn2 Instances, are the most powerful EC2 instances for deep learning and generative AI and provide up to 30-40% better price performance than the current generation of GPU-based EC2 P5e and P5en instances. For the most demanding, state-of-the-art models that need more compute and memory than a single instance can deliver, Amazon EC2 Trn2 UltraServers are…
Read More » -
Proxmox
SUPER Cheap Ai PC – Low Wattage, Budget Friendly, Local Ai Server with Vision
Exploring the cheap end of AI we end up testing M2000 or K2200 and P2000s against CPU inference to see what local Ai performance looks like in the mid $100 price range. I thought going in it would be the K2200, but there is a twist to this so make sure you watch! SUPER BUDGET AI RIG Dell Optiplex 7050…
Read More » -
Linux
M4 Mac Mini CLUSTER 🤯
The M4 Mac Mini working together as a cluster. ⚡ M4 Mac Mini on sale NOW: Run Windows on a Mac FREE TRIAL: Use COUPON: ZISKIND10 🛒 Gear Links 🛒 🪛🪛Highly rated precision driver kit: ⌨️🏢 Keyboard for office (heavy): ⌨️☕ Keyboard for cafe (light): 💻☕ Favorite 15″ display with magnet: 🎧⚡ Great 40Gbps T4 enclosure: 🛠️🚀 My nvme ssd:…
Read More » -
VMware
Virtual Bytes Datacenter Update 2024 #dellemc #cloud #datacenter
Virtual Bytes Datacenter Update 2024 #dellemc #cloud #datacenter Production Environment & Infrastructure VMware Cloud Foundation 5.2.1 4 – Dell PowerEdge R70XD – Production Host All-Flash vSAN ESA Cluster (4 x DellEMC PowerEdge R740s) 2 x Intel Xeon Processor Gold 6138 2.0GHZ 27.5M 384GB RAM 20TB vSAN ESA Dual Mellanox ConnectX-4 LX 50Gb/s (Data, vSAN) Quad Intel X710 NDC SFP+ 10Gb/s…
Read More » -
Virtualization
The M4 Mac mini’s RIDICULOUS efficiency
The M4 Mac mini is so efficient, they couldn’t fit the power button on the front. Here are the resources I mentioned: – M4 Mac mini full test data: – M4 Mac mini HPL efficiency: – M4 Mac mini LLM efficiency: – M4 Mac mini power button bracket: Support me on Patreon: Sponsor me on GitHub: Merch: 2nd Channel: 3rd…
Read More » -
Proxmox
Local Ai Models on Quadro P2000 – Homelab testing Gemma Ai, Qwen2, Smollm, Phi 3.5, Llama 3.1
Longtime homelab favorite Quadro 2000 is a 5 GB GPU that is still pretty decent and in a lot of home servers already, but how does it handle running local LLMs? This is crazy, but it works and the performance IS NOT what you expect. Must watch if you have P2000 already in your system! I will cover some tips…
Read More »
