llm
-
Virtualization
AWS Trainium2-powered Amazon EC2 Trn2 Instancess and Trn2 UltraServers | Amazon Web Services
AWS Trainium2-powered Amazon EC2 Trn2 Instances, are the most powerful EC2 instances for deep learning and generative AI and provide up to 30-40% better price performance than the current generation of GPU-based EC2 P5e and P5en instances. For the most demanding, state-of-the-art models that need more compute and memory than a single instance can deliver, Amazon EC2 Trn2 UltraServers are…
Read More » -
Proxmox
SUPER Cheap Ai PC – Low Wattage, Budget Friendly, Local Ai Server with Vision
Exploring the cheap end of AI we end up testing M2000 or K2200 and P2000s against CPU inference to see what local Ai performance looks like in the mid $100 price range. I thought going in it would be the K2200, but there is a twist to this so make sure you watch! SUPER BUDGET AI RIG Dell Optiplex 7050…
Read More » -
Linux
M4 Mac Mini CLUSTER π€―
The M4 Mac Mini working together as a cluster. β‘ M4 Mac Mini on sale NOW: Run Windows on a Mac FREE TRIAL: Use COUPON: ZISKIND10 π Gear Links π πͺπͺHighly rated precision driver kit: β¨οΈπ’ Keyboard for office (heavy): β¨οΈβ Keyboard for cafe (light): π»β Favorite 15″ display with magnet: π§β‘ Great 40Gbps T4 enclosure: π οΈπ My nvme ssd:…
Read More » -
VMware
Virtual Bytes Datacenter Update 2024 #dellemc #cloud #datacenter
Virtual Bytes Datacenter Update 2024 #dellemc #cloud #datacenter Production Environment & Infrastructure VMware Cloud Foundation 5.2.1 4 β Dell PowerEdge R70XD β Production Host All-Flash vSAN ESA Cluster (4 x DellEMC PowerEdge R740s) 2 x Intel Xeon Processor Gold 6138 2.0GHZ 27.5M 384GB RAM 20TB vSAN ESA Dual Mellanox ConnectX-4 LX 50Gb/s (Data, vSAN) Quad Intel X710 NDC SFP+ 10Gb/s…
Read More » -
Virtualization
The M4 Mac mini’s RIDICULOUS efficiency
The M4 Mac mini is so efficient, they couldn’t fit the power button on the front. Here are the resources I mentioned: – M4 Mac mini full test data: – M4 Mac mini HPL efficiency: – M4 Mac mini LLM efficiency: – M4 Mac mini power button bracket: Support me on Patreon: Sponsor me on GitHub: Merch: 2nd Channel: 3rd…
Read More » -
Proxmox
Llama 3.2 Vision 11B LOCAL Cheap AI Server Dell 3620 and 3060 12GB GPU
We are testing a killer cheap AI home server off a single 3060 GPU and a 3620, a very low cost and surprisingly capable when paired with the new Llama 3.2 11B LLM powered by Ollama, OpenWEBUI and LCX containers in Proxmox. Cheap AI Server Dell Precision 3620 Tower 3060 12GB GPU GPU 6 to 8 pin Power Adapter Ai…
Read More »
