LLM Hardware News
Latest LLM hardware news! Discover GPU releases, memory bandwidth advancements, and new platforms for running large language models locally.
Huge Speed Boost for GPT-OSS Models on Blackwell GPUs with llama.cpp
GPU
AMD Ryzen AI Max+ (Strix Halo) Gets Two New SKUs for Local LLM Systems
Strix Halo
RDMA over Thunderbolt Lets Mac Studios Run Huge Local LLMs Faster Than Expected
Llama.cpp Local LLMs on AMD Get 13% Faster Prompt Processing with RADV Vulkan Driver Update
GPU, Prompt processing
First Nvidia DGX Spark LLM Benchmarks Are In: Does It Beat Strix Halo
DGX Spark
Intel’s Nova Lake-AX for Local LLMs – What We Know So Far About AMD’s Halo Competitor
Unified memory, VRAM
Huawei’s Atlas 300I Duo offers 96GB VRAM for local LLMs under $1500. Is this the budget VRAM breakthrough?
VRAM
Local LLM VRAM Race: Can AMD’s AT0 Take the Lead From NVIDIA With a 512-Bit Bus?
Inference, VRAM
LLM VRAM Usage Cut by 45x? What Jet-Nemotron Really Means for Local Users
VRAM