AMD Ryzen AI Halo Is An Excellent & Powerful Mini PC With Fully Open-Source Software Review - Phoronix

AMD has unveiled the Ryzen AI Halo mini PC, a machine that can run up to 200 billion parameter LLMs locally with 128GB of unified memory. The review breathlessly hails the 'fully open-source software stack' while conveniently omitting that the firmware, drivers, and ROCm runtime are all proprietary – but hey, the kernel is GPL, so that's fine, right? Just like every other 'open-source' AI story, the devil is in the fine print: you can run LLaMA 3 all you want, but only if AMD's GPU compute stack doesn't crash first.

The real kicker: this 'mini PC' is essentially a development kit for AMD's upcoming Strix Halo APU, not a consumer product. The Phoronix review celebrates that the box can run 200B models with 'reasonable' token generation rates – 'reasonable' being the technologist's favourite euphemism for 'about a third of what a cheap RTX 4090 can do.' But hey, it's in a tiny chassis, so you can put it on your desk while your models trickle out a few tokens per second. Progress!

And let's not forget the wider context: this is AMD's bold attempt to break NVIDIA's stranglehold on local AI inference, but with a platform that has historically been a second-class citizen in machine learning. The Ryzen AI Halo is a capable piece of hardware, sure, but it's running on a software stack held together by duct tape and hope. If AMD wants to challenge CUDA's dominance, it needs more than a Debian-derived OS and a 128GB memory pool—it needs developers to care. And right now, they don't. So congratulations, AMD: you've built a fantastic toy for the three people who will actually use it for local LLM development. The rest of us will stick with the cloud.