This is great as a first look, but the author is not a developer, so we don't yet know whether a dev can be as productive with local models on M5 Mac Studio compared to a 20x subscription plan.
I'm also curious about any new low hanging optimization opportunities in the kernels for this new hardware.
It's already clear to me that M5 Mac Studio is more cost-effective than anything you can run on open router, assuming decent utilization.
The M5 Mac Studio will be the most cost effective way to run uncensored cyber capable open agents.
An exciting tipping point will be if programmers can get an Astra-Ultra like experience all week with this hardware. That would be a real sense where this hardware exceeds the value of even 20x cloud subscriptions.
On Apple website it says 512GB memory option is available in October. I guess bumping to that one would cost additional 4-6k US$. So an Ultra with 2TB storage would be north of 15k US$.
That’s like 12 years worth of OpenAI Pro subscriptions
While I know it's not apples to apples, the target comparison right now is 2x DGX Sparks. Similar price, 256gb. The conversation has focused on memory bandwidth vs. compute in agentic loops, so for most people the raw numbers will mean less than the "time per task" in coding benchmarks.
This is a great article and bodes well for the M5, but we should expect more like this comparing to other platforms before we truly understand where it fits.
When people benchmark MLX related quant models, they really need to publish numbers on benchmarks. You cannot take this as it is what you get of the original models. MLX uses pretty simple quantization methods so at lower bits without QAT, it is just not as good quality as llama.cpp ones.
Once you hit the memory you need, generation speed is mainly set by bandwidth, and every Ultra from M1 thru M3 has ~800 GB/s. IMO best ROI for most people is 'cheapest used Ultra with enough RAM'
I setup an eBay alert and picked up a used M2 Ultra that has delivered good ROI (at least, far better than 15k for comparable-for-my-use-case performance)
The Cost of a 27- inch fully loaded iMac from Apple
$3,700 in 2011 is worth $5,510.05 today (fully loaded) used for 10 years.
The Mac Pro Tower plus the Cinema Display monitor at the time was even more, similar to the Studio M5 ULtra today than the iMac which I believe was an upper middle computer?
$5,700 in 2011 is worth $8,488.46 today
$7,700 in 2011 is worth $11,466.87 today
The cost of Mac Studio M5 Ultra today $9,466.87-$11,466.87
Note: If memory cost was the same as it was two years ago subtract about $2000-$3000 dollars.
Today’s prices are not that far off from top end computers.
> "It also happens to be a Mac, with an operating system that looks nice and doesn’t suck"
Yes Apple has some of the best hardware out there, albeit overpriced. But the software is such a hindrance and I can't take anyone that states otherwise seriously. If only it had proper Linux support (and the Asahi people do an amazing job but you can reverse-engineer only so many stuff with limited funding, and then you have to do it again for new models). MacOS is good if you just want to have a standard experience, which to be fair is most people. It's good for just setting up an LLM server I guess since the hardware is a perfect fit. I wouldn't touch it otherwise.
I find it funny that the thing always mentioned with this machine is local AI. If you're a local model enthusiast, then maybe that makes sense, but I just don't see the economics working there.
I ordered the same one for work so I could run more local agents at once (many iOS simulators and Xcode build processes).
I think Apple is really sleeping on making this run a Linux server. These things are very capable and draw very little wattage when idle. It would make an excellent homelab device, but MacOS currently holds it back in this regard.
My mac is 5 years old. I don't think I can comfortably buy a new one right now. It has a 16GB unified RAM. Honestly that would be enough for so many local models that I want to use but can't use. Because RAM usage (even with literally every single user installed app quit/stopped) the RAM usage is very high that I can barely safely get 6-7 GB (I am supposed to get ~10 GB, but it goes up and down real fast!). That's a shame. If only I could install an alternative OS that uses very little amount of RAM :-)
What do people realistically do with these? It's too slow and du... not SOTA-level for coding. It's way too slow for video. I tried simulating an "Fable herding Qwen subagents" and it takes much longer and delivers a much worse result than Fable/Astra alone.
At this point I think I will get the DGX gb300 workstation though I will wait a bit more for the cold season. It is double the price but at least is the real thing
Ordered one for OpenFOAM. Excited for it. Will be nice to not have my laptop running CFD 24 hours a day, but my M1 Max is currently my fastest machine… I’m expecting about 3.5x from the M5 Ultra.
I think we'll eventually get to the point where folks will have a local AI agent but I think people need to temper their expectations to a degree. You aren't going to have data center level tok/s from a box sitting under your desk and you don't need instantaneous responses for many workloads. Having a local agent that can execute tasks over a couple days with your supervision that might otherwise take you weeks is perfectly acceptable.
However I also think that Agentic AI is very much not an out-of-the-box solution, local or otherwise, and it takes a high level of technical knowledge to create an effective AI agent. And there's a problem now where most orchestration is fixed on what models are used for what tasks with no ability to weight constraints like cost, speed, and security.
Everyone looking at the Qwen3 27B model and the 5090. It’s like saying a Porsche is better than a $5m Komatsu earth mover at moving a 20lb carry-on suitcase. Yes. Yes it is. Why do people spend $5m on a komatsu then, when this one metric shows the Porsche is better? Huh. Show us the “Moving 300 metric tonnes in one load” metric. How’s the Porsche now? Oh, the Porsche is in the Komatsu? Ok I’m getting a bit carried away with that analogy.
M5 Ultra Mac Studio Review
(macstories.net)250 points by piotrgrabowski 20 hours ago | 246 comments
Comments
I'm also curious about any new low hanging optimization opportunities in the kernels for this new hardware.
It's already clear to me that M5 Mac Studio is more cost-effective than anything you can run on open router, assuming decent utilization.
The M5 Mac Studio will be the most cost effective way to run uncensored cyber capable open agents.
An exciting tipping point will be if programmers can get an Astra-Ultra like experience all week with this hardware. That would be a real sense where this hardware exceeds the value of even 20x cloud subscriptions.
That’s like 12 years worth of OpenAI Pro subscriptions
This is a great article and bodes well for the M5, but we should expect more like this comparing to other platforms before we truly understand where it fits.
I didn't expect this to make the 5090 to look like a good deal.
I setup an eBay alert and picked up a used M2 Ultra that has delivered good ROI (at least, far better than 15k for comparable-for-my-use-case performance)
The Mac Pro Tower plus the Cinema Display monitor at the time was even more, similar to the Studio M5 ULtra today than the iMac which I believe was an upper middle computer?
$5,700 in 2011 is worth $8,488.46 today
$7,700 in 2011 is worth $11,466.87 today
The cost of Mac Studio M5 Ultra today $9,466.87-$11,466.87
Note: If memory cost was the same as it was two years ago subtract about $2000-$3000 dollars.
Today’s prices are not that far off from top end computers.
https://www.officialdata.org/us/inflation/2011?amount=3700
Yes Apple has some of the best hardware out there, albeit overpriced. But the software is such a hindrance and I can't take anyone that states otherwise seriously. If only it had proper Linux support (and the Asahi people do an amazing job but you can reverse-engineer only so many stuff with limited funding, and then you have to do it again for new models). MacOS is good if you just want to have a standard experience, which to be fair is most people. It's good for just setting up an LLM server I guess since the hardware is a perfect fit. I wouldn't touch it otherwise.
I ordered the same one for work so I could run more local agents at once (many iOS simulators and Xcode build processes).
- https://sunkcost.ai/s/mac-studio-m5-max-128/qwen3.8-27b-q4/?...
However I also think that Agentic AI is very much not an out-of-the-box solution, local or otherwise, and it takes a high level of technical knowledge to create an effective AI agent. And there's a problem now where most orchestration is fixed on what models are used for what tasks with no ability to weight constraints like cost, speed, and security.
Ehh, the actual elephant in the room is:
"why bother with local AI at all when you can lease a GPU for $5/hr?"
To which the answer is you shouldn't bother, unless you have a bunch of money to throw at hobby projects.