If the specs seem outdated, it’s because this chip launched in 2024. It’s available at cloud providers including Cirrascale Show 2 replies

What's the price? Show 4 replies

Curious how the memory bandwidth actually holds up under sustained inference loads compared to the spec sheet numbers.

So it's an M4 Max Mac Studio, RAM-wise, with a GPU's worth of compute? Show 1 reply

Sort of interesting design It has half a terabyte of SRAM on the accelerator with a 128 GB of RAM replacing HBM with SRAM but keeping regular RAM. Show 1 reply

Seems like a reasonable general-purpose card.

Buy for the low, low price of - nope. Not for you.

    Cirrascale (8-card Ultra server, 128 GB each, 512 GB system RAM): 
    $4,699/mo (monthly term) or $3,759/mo (annual term)

    Cloud GPU rental (per-GPU): from $5.15/GPU/hr

ref: https://cloud-gpus.com/qualcomm-ai-100-ultra/ Show 1 reply

is this hexagon? Show 1 reply

Ok so it’s significantly worse than Apple M6 and we don’t know if it’s cheaper or not

Edit: Ah sorry you’re right, the bandwidth is lower but the TOPS is a lot higher. I’m not sure how much effect you get from higher TOPS with such low bandwidth though.

Show 4 replies

that's a slim card

Aren't these specs already outdated? Seems meh. I would think players would like to bring something new to the table instead of bringing what was okay two years ago or so.

Give me 1TB RAM and 5TB/s or something that exciting.

Show 5 replies