General discussion • Re: RPi 5 as a desktop daily driver?

The AMD Ryzen 7 8845HS Mini PC claims 16 TOPS.

That's pretty good for a Laptop chip, but will it run Linux?

Developers can leverage the AMD Vitis™ AI quantizer to quantize the model into INT8 and save it in ONNX format

That has to be faster than fp16?
Int2 faster than Int4, faster than In8, faster than fp16, faster than fp32?
So any Binary, Int2 NPUs? Can Int2 be fake ternary?

Those Ryzen AI NPUs look very handy, should be much cheaper than RTX4080?
GPU version with Windows Olive optimized code , hope Linux gets support.

Running on the default PyTorch path, the AMD Radeon RX 7900 XTX delivers1.87 iterations/second.
Running on the optimized model with Microsoft Olive, the AMD Radeon RX 7900 XTX delivers18.59 iterations/second.
End Result is up to 9.9X improvement in performance on AMD Radeon™ RX 7900 XTX.

But RX-7900 is similar in price to Nvidia GPU, $1100-1200 AUD.
New Motherboard $200 + AMD Ryzen™ AI 8700G CPU $539
If AMD is adding NPU to their CPUs now, who else is?

That's interesting, the RK3588 has support for Int4 and triple NPU core for 6TOPS.
Rock5 SBC $252 AUD?

So 4 levels of AI on Desktop, Pi5, Rock5, Ryzen AI, x86MB + GPU card.
Any useful NUCs with NPU? Ah, Intel Core Ultra is the NPU versions.
Those Core Ultra Laptops cost a bit, throw "AI" in the blurb and charge more?
2024 sure is turning into a year for AI, I wonder what this means for Gaming?

Statistics: Posted by Gavinmc42 — Sun Mar 24, 2024 1:21 pm

---