The Ryzen APU could be interesting for running local AI models and with 128 GB of RAM you can fit quite a large model. Plus it should be relatively energy efficient compared to a full size desktop build with separate GPU. Lack of PCIe 5.0 is a bit of a bummer as you could otherwise plug in some new Samsung 9100 Pro NVMe drives.
Would love to see how it performs. It supposedly has a memory bandwidth of 256 GB/sec which is about similar to a Threadripper Pro 7965WX with 8 memory channels. A Mac Studio M2 Ultra has 800 GB/sec of bandwidth though (which is RTX4080/RTX5080 territory) but is also about 2-3x more expensive at 128 GB of memory, not to mention the cost of upgrading internal storage.
They should work just fine, sure peak bandwidth will be limited, but most workloads are not bottlenecked by I/O bandwidth on PCIe 4, but are limited by IOPs which should be decent on the 9100.
Would love to see how it performs. It supposedly has a memory bandwidth of 256 GB/sec which is about similar to a Threadripper Pro 7965WX with 8 memory channels. A Mac Studio M2 Ultra has 800 GB/sec of bandwidth though (which is RTX4080/RTX5080 territory) but is also about 2-3x more expensive at 128 GB of memory, not to mention the cost of upgrading internal storage.