Google Coral is probably the most famous and is mainly suited for small IoT devices, e.g. speeding up image recognition for security cameras. They come in all shapes and sizes though.
The fact that i didnt know about those means that consumers have zero need for them and building them into consumer hardware is just an attempt to keep the AI bubble afloat.
Just offer NPUs as PCIe extension cards. Thats how computers used to be and should be. Modular and versatile.
Already existed for half a decade.
Google Coral is probably the most famous and is mainly suited for small IoT devices, e.g. speeding up image recognition for security cameras. They come in all shapes and sizes though.
M.2 Accelerator A+E key | Coral - https://www.coral.ai/products/m2-accelerator-ae
The fact that i didnt know about those means that consumers have zero need for them and building them into consumer hardware is just an attempt to keep the AI bubble afloat.
I considered getting one of these in the past for Frigate, but I ended up getting Reolink cameras with human detection built-in.
Exactly!
I could even see the cards having ram slots, so you can add dedicated ram to the NPU to remove the need for sharing ram with the system