News Score: Score the News, Sort the News, Rewrite the Headlines

Raspberry Pi's new AI HAT adds 8GB of RAM for local LLMs

Today Raspberry Pi launched their new $130 AI HAT+ 2 which includes a Hailo 10H and 8 GB of LPDDR4X RAM.With that, the Hailo 10H is capable of running LLMs entirely standalone, freeing the Pi's CPU and system RAM for other tasks. The chip runs at a maximum of 3W, with 40 TOPS of INT8 NPU inference performance in addition to the equivalent 26 TOPS INT4 machine vision performance on the earlier AI HAT with Hailo 8.In practice, it's not as amazing as it sounds.You still can't upgrade the RAM on the...

Read more at jeffgeerling.com

© News Score  score the news, sort the news, rewrite the headlines