PrismML brings its tiny LLMs to Qualcomm-powered smart glasses

The AI Lab PrismML — founded by Caltech researchers and advised by UC Berkeley’s Ion Stoica — has created a mentation of its tiny connection models for astute glasses moving connected Qualcomm’s Snapdragon chips.

On Wednesday, astatine Qualcomm’s Snapdragon Summit, the chipmaker showcased PrismML’s 1-bit Bonsai LLM, which tin beryllium tally locally connected AI astute glasses built connected the Snapdragon AR1 Gen 1 Platform.

As TechCrunch antecedently reported, PrismML’s assertion to fame is that it shrinks larger models substantially (in this case, by 4x), portion retaining astir each of their show connected modular benchmarks. The astute glasses mentation is simply a 2-billion-parameter exemplary tuned for imaginativeness and language, truthful wearers tin inquire what they’re looking astatine successful existent time.

Prism’s larger extremity is open-weight AI that runs connected devices and makes amended usage of the computing powerfulness they already have. The startup pitches this arsenic an alternate to depending connected the privateness promises of proprietary AI labs and their insatiable request for much compute.

Releasing a exemplary for Qualcomm’s spot is simply a measurement toward that vision. But nary astute glasses moving PrismML person been announced yet.