Report: Apple interested in startup that runs giant AI models on iPhone without servers

According to a report by The Information, Apple has held meetings with PrismML, a startup that has developed technology to run a 27-billion-parameter AI model on a device without server assistance. PrismML plans to release its model as open source on July 14. The meetings indicate Apple's interest in enhancing on-device AI capabilities while maintaining its privacy stance.

The technology allows a 27B parameter model to operate entirely locally, a significant advancement in on-device AI. This could reduce reliance on cloud processing, potentially improving response times and data security. Apple's interest aligns with its history of emphasizing privacy and on-device processing.

If Apple adopts this technology, it could differentiate its devices in AI performance without compromising its privacy narrative. The open-source release on July 14 will likely attract widespread developer attention. The outcome of the meetings is not yet known.