Apple is in talks with PrismML, a stealthy California Institute of Technology (Caltech) spinout, as it looks to drastically reduce its reliance on the cloud and run heavyweight AI entirely on-device.

The discussions, first reported by The Information, come on the heels of a massive technical breakthrough from the startup: PrismML successfully compressed Alibaba’s 27-billion-parameter open-source Qwen 3.6 model to run locally on an iPhone 17 Pro.

Typically, cramming a model of that caliber onto a smartphone requires a "sparse architecture"—meaning the phone only wakes up a fraction of the AI’s brain at any given moment to keep the device from melting. PrismML completely flips the script.

• 
  

  The Shrink: Squeezed the model from a massive 54 GB down to less than 4 GB.

  
  


• 
  

  The Brainpower: Keeps all 27 billion parameters active simultaneously without sacrificing benchmark performance.

  
  


• 
  

  The Core Tech: Built on ultra-dense 1-bit and ternary weight architectures (reducing memory footprint up to 14x while running up to 8x faster).

  
  

Why this matters for Apple: Local AI means total user privacy, lightning-fast response times, and zero reliance on a cellular connection. It also saves Apple from paying astronomical cloud server bills.

At WWDC, Apple made waves by introducing a revamped Siri architecture. However, many of those advanced features still rely on sending data off-device to Google’s Gemini models in the cloud.

By actively hunting for acquisition targets like PrismML, Apple is aiming to shift those heavy AI workloads back into your pocket. While rivals like Meta, Microsoft, and Amazon are committing hundreds of billions to build out massive AI data centers, Apple’s ultimate power move might just be making the data center obsolete for the everyday user.