IBM (NYSE: IBM) and Together AI have signed a multi-year, $240 million agreement to deploy a large-scale AI inference cluster on IBM Cloud using Nvidia HGX B300 systems and Nvidia Spectrum-X Ethernet networking, according to a press release from IBM.

The cluster is expected to be available in the first quarter of 2027. Together AI will use the infrastructure to provide open-source model inference to enterprises. IBM describes the deployment as the first dedicated, large-scale inference cluster on IBM Cloud built with HGX B300 systems.

Nvidia states the HGX B300 systems are built to deliver 30 times more AI factory output compared to prior generations.

"Enterprises want the performance of the best frontier models without the closed-model price tag, and that only works if the infrastructure underneath is fast and reliable at scale," said Vipul Ved Prakash, CEO of Together AI. "This cluster lets us bring production-grade inference to more companies, faster."

Together AI recently raised an $800 million Series C financing round at an $8.3 billion valuation. The company reports it is currently serving 400 trillion tokens monthly on its inference platform.

The agreement expands an existing collaboration between IBM and Nvidia, which previously announced joint work across GPU-native data analytics, unstructured data extraction, and on-premises and cloud infrastructure.