Astera Labs launches Orion, a modular rack-scale AI inference design

Go back to Astera Labs launches Orion, a modular rack-scale AI inference design

Astera Labs Unveils Orion: A Compute-Agnostic Rack-Scale Architecture for Token-Efficient AI Factories

October 12, 2026 9:00 AM EDT

Modular, production-grade reference designs are designed to help neoclouds and enterprises quickly scale AI inference capacity up and across with up to 160 accelerators per pod

News Highlights:

Bring Your Own GPU/CPU: Modular Orion reference architecture is designed to give customers the flexibility to choose accelerators and CPUs based on availability, lead time, cost, target applications, or workloads.A faster-path to AI inference capacity: Six production-grade reference designsspanning rack, compute tray, fabric tray, memory tray, link board, and compute boardhelp to accelerate time-to-market... More