Qualcomm announced the 150W Cloud AI 100 Ultra accelerator

Qualcomm has introduced a new AI accelerator, the Cloud AI 100 Ultra, in a PCIe card form factor with a power consumption of 150W.

The device is equipped with 128 GB of LPDDR4x memory, which provides a bandwidth of 548 GB/s. The new product's performance reaches 870 TOPS in INT8 operations, which is optimized for working with large language models.

The new accelerator is aimed at server deployments where energy efficiency is critical when processing requests to language models.