Meta Confirms Production Use of Google TPUs Through SGLang-TorchTPU

1 reports 1 reporting sources 2 hours agoNew

Understand the event

AI overview

Meta’s PyTorch-TPU lead, Zongwei Zhou, confirmed that SGLang-TorchTPU is running in Meta’s production environment for AI inference, according to Baoyu. The confirmation follows Google’s announcement of SGLang inference support on TPU. The Information reported in February that Meta and Google had signed a multiyear TPU rental contract worth billions of dollars. Zhou’s confirmation establishes production use but does not establish whether that deployment uses rented or purchased TPUs.

Generated by AI from reports · Updated 55 minutes ago

Latest development10/21 14:09 (UTC+8)

Meta engineer confirms Google TPU inference is running in production 宝玉 · X

Report timeline

Follow the reports to explore different sides of the event.

10/21

14:09
宝玉 · X
Meta engineer confirms Google TPU inference is running in production
Baoyu reports that Meta’s PyTorch-TPU lead, Zongwei Zhou, confirmed SGLang-TorchTPU is running in Meta’s production environment, citing Google’s October 20 developer blog announcing SGLang inference on TPU. Zhou did not disclose deployment scale, affected products, or whether the TPUs are rented or purchased. The Information reported in February that Meta and Google signed a multiyear TPU rental contract worth billions of dollars; neither company publicly detailed the arrangement.

The same kind of briefing as the one above: a few stories worth reading. Free. Mail starts after you confirm, and every letter has a one-click unsubscribe. Read a past issue

Event heat trend

There is not enough continuous observation data to plot a trend yet.

Keep reading

Latest daily · Issue 28Mistral AI releases Voxtral 3 speech models and a voice agent SDK