vLLM Adds Day-One TPU Support for Kimi K3.1 Pro

1 reports 1 reporting sources Updated 2 hours ago

Understand the event

AI overview

vLLM announced day-one support for running Kimi K3.1 Pro on TPU v7x through vllm-torchtpu. The announcement points readers to an llm-d deployment guide and describes the support as part of continued collaboration between Google and Inferact.

Generated by AI from reports · Updated 1 hours ago

Latest development11/6 06:26 (UTC+8)

Kimi K3.1 Pro on TPUs, with day-0 support ⚡ Run it on TPU v7x with vllm-torchtpu. Great to see the continued collaboration between the @Google and @inferact teams! 🤝 Read more 👇 https://llm-d.ai/blog/deploy-kimi-k3-1-pro-with-llm-d vLLM · X

Models in this story

Kimi K3.1 Pro#2 overall$2 input / $10 output per million tokens

API prices of all models

Report timeline

Follow the reports to explore different sides of the event.

11/6

06:26
vLLM · X
Kimi K3.1 Pro on TPUs, with day-0 support ⚡ Run it on TPU v7x with vllm-torchtpu. Great to see the continued collaboration between the @Google and @inferact teams! 🤝 Read more 👇 https://llm-d.ai/blog/deploy-kimi-k3-1-pro-with-llm-d
Kimi K3.1 Pro on TPUs, with day-0 support ⚡ Run it on TPU v7x with vllm-torchtpu. Great to see the continued collaboration between the @Google and @inferact teams! 🤝 Read more 👇 https://llm-d.ai/blog/deploy-kimi-k3-1-pro-with-llm-d

Model releases, price changes and compute developments, with original sources. Free, confirmed by email, and easy to unsubscribe. Read a past issue

Event heat trend

There is not enough continuous observation data to plot a trend yet.