vLLM Releases Version 0.33.0 With New Model Support and Speculative Decoding Updates

1 reports 1 reporting sources Updated 2 hours ago

Understand the event

AI overview

vLLM released version 0.33.0 with support for Reflection Beam-1.0, Step-5 Preview, Nemotron Parse 3.5, and MiniCPM-OCR 1.0. The release also adds the XPress refiner and FLy lossy verify for speculative decoding. Its PyTorch 2.14 wheels require CUDA 13.0 and are libtorch ABI-stable. vLLM said the release includes 927 commits from 389 contributors, including 122 first-time contributors.

Generated by AI from reports · Updated 1 hours ago

Latest development11/4 07:53 (UTC+8)

vLLM Releases v0.33.0 With New Models and Speculative Decoding Updates vLLM · X

Models in this story

Step 5 Preview#22 overall$1 input / $2.7 output per million tokens

API prices of all models

Report timeline

Follow the reports to explore different sides of the event.

11/4

07:53
vLLM · X
vLLM Releases v0.33.0 With New Models and Speculative Decoding Updates
vLLM has released v0.33.0, a version built from 927 commits with contributions from 389 contributors, including 122 first-timers. It adds support for Reflection Beam-1.0, Step-5 Preview, Nemotron Parse 3.5, and MiniCPM-OCR 1.0, and includes PyTorch 2.14 wheels that require CUDA 13.0 and are libtorch ABI-stable. Speculative decoding updates include the XPress refiner and FLy lossy verify.

Model releases, price changes and compute developments, with original sources. Free, confirmed by email, and easy to unsubscribe. Read a past issue

Event heat trend

There is not enough continuous observation data to plot a trend yet.