vLLM-Omni adds day-0 support for FLUX 3 Image Klein

What happened

vLLM-Omni now supports FLUX 3 Image Klein from day 0. The vLLM team worked with Black Forest Labs and NVIDIA to bring the new image model to its serving stack. The integration includes FLUX 3 Image Klein image generation and BF16, FP8 and NVFP4 checkpoints.

The story so far

Black Forest Labs has released FLUX 3 Image Klein, a 5.6-billion-parameter open-weights model for image generation and editing, with launch-day support in Hugging Face Diffusers and vLLM-Omni. The Decoder reported that the model supports up to ten reference images and native 4K output, while its INT8 build runs on NVIDIA GPUs with 8 GB of VRAM and generates an image in under 9 seconds on an RTX 4070. The weights use the FLUX Kommunity License, which permits free commercial use for companies making under $5 million annually. Diffusers supports text-to-image generation, multi-reference image-to-image generation and bounding-box layout control. Its available checkpoints include a distilled model using 16 steps without classifier-free guidance and a base model using 50 steps with it. Hugging Face reported that the distilled model generated a 1024 × 1024 image in 1.93 seconds on an H100 in its benchmark, and provides quantized loading examples and LoRA training scripts. The vLLM team said it worked with Black Forest Labs and NVIDIA to add vLLM-Omni support, including BF16, FP8 and NVFP4 checkpoints. NVIDIA said the model was trained on its GB200 NVL72 hardware and can run on an RTX GPU.

Keep reading

Trending now

1. 1Meta Releases Muse Spark Open With Mac and Cloud Support, Topping US Open-Weight Index
2. 2Google Launches Gemini 4 Argon Globally, Expands Paid Access as Benchmark Results Vary
3. 3OpenAI Updates GPT-6 Astra Pro in ChatGPT With Parallel Agents and Faster Responses
4. 4Meta’s New Business Terms Raise Dispute Over Website Crawling and AI Training Rights