Skip to content

Hugging Face Announces a Livestream on Quantization with llama.cpp and vLLM

1 reports 1 reporting sources Updated 2 hours ago

Understand the event

AI overview

Hugging Face announced a livestream primer on quantization with llama.cpp and vLLM, featuring Merve Noyan, Maxime Labonne, Aditya Tadinada, Bartowski, and Mike Goin. The session is planned for next Tuesday and will cover ways to shrink models to fit on a laptop.

Generated by AI from reports · Updated 1 hours ago

Read next

More changes in today’s briefingOpenAI Releases Images 2.6 With SVG Export, GIFs, and Faster Generation

Report timeline

Follow the reports to explore different sides of the event.

11/5
  1. Join us in this livestream next Tuesday, learn how to shrink models to fit in your laptop and make them go brrr 💨 We will have @mervenoyann @maximelabonne @TadimetiAditya @bartowski1182 and @mgoin_ giving a primer and know-hows on quantization with llama.cpp and vLLM ⚡️

    Join us in this livestream next Tuesday, learn how to shrink models to fit in your laptop and make them go brrr 💨 We will have @mervenoyann @maximelabonne @TadimetiAditya @bartowski1182 and @mgoin_ giving a primer and know-hows on quantization with llama.cpp and vLLM ⚡️

Keep up with AI, one email a day

Model releases, price changes and compute developments, with original sources. Free, confirmed by email, and easy to unsubscribe. Read a past issue

Event heat trend

There is not enough continuous observation data to plot a trend yet.