Skip to content

Datasette-llm 0.1a11 Adds Support for OpenAI-Compatible Endpoints

Simon WillisonFrom the source·· 2 days agodatasette-llm 0.1a11
Original
Image: Simon Willison
Who
Datasette
What
released an update adding support for OpenAI-compatible endpoints the datasette-llm plugin
Quote
This release adds support for OpenAI-compatible endpoints, so you can configure Datasette to use an LLM hosted anywhere that talks the OpenAI pseudo-standard web protocol.

What happened

Datasette-llm 0.1a11 adds support for OpenAI-compatible endpoints, letting Datasette use an LLM hosted by services such as LM Studio, Ollama, or llama.cpp. The post provides a command and configuration example for running a local Datasette Agent instance powered by a local model.

Read next

See the full storyDatasette-llm 0.1a11 Adds OpenAI-Compatible Endpoint Support

The story so far

Datasette-llm 0.1a11 adds support for OpenAI-compatible endpoints, allowing Datasette to connect to models hosted by services such as LM Studio, Ollama, and llama.cpp. The release includes a command and configuration example for running a local Datasette Agent instance with a local model.

This story is in 11/16 AI DailyRead the whole issue