What happened
Perplexity introduces the Orchestrator API, which selects a model provider based on availability, capacity, and latency. It brings open-weight and proprietary models into one API with unified billing.
Introducing the Perplexity Orchestrator API.
Orchestrator lets you choose the right model for the right task, and automatically selects the provider based on availability, capacity, and latency.
All open-weight and proprietary models are in one API with unified billing.
Reported by 2 sources
The story so far
Perplexity launched its Orchestrator API, providing developers with unified billing and access to over 45 open-weight and proprietary AI models. The platform automatically selects the optimal model provider for each task by balancing factors such as capability, capacity, latency, and availability. Aravind Srinivas, CEO of Perplexity, stated that the service features KV-cache-compatible, decision-model-based routing. According to Denis Yarats, this system includes automatic provider failover and allows for routing based on specific task types, such as handling security or biology queries. In an example provided by Yarats, routing tasks from Fable 5.2 to GPT-6.1 Sol resulted in an increase from 38 to 41 solved tasks out of 63 on Terminal-Bench 4.1.
How the story developed · 2
View full event- 11/18 05:14 (UTC+8)Perplexity Orchestrator API Adds KV-Cache-Compatible Decision-Model RoutingAravind Srinivas · X
- 11/18 04:14 (UTC+8)
Perplexity Introduces the Orchestrator API This report

