What happened
Perplexity is launching its Orchestrator API, which picks a model for each task by balancing capability, capacity, and latency. Developers can choose from more than 45 open-weight and closed models.
Perplexity is the industry leader that defined what a company built around multi-model orchestration could look like. Today, we’re launching our Orchestrator API, that picks the right model for your task: balancing across capability, capacity and latency, and, giving you the flexibility to choose across 45+ open-weight and closed models.
View the quoted post on XIntroducing the Perplexity Orchestrator API.
Orchestrator lets you choose the right model for the right task, and automatically selects the provider based on availability, capacity, and latency.
All open-weight and proprietary models are in one API with unified billing.
Reported by 2 sources
The story so far
Perplexity launched its Orchestrator API, providing developers with unified billing and access to over 45 open-weight and proprietary AI models. The platform automatically selects the optimal model provider for each task by balancing factors such as capability, capacity, latency, and availability. Aravind Srinivas, CEO of Perplexity, stated that the service features KV-cache-compatible, decision-model-based routing. According to Denis Yarats, this system includes automatic provider failover and allows for routing based on specific task types, such as handling security or biology queries. In an example provided by Yarats, routing tasks from Fable 5.2 to GPT-6.1 Sol resulted in an increase from 38 to 41 solved tasks out of 63 on Terminal-Bench 4.1.
How the story developed · 2
View full event- 11/18 05:14 (UTC+8)
Perplexity Launches Its Orchestrator API for Model Selection This report
- 11/18 05:14 (UTC+8)Perplexity Orchestrator API Adds KV-Cache-Compatible Decision-Model RoutingAravind Srinivas · X
