Skip to content

Perplexity Launches Orchestrator API for Unified Model Routing and Billing

3 reports 2 reporting sources first reported Updated 10 hours ago

Understand the event

AI overview

Perplexity launched its Orchestrator API, providing developers with unified billing and access to over 45 open-weight and proprietary AI models. The platform automatically selects the optimal model provider for each task by balancing factors such as capability, capacity, latency, and availability. Aravind Srinivas, CEO of Perplexity, stated that the service features KV-cache-compatible, decision-model-based routing. According to Denis Yarats, this system includes automatic provider failover and allows for routing based on specific task types, such as handling security or biology queries. In an example provided by Yarats, routing tasks from Fable 5.2 to GPT-6.1 Sol resulted in an increase from 38 to 41 solved tasks out of 63 on Terminal-Bench 4.1.

Generated by AI from reports · Updated 10 hours ago

Read next

More changes in today’s briefingOpenAI Introduces GPT-6.2 Astra and Sol

Models in this story

  • GPT-6.1 Sol#10 overall$2 input / $10 output per million tokens

Developments

2 developments

  1. 11/18 05:05 (UTC+8) · 1 reports
    Perplexity Shares KV Cache Friendly Routing on Its Orchestrator API
    Aravind Srinivas · X:Perplexity Orchestrator API Adds KV-Cache-Compatible Decision-Model Routing
  2. 11/18 04:13 (UTC+8) · 2 reports
    Perplexity Introduces the Orchestrator API
    Aravind Srinivas · X:Perplexity Launches Its Orchestrator API for Model Selection

Report timeline

Follow the reports to explore different sides of the event.

11/18
  1. Perplexity Orchestrator API Adds KV-Cache-Compatible Decision-Model Routing

    Aravind Srinivas highlights KV-cache-compatible, decision-model-based routing on the Perplexity Orchestrator API. In a quoted post, Denis Yarats says the API offers 45+ open-weight and proprietary models, automatic provider failover, and unified billing. Yarats gives an example routing benign security and biology tasks, and anything after a refusal, from Fable 5.2 to GPT-6.1 Sol; on Terminal-Bench 4.1, the result rises from 38 to 41 solved tasks out of 63.

  2. Perplexity Launches Its Orchestrator API for Model Selection

    Perplexity is launching its Orchestrator API, which picks a model for each task by balancing capability, capacity, and latency. Developers can choose from more than 45 open-weight and closed models.

  3. Perplexity Introduces the Orchestrator API

    Perplexity introduces the Orchestrator API, which selects a model provider based on availability, capacity, and latency. It brings open-weight and proprietary models into one API with unified billing.

Keep up with AI, one email a day

Model releases, price changes and compute developments, with original sources. Free, confirmed by email, and easy to unsubscribe. Read a past issue

Event heat trend

Current within comparable coverage
15
Peak within comparable coverage
2011/18 05:00 (UTC+8)
24-hour change
–

Trends compare the same continuously observed participants, which may cover fewer sources than current heat. Point or click to inspect hourly heat, or use left and right arrow keys.