Skip to content

Perplexity Introduces the Orchestrator API

Perplexity · XFrom the source· @perplexity_ai·· 11 hours ago

15.6K views · 149 likes · 17 reposts (at collection)

Original

What happened

Perplexity introduces the Orchestrator API, which selects a model provider based on availability, capacity, and latency. It brings open-weight and proprietary models into one API with unified billing.

Article

Introducing the Perplexity Orchestrator API.

Orchestrator lets you choose the right model for the right task, and automatically selects the provider based on availability, capacity, and latency.

All open-weight and proprietary models are in one API with unified billing.

Reported by 2 sources

    The story so far

    Perplexity launched its Orchestrator API, providing developers with unified billing and access to over 45 open-weight and proprietary AI models. The platform automatically selects the optimal model provider for each task by balancing factors such as capability, capacity, latency, and availability. Aravind Srinivas, CEO of Perplexity, stated that the service features KV-cache-compatible, decision-model-based routing. According to Denis Yarats, this system includes automatic provider failover and allows for routing based on specific task types, such as handling security or biology queries. In an example provided by Yarats, routing tasks from Fable 5.2 to GPT-6.1 Sol resulted in an increase from 38 to 41 solved tasks out of 63 on Terminal-Bench 4.1.

    How the story developed · 2

    View full event
    1. 11/18 05:14 (UTC+8)
      Perplexity Orchestrator API Adds KV-Cache-Compatible Decision-Model RoutingAravind Srinivas · X
    2. 11/18 04:14 (UTC+8)

      Perplexity Introduces the Orchestrator API This report

    Read next

    See the full storyPerplexity Launches Orchestrator API for Unified Model Routing and Billing