Skip to content

Perplexity Launches Its Orchestrator API for Model Selection

Aravind Srinivas · XFrom the source· @AravSrinivas·· 11 hours ago

7K views · 82 likes · 6 reposts (at collection)

Original

What happened

Perplexity is launching its Orchestrator API, which picks a model for each task by balancing capability, capacity, and latency. Developers can choose from more than 45 open-weight and closed models.

Article

Perplexity is the industry leader that defined what a company built around multi-model orchestration could look like. Today, we’re launching our Orchestrator API, that picks the right model for your task: balancing across capability, capacity and latency, and, giving you the flexibility to choose across 45+ open-weight and closed models.

Quoted postPerplexity@perplexity_ai

Introducing the Perplexity Orchestrator API.

Orchestrator lets you choose the right model for the right task, and automatically selects the provider based on availability, capacity, and latency.

All open-weight and proprietary models are in one API with unified billing.

View the quoted post on X

Reported by 2 sources

    The story so far

    Perplexity launched its Orchestrator API, providing developers with unified billing and access to over 45 open-weight and proprietary AI models. The platform automatically selects the optimal model provider for each task by balancing factors such as capability, capacity, latency, and availability. Aravind Srinivas, CEO of Perplexity, stated that the service features KV-cache-compatible, decision-model-based routing. According to Denis Yarats, this system includes automatic provider failover and allows for routing based on specific task types, such as handling security or biology queries. In an example provided by Yarats, routing tasks from Fable 5.2 to GPT-6.1 Sol resulted in an increase from 38 to 41 solved tasks out of 63 on Terminal-Bench 4.1.

    How the story developed · 2

    View full event
    1. 11/18 05:14 (UTC+8)

      Perplexity Launches Its Orchestrator API for Model Selection This report

    2. 11/18 05:14 (UTC+8)
      Perplexity Orchestrator API Adds KV-Cache-Compatible Decision-Model RoutingAravind Srinivas · X

    Read next

    See the full storyPerplexity Launches Orchestrator API for Unified Model Routing and Billing