Skip to content
K = 0.731
← All topics

Deployment engineering

Running models in practice: inference optimization, memory and cost, serving architecture and infrastructure choices.

87 picksLast 30 days 47 itemsCollected 371 items

New

Picks archive · page 5

6/11Wed
  1. Mistral AI62

    Mistral AI launches Mistral Compute infrastructure service

    Mistral AI has launched Mistral Compute, an integrated private stack spanning bare-metal servers to fully managed PaaS, including GPUs, orchestration, APIs, and products. As an NVIDIA partner, it will offer the latest NVIDIA reference architectures, with tens of thousands of GPUs available initially and rapid expansion planned over the coming years.

    Why it matters: Mistral is productizing its in-house training and inference infrastructure, offering another option for sovereign AI compute in Europe.

6/4Wed
  1. Mistral AI60

    Mistral releases enterprise coding assistant Mistral Code

    Mistral has released Mistral Code, an enterprise AI coding assistant combining four models—Codestral, Codestral Embed, Devstral, and Mistral Medium. It supports cloud, dedicated-capacity, and on-premises air-gapped GPU deployments and is built on the open-source project Continue.

    Why it matters: Mistral packages models, an IDE plugin, and local deployment into an enterprise coding assistant and reports deployment scale at three European companies, giving a view of private coding solutions.

5/28Wed
  1. Mistral AI62

    Mistral releases Codestral Embed, its first code-embedding model

    Mistral has released Codestral Embed, its first embedding model designed for code. It outperforms Voyage Code 3, Cohere Embed v4.0, and OpenAI's large embedding model on real-world code-retrieval tasks.

    Why it matters: Mistral's first code-embedding model offers adjustable dimensions and precision, helping readers weigh retrieval quality against storage costs.

5/7Wed
  1. Mistral AI60

    Mistral releases Le Chat Enterprise, powered by Mistral Medium 3

    Mistral has released Le Chat Enterprise, an AI assistant for businesses powered by the new Mistral Medium 3 model. It offers enterprise search, an agent builder, custom data and tool connectors, document libraries, custom models, and hybrid deployment. All features will roll out over the next two weeks.

    Why it matters: Mistral combines enterprise search, agent building, and hybrid deployment in one platform, offering a view of how enterprise AI purchasing is consolidating.

  2. Mistral AI72

    Mistral AI releases Mistral Medium 3 for low-cost enterprise deployment

    Mistral AI has released Mistral Medium 3, which it says reaches at least 90% of Claude Sonnet 3.7's performance on several benchmarks. Pricing is $0.40 per million input tokens and $2 per million output tokens.

    Why it matters: The official release gives Mistral Medium 3's pricing, comparison model, and deployment requirements, helping readers assess the cost of enterprise self-hosting.

3/7Fri
  1. Mistral AI78

    Mistral AI releases Mistral OCR document-understanding API

    Mistral AI has released Mistral OCR, an optical-character-recognition API that parses images and PDFs into ordered, interleaved text and images. It is also the default model for document understanding in Le Chat.

    Why it matters: The official release compares it with Google, Azure, and Gemini models and prices it at $1 per 1,000 pages, helping readers assess document-processing replacement costs.

1/30Thu
  1. Mistral AI78

    Mistral AI releases Mistral Small 3, an open 24B model under Apache 2.0

    Mistral AI has released Mistral Small 3, a 24B-parameter model optimized for low latency and open-sourced under Apache 2.0. It provides both pretrained and instruction-tuned checkpoints.

    Why it matters: A 24B model under Apache 2.0 is positioned against models three times its size, with quantization details for single-GPU local deployment to help readers assess its fit.