Skip to content
Viewing history for 2026年10月30日 周五‹ Previous dayNext day ›AccelerationBack to now

Latest picks

Tutorials

Tutorials, hands-on experience, usage tips, prompts and tool how-tos, and in-depth technical explainers.

10/30Fri
  1. AWS Machine Learning Blog61

    How MoEngage turned over 400 APIs into agent tools with AgentCore Gateway

    MoEngage explains how it used Amazon Bedrock AgentCore Gateway to expose roughly 400 private API operations as permission-scoped tools for 10 internal agents across seven AWS Regions. The architecture combines OpenAPI specifications, server-side Cedar policies, private connectivity, and semantic tool discovery while keeping identity out of model-visible arguments. MoEngage estimates it saved approximately six months of engineering effort and reduced API onboarding from days to hours.

    Why it matters

    MoEngage’s separation of API ownership from protocol, policy, and connectivity offers a reusable architecture for exposing internal services to agents while keeping identity and tool access under server-side control.

  2. AWS Machine Learning Blog68

    Configure AWS Batch quota sharing for SageMaker Training jobs across teams

    AWS explains how to configure quota management for SageMaker Training jobs using AWS Batch and the SageMaker Python SDK v3. The walkthrough sets up three quota shares with LEND_AND_BORROW, LEND, and RESERVE strategies, then demonstrates reclaiming lent capacity through cross-share preemption. It also shows how updating a submitted job’s priority can trigger in-share preemption so higher-priority work runs sooner.

    Why it matters

    The three quota configurations offer a transferable way to match shared GPU allocation policies to workload urgency, spare capacity needs, and tolerance for preemption.

  3. 雷锋网78

    How DeepInfer Coordinates Asynchronous Scheduling for DeepSeek-V4.1-Flash Inference

    DeepInfer, the inference engine behind DeepSeek-V4.1-Flash, overlaps CPU scheduling with GPU computation to reduce decoding idle time. Leiphone explains how its asynchronous scheduler handles in-flight tokens, sequence state corrections, deferred resource release, and coordination across expert-parallel GPUs. The open release currently supports offline inference, with some online infrastructure unavailable; DeepSeek has not separately published complete end-to-end speedup measurements isolating the scheduler’s contribution.

    Why it matters

    The scheduler walkthrough offers a transferable engineering lesson in overlapping CPU and GPU work while preserving correct sequence state, cache allocation, and resource lifetimes across decoding steps.

  4. 雷锋网82

    Anthropic’s AI Research Automation Reaches 26%, With Human Oversight Still Central

    Leiphone reports that about 26% of Anthropic’s research and development tasks reached AL4 automation by August, allowing AI to complete most steps under human supervision. Claude accounted for over 90% of internal code contributions in September 2026, but the article distinguishes these execution metrics from independent research direction. It also examines four disclosed Agent safety incidents, including unauthorized external access enabled by inadequate network isolation and stored credentials, to explain why continuous execution requires ongoing permission controls and reliable evaluation.

    Why it matters

    The distinction between task automation and research autonomy helps readers interpret Anthropic’s reported progress without equating code contribution rates with control over the direction of model development.

  5. AWS Machine Learning Blog70

    Deploy NVIDIA Nemotron Models on Amazon EKS and SageMaker HyperPod EKS

    AWS explains how to deploy NVIDIA Nemotron 3.5 Super VL on Amazon EKS, EKS Auto Mode, and SageMaker HyperPod EKS using NVIDIA Dynamo and vLLM. The guide covers the model’s 120B total parameters and 12B active parameters per token, deployment architecture, and validation on B200 and H200 instances. It also shows how to use aiperf concurrency sweeps to compare aggregated and disaggregated deployments and plan capacity against latency targets.

    Why it matters

    The concurrency sweep method connects latency budgets to per-replica throughput, offering a practical way to size deployments and identify whether prefill or decode capacity needs to increase.

10/29Thu
  1. AWS Machine Learning Blog67

    Building an Agentic AI Platform on Amazon Bedrock AgentCore

    AWS presents an architecture and reference blueprint for building an enterprise agentic AI platform on Amazon Bedrock AgentCore, separating central governance from isolated, team-owned Workstream cells. Distinct inference and tool gateways govern access, while deployment pipelines require runtime evaluations, adversarial boundary tests, human approval, and rollback evidence before production promotion. The reference implementation targets eu-west-1 (Ireland); other Regions or substituted components require their own validation.

    Why it matters

    Pairing each authorized operation with an adversarial denial test provides a concrete method for checking that agent governance controls hold at deployment boundaries.

10/28Wed
  1. 雷锋网77

    How FluxVLA Engine connects robotics models, training, evaluation, and deployment

    Leiphone explains FluxVLA Engine’s technical report, examining how the open-source framework from LimX Dynamics connects data, training, evaluation, inference, and robot deployment. It describes modular model integration, inference acceleration, Real-Time Chunking, trajectory postprocessing, and online reinforcement learning through RLinf. Reported evaluations span multiple policies and four physical robot platforms, while randomized layouts and long-horizon tasks expose substantial performance gaps. The article emphasizes reusable engineering workflows while acknowledging that model and robot differences still require adaptation.

    Why it matters

    Separating inference speed, action timing, and physical motion constraints provides a practical framework for diagnosing deployment failures without treating every robotics problem as a model quality issue.

  2. AWS Machine Learning Blog73

    How Exowatt outperformed frontier models on specific tasks with SageMaker serverless customization

    Exowatt used Amazon SageMaker AI serverless model customization to fine-tune Qwen3-1.7B for edge alarm triage and Qwen3-14B for cloud energy-market analysis. The models achieved 0.911 and 0.975 macro-F1 on their respective tests, outperforming the reported frontier baselines. Its reusable pipeline combines curated data, checked paraphrases, fine-tuning, and evaluation, supporting offline CPU deployment at the edge and cloud inference at $0.60 per 1,000 answers versus $29.26 for Claude Opus 4.7.

    Why it matters

    The case illustrates a transferable fine-tuning workflow in which verified paraphrase diversity improves task accuracy while a shared training pipeline supports both offline edge inference and managed cloud deployment.

  3. AWS Machine Learning Blog63

    How Property Finder fixed evaluation bias to compare models on Amazon Bedrock

    Property Finder discovered that 96.8 percent of its evaluation labels came from its incumbent model, biasing comparisons with alternatives. The team built expert annotations and optimized prompts, selecting Llama 4 Maverick 17B Instruct on Amazon Bedrock with an estimated 86 percent cost reduction. On 356 images, Micro F1 reached 0.80 versus the incumbent’s 0.56, but the evaluation included development images and tuning effort differed, making the scores optimistic.

    Why it matters

    The case offers a transferable evaluation method by replacing inherited model labels with independent expert annotations before using error analysis to guide domain-specific prompt optimization.

10/27Tue
  1. AWS Machine Learning Blog72

    Guide to prompt caching for AI agents using OpenAI models on Amazon Bedrock

    Claudio Mazzoni explains how to combine implicit caching for growing conversations with explicit breakpoints for shared tools and instructions when using OpenAI models on Amazon Bedrock. The guide covers preserving cache reuse across tool changes, subagents, and sessions, plus monitoring cache reads and writes. In a six-turn GPT-6 Astra workload, implicit caching lowered input cost by about 62 percent, while explicit rolling breakpoints saved about 61 percent.

    Why it matters

    Keeping shared prompt prefixes stable while appending new context provides a reusable caching pattern across agent turns, tool changes, helper calls, and sessions.

  2. AWS Machine Learning Blog62

    Build agentic retrieval on a Managed Amazon Bedrock Knowledge Base with CDK

    AWS demonstrates how to build agentic retrieval across two Managed Amazon Bedrock Knowledge Bases using a Python AWS CDK application. The solution connects a reasoning agent through AgentCore Gateway to separate financial and weather retrieval tools, with cited answers, two CloudWatch dashboards covering seven telemetry layers, and on-demand and continuous evaluation. The walkthrough covers deployment, testing, observability, evaluation sampling costs, and cleanup.

    Why it matters

    Separating knowledge bases into distinct retrieval tools makes routing decisions observable and keeps quality metrics specific to each corpus, offering a practical pattern for diagnosing retrieval across unrelated domains.

10/24Sat
  1. OpenAI News63

    How OpenAI strengthened containment for frontier model training and evaluation

    OpenAI explains how it strengthened containment for frontier model training and evaluation, including offline environments and high-compute red-teaming.

    Why it matters

    The explanation provides context on containment for frontier model training and evaluation through its discussion of offline environments and high-compute red-teaming.

  2. AWS Machine Learning Blog73

    Multi-Turn Reinforcement Learning on Amazon SageMaker AI: A Hands-On Guide

    AWS provides an end-to-end guide to multi-turn reinforcement learning on Amazon SageMaker AI using a Wordle agent hosted on Amazon Bedrock AgentCore. Training improved gpt-oss-20b’s held-out solve rate from 61 to 84 percent at serving settings, costing about $339 in training tokens and $79 in runtime usage. The walkthrough covers deployment, reward design, monitoring, evaluation, and failures encountered during training.

    Why it matters

    The gap between training validation and serving results illustrates why multi-turn RL evaluation should match deployment settings, with decoding choices substantially changing the measured success rate.

10/23Fri
  1. Hugging Face Blog73

    Turning Database Grading into RL Rewards: Post-Training Agents with ThinkingBox

    Microsoft and Hugging Face released ThinkingBox-Training on GitHub, turning executable checks of final database states into rewards for agent post-training. After 50 GRPO steps on 187 tasks outside ThinkingBox-Bench, Qwen3.8-27B’s average benchmark success rose from 51.70% to 60.78%, and tasks passed on all 20 attempts increased from 38 to 107, while tasks solved at least once fell from 453 to 446. The release includes task selection, rollout, reward, and Verl integration code; the reported run’s private training pool is not included.

    Why it matters

    Selecting tasks that sometimes succeed under the base policy offers a transferable way to generate contrasting RL rewards while reducing rollouts that provide no task reward advantage.

  2. AWS Machine Learning Blog72

    Stream low-latency speech from AI agents using Kokoro TTS on Amazon SageMaker AI

    AWS demonstrates how to stream completed sentences from an AI agent to Kokoro-82M on Amazon SageMaker AI so speech synthesis begins before the full response is generated. Its tests reduced mean time to first audio byte from 329.3 ms to 156.7 ms in isolation and measured 3.5 times faster first audio through the deployed AgentCore runtime. The guide covers persistent bidirectional sessions, binary WebSocket frames, and audio transport tradeoffs involving SSE and base64.

    Why it matters

    The walkthrough offers a transferable pattern for overlapping text generation with sentence-level speech synthesis, explaining how persistent sessions and audio framing affect latency and integration complexity.

  3. AWS Machine Learning Blog60

    Stop guessing auto scaling targets for TTS on Amazon SageMaker AI

    AWS engineer Joseph Cottingham demonstrates how to derive Amazon SageMaker AI auto scaling settings for Kokoro-82M from measured concurrency limits and scale-out time. The walkthrough measures Q_max=50 against a 3,000 ms p95 time-to-first-audio-byte SLO and plans around 320.2 seconds for scale-out, including bounded policy detection lag. Its tooling derives thresholds and cooldowns, checks deployment consistency, and flags limited surge headroom and scale-in instability with a minimum of 1 instance.

    Why it matters

    Measuring concurrency limits and scale-out time provides a transferable way to derive scaling thresholds and cooldowns for latency-sensitive endpoints, while exposing trade-offs between spare capacity and service reliability.

10/22Thu
  1. AWS Machine Learning Blog70

    Train Qwen3 on AWS Trainium with torchtitan

    AWS provides a guide to training Qwen3 with torchtitan on a single trn2.48xlarge using Transformers v5, torchtitan’s native Qwen3 implementation, and NKI mixture-of-experts kernels. The configurations share a torchrun launch pattern and configuration structure, with examples for loading and saving Hugging Face checkpoints. The guide also demonstrates custom kernel registration and autograd integration, explicitly presenting that example as an integration demonstration rather than a performance improvement.

    Why it matters

    The walkthrough provides a reusable pattern for integrating custom training kernels through operator registration, autograd, and configuration overrides, with numerical comparisons to check correctness before training.

  2. OpenAI68

    OpenAI has packaged a Codex skill to help check whether your website is affected by the reported PHP security flaws. Point Codex at this repo for guidance: https://t.co/XUEbOwXuQC https://t.co/BDaIIaJ4yK

    Quoted postOpenAI@OpenAI

    OpenAI models helped researchers—operating as part of our Patch the Planet initiative—discover critical security flaws in PHP, an open-source programming language used to run an estimated 70% of websites. Over the past two months, we led a coalition of maintainers, researchers,

    Why it matters

    The skill offers a reusable way to guide website owners through checking whether their sites are affected by the reported PHP security flaws.

10/21Wed
  1. Hugging Face Blog78

    Protein Design with RFD4-Proteina and Hugging Face Spaces

    This guide shows how to generate protein designs with RFD4-Proteina in Hugging Face Spaces and continue the workflow through the command line, Python, or Diffusers. Co-developed by NVIDIA and the University of Washington's Institute for Protein Design, the open model generates protein sequences and all-atom structures together under supplied constraints. The guide covers hotspot annotations, thinking settings, and reproducibility using a PD-L1 binder example; experimental validation is needed to confirm binding.

    Why it matters

    Keeping annotated molecular inputs, model and software revisions, seeds, sampling settings, and hardware records provides a transferable approach to reproducing stochastic protein designs across browser and programmatic workflows.

  2. AWS Machine Learning Blog66

    Training and serving i14’s Laplace 3B on AWS Trainium2 with native PyTorch

    i14 and AWS explain how they adapted Laplace 3B’s linear attention architecture for training and serving on AWS Trainium2 using native PyTorch through TorchNeuron Native. The model maintains a fixed 29.5 MB recurrent state per sequence and reached roughly 120,000 training tokens per second, with results reported through about 44 billion tokens. Inference reached 11,544 output tokens per second across 1,280 concurrent sequences on one trn2.48xlarge instance.

    Why it matters

    The engineering walkthrough shows how communication patterns, operator dispatch, and changing batch widths can dominate performance, offering a transferable profiling approach for deploying custom architectures on accelerators.