Skip to content
All news · Today0 items

#On-device

All collected and published items, ordered by time. Picks are a selected subset.
10/16Fri
  1. Artificial Analysis · X55

    RTX Spark laptop completes Artificial Analysis local agent workload in 18.7 minutes

    NVIDIA's RTX Spark N1X puts up to 128 GB of unified memory and a Blackwell GPU in a Windows laptop. In Artificial Analysis's first AA-AgentPerf-Local results, an RTX Spark laptop completes its local agent workload on Qwen3.8 27B in 18.7 minutes. Artificial Analysis describes RTX Spark's N1X chip as essentially the GB10, linking to https://t.co/520A4lOOdB

10/15Thu
  1. 雷锋网69

    How Huawei’s Kirin 9050 Pro logic folding supports Mate 90 flagship features

    Huawei says its mass-produced Kirin 9050 Pro uses logic folding to shorten signal paths through vertically connected circuit layers, supporting performance and efficiency gains in the Mate 90 Pro Max. The article explains how dense hybrid bonding enables this layout and how memory coordination allows Kirin 9050 chips to run a 30B MoE model with less than 2.5GB of additional memory usage. Huawei also says Kirin 2027 chips are in testing, with results meeting expectations so far.

10/14Wed
  1. Ars Technica · AI49

    Anthropic Warns Small AI Models Could Self-Replicate Through IoT Devices

    Anthropic warns that small AI models may soon enable self-replicating malware to spread across IoT devices, potentially forming computer worms that infect unfamiliar devices without human interaction. The company said such models may be able to replicate autonomously across IoT devices by next year. A recent experiment found significant challenges to building an AI malware replicator, tempering the concern; Anthropic also said one could be difficult to shut down, though its doubling time may be days.

  2. Google DeepMind · X40

    Over half of reported crimes in Singapore use sophisticated social engineering. With @GovTechSG, we’re building on-device fraud detection using our open model Gemma. By fine-tuning it on local scam tactics, it identifies threats in real time without compromising personal privacy → https://goo.gle/4ygVkJa

    Over half of reported crimes in Singapore use sophisticated social engineering. With @GovTechSG, we’re building on-device fraud detection using our open model Gemma. By fine-tuning it on local scam tactics, it identifies threats in real time without compromising personal privacy → https://goo.gle/4ygVkJa

  3. Google DeepMind63

    Google DeepMind and Singapore GovTech deliver on-device Gemma model for scam detection

    Google DeepMind and Singapore’s Government Technology Agency (GovTech) have delivered a Gemma model fine-tuned on local scam conversations and optimized for typical smartphones in Singapore. A lightweight classifier screens incoming messages before the model evaluates broader conversation context and triggers warnings about suspected manipulation, with conversation processing kept on the device. Training excluded private or personally identifiable information, using anonymized datasets derived from scam reports and intelligence feeds.

    Why it matters: The two-stage detection pipeline offers a transferable approach to balancing smartphone power consumption with contextual scam analysis while keeping private conversations on the device.

10/13Tue
  1. The Decoder73

    Anthropic study warns small AI models could soon replicate across consumer devices

    Anthropic researchers William Zhou and Daniel Freeman report that small AI models could become capable of autonomous replication across poorly secured consumer devices by the end of 2026. Gemma4-26B-A4B ran across 15 Android TV boxes costing about $55 each, while GLM-5.2 replicated across all eight test nodes in four of five runs; the experiments omitted actual hacking. No current model combines the small size and replication capabilities needed for a fully autonomous AI worm.

  2. Ethan Mollick · X18

    GPT-4 was the undisputed best model in the world for a full year and we all debated whether anyone could catch up or if OpenAI had some secret formula that nobody else knew about. Now there are are 19 AI models that can run on a modern smartphone that are better than GPT-4!

    GPT-4 was the undisputed best model in the world for a full year and we all debated whether anyone could catch up or if OpenAI had some secret formula that nobody else knew about. Now there are are 19 AI models that can run on a modern smartphone that are better than GPT-4!

10/11Sun
  1. The Verge · AI22

    Testing Local AI With Hermes Agent and Qwen on an M5 Ultra Mac Studio

    A Verge writer began running local LLMs on an M5 Ultra Mac Studio with 256GB of unified memory, installing the open-source Hermes Agent desktop app and the 125-billion-parameter Qwen 3.8 Flash Next model, about 105GB in size. Early tasks included a daily briefing via Telegram, reorganizing a 400-plus-game Steam library, and local data analysis; the writer is now working on automating laptop benchmark tests.

10/9Fri
10/8Thu
  1. The Verge · AI58

    Microsoft Surface RTX Spark Dev Box opens for preorder at $5,999

    Microsoft opened preorders for the high-end Surface RTX Spark Dev Box AI mini-PC for developers at about $6,000, with shipping starting in November. It uses Nvidia's Arm-based RTX Spark platform and 128 GB of unified memory, is optimized for local AI, and can run models with more than 120B parameters. Use cases include testing AI models, prototyping agents, and running AI coding tools locally.

  2. NVIDIA Blog78

    NVIDIA and Microsoft announce RTX Spark and infrastructure for Windows agents

    At a Windows AI and Surface event in San Francisco, NVIDIA and Microsoft said they are designing software and hardware together for the agent era on Windows PCs. Microsoft announced that its OS-level Microsoft Execution Containers (MXC) infrastructure is generally available, allowing agents to run persistently in the background under system control.

    Why it matters: NVIDIA and Microsoft are delivering both the system-level containers and local compute needed to run agents, helping readers assess the conditions for local agent workflows.

10/7Wed
  1. Ollama · X48

    Ollama adds Google DeepMind's EmbeddingGemma 2 for on-device multimodal embeddings

    .@GoogleDeepMind EmbeddingGemma 2 is now available on Ollama. Made for consumer devices and is multimodal. ollama pull embeddinggemma-2 Quoted post by @GoogleDeepMind (context, not the main author's work): Meet EmbeddingGemma 2, our first natively multimodal open model for on-device embeddings. It expands beyond text to unify code, images, audio, and video in a shared space. 🧵

  2. Google DeepMind71

    Google DeepMind releases EmbeddingGemma 2, a lightweight open multimodal embedding model

    Google DeepMind released EmbeddingGemma 2, a 740M-parameter open model based on the Gemma 4 architecture and licensed under Apache 2.0. It maps text, images, audio, and video into a shared embedding space.

    Why it matters: EmbeddingGemma 2 maps text, images, audio, and video into one embedding space and reports concrete on-device memory and vector truncation figures, helping assess local multimodal retrieval.

  3. The Decoder66

    Google releases EmbeddingGemma 2 multimodal embedding model

    Google released EmbeddingGemma 2, an open multimodal embedding model that converts text, images, video, audio, and code into numerical vectors. It has 740 million parameters. Google says it outperforms competitors with more than twice as many parameters on multimodal embedding benchmarks and scores 78.68 on the Massive Text Embedding Benchmark (Code), nearly 10 points above the previous model's 68.76.

  4. The Verge · AI32

    Apple and Google are redefining 'recording': if AI hardware stores text but no video, is it still recording?

    Apple is reportedly developing a smart-home camera that does not save video, instead using AI to convert visual data into text snippets describing what is happening at home, with facial recognition support. Sandeep Waraich, who leads Google's wearable-device work, has also suggested that a smart-glasses camera could act only as an image sensor without saving footage.

  5. Sundar Pichai · X62

    Google releases EmbeddingGemma 2, an open multimodal embedding model

    Sundar Pichai announced EmbeddingGemma 2, described as Google's first open, natively multimodal embedding model. It handles text, code, image, video, and audio tasks in a modular 740M parameter form factor, is positioned for offline, privacy-first RAG when paired with Gemma 4, and is said to outperform some specialist models more than twice its size. Weights are available now on Hugging Face.

10/6Tue
10/5Mon
  1. Ars Technica · AI60

    AI smart glasses face their first major government crackdown

    Australia is considering banning smart glasses in some public places, and courts in several countries have issued bans. Norway's government says it does not plan a blanket ban but considers a proposed restriction a 'highly prioritized matter'. A draft law will soon go to parliament; the government says it does not want a society where people fear being secretly recorded, photographed, or filmed.

10/4Sun
10/3Sat
  1. TechCrunch · AI58

    Meta launches open-source Muse Gadgets project so developers can build hardware for Muse

    Meta launched the open-source Muse Gadgets project, providing open firmware and a Linux SDK for developers to build devices connected to its personal AI agent Muse using inexpensive hardware such as Raspberry Pi or ESP32. It offers examples including a color e-ink display, an HDMI TV stick, and other projects, and has opened a Discord channel to support users.