Google introduces AgentHands to generate spatial gestures for XR agent conversations
AgentHands: Generating interactive hand gestures for spatially grounded agent conversations in XR
What happened
Google has released AgentHands, a research prototype described in a paper at CHI 2026, that maps LLM reasoning output to gestures synchronized with speech in XR. This lets an agent point things out and demonstrate objects or steps in the user's physical space. The system comprises four modules: object registration, a gesture-event library, gesture-embedding inference, and synchronized execution in a headset. Gestures are categorized by dimensions including left or right hand, spatial anchoring, and VFX. In a controlled study with N=12, AgentHands significantly improved spatial reference over a voice-only baseline.
Keep reading
Latest daily · Issue 24NVIDIA and AI4Bharat Introduce Nemotron-pretraining-Indic-v1 and an Open Data Generation PipelineTrending now
- 1Meta Releases Muse Spark Open With Mac and Cloud Support, Topping US Open-Weight Index
- 2Google Launches Gemini 4 Argon Globally, Expands Paid Access as Benchmark Results Vary
- 3OpenAI Updates GPT-6 Astra Pro in ChatGPT With Parallel Agents and Faster Responses
- 4Meta’s New Business Terms Raise Dispute Over Website Crawling and AI Training Rights
Tomorrow at 08:00, a briefing like this arrives in your inbox.
The same kind of briefing as the one above: a few stories worth reading. Free. Mail starts after you confirm, and every letter has a one-click unsubscribe. Read a past issue · 2026-10-17