Automatic sound design, synced to every frame.
Mirelo SFX 2.0 is now on Runway, generating full soundscapes from your video while keeping dialogue intact. Get started at the link below.
Kling AI launched Kling 4.0 on October 15, introducing native video generation up to 30 seconds, 10-bit HDR output, and claimed improvements in fast motion and complex camera movements. The model supports up to 15 combined reference assets, up to 10 keyframe inputs, and prompts up to 8000 tokens. Support for 4K, 1080p, and 21:9 output, repeated video extensions totaling up to 2 minutes, and API access are described as forthcoming.
Why it matters: The reference inputs, keyframe controls, and HDR output provide concrete context for assessing how Kling 4.0 could fit into professional video production workflows.
Baoyu shares Kling_ai’s announcement that Kling 4.0 is now fully available.
The quoted post showcases KING CARD, created with Kling 4.0.
https://twitter.com/Kling_ai/status/2110747526840361191
Kunlun Tech released Matrix-Game 4.0, reporting 480p gameplay at 60 FPS on a single NVIDIA RTX 5090 with end-to-end response latency below 150 milliseconds. Its game engine maintains world state and interaction rules, a coding agent modifies game logic, and a video model generates detailed visuals from structural frames and dynamic semantic conditions. Code, weights, and simplified scene models are available at https://huggingface.co/Skywork/Matrix-Game-4.0.
Why it matters: The architecture offers a transferable approach to interactive generation by assigning persistent state and rules to an engine while using a video model for visual rendering.
The author describes subtitle translation problems they encountered: subtitles appearing before a speaker talks, sentences split into fragments that do not match the spoken words, and multiple lines obscuring the video. The post introduces their open-source project, BaoCut, in the context of these challenges but does not explain how it handles them. https://t.co/WFPLrSceV7
We’ve partnered with Baseten to bring Runway’s video models to enterprises. Deploy Gen-4.5 and Aleph 2.0 in dedicated, single-tenant environments, fine-tune them on your own data and scale with reserved GPU capacity. Learn more at the link below.
Introducing Runway for web design.
Connect Runway to @Replit to generate images, video and assets directly inside your project, from first idea to finished site. Get started at the link below.
Odyssey has launched a free public research preview of Odyssey-3, a world model that generates interactive environments from text prompts and runs in real time on an autoregressive diffusion transformer. The base model has 14 billion parameters and outputs 832 × 480 video, while Odyssey-3 Pro supports 1280 × 720. Its reported 66.1-point Physics-IQ Verified score came from a single run using a selection method, below the benchmark's four-run requirement.
HiDream-O1-Video-1.0, HiDream’s new video model, debuts at #6 on the Artificial Analysis Image to Video with Audio Leaderboard, just behind Dreamina Seedance 2.0 720p. HiDream positions it as a native omnimodal model built for physical consistency, generating 1080p videos of 5 to 20 seconds with natively synchronized audio and scene-dependent duration. It is available through vivago R1 Studio and the HiHarness API, where 1080p video with audio costs $5.80 per minute, about $0.10 per second.
Artificial Analysis reports that Grok Imagine Video 1.5 Lite ranks #17 on both AA-Video-T2V v2.0 and AA-Video-T2V-Silent v2.0, ahead of Google's Veo 3.1 at about a third of its price.
Its median generation time of 60.5 seconds for a 10 second 1080p clip places it on the quality and speed Pareto frontier.
SpaceXAI prices 1080p output at $0.14 per second ($8.40 per minute), with availability through the SpaceXAI API, fal at the same prices, and Vercel AI Gateway.
Bring your ideas to life with @claudeai Motion + Runway.
Use Claude Motion to animate charts, create customer walkthroughs or create short explainers, then bring your work into Runway to generate videos and images.
Learn more at the link below.
Quoted post by @claudeai: Claude Dashboards and Claude Motion are in beta today. Ask Claude to turn your data into live dashboards and your ideas into animated explainers.
Ben Affleck went viral this week for several interview clips. At GQ and Bloomberg Screentime 2026, he explained concepts including machine learning, neural networks, transformers, tensors, GPUs, and inference, and said he can write Python.
Shengshu Technology opened a preview of its next-generation flagship video-generation model, Vidu Q4, highlighting lifelike expression. It first released three capabilities: character performance, camera language, and visual-effects scenes. The model supports direct output up to 4K, clips up to 16 seconds, and up to 15 reference images and three reference audio clips per generation.
On the latest Artificial Analysis text-to-video leaderboard, Utopai X, a model from film company Utopai Studios, ranked second with 1,150 points, just seven points behind Alibaba's Wan 3.0. The ranking was based on blind votes by evaluators who did not know the models' names.
Melius, an AI advertising platform founded by a former Ramp engineer, raised a $20 million Series A led by CRV. It had also raised a $5 million seed round led by General Catalyst, for $25 million in total funding.
Reka AI released a research preview of Rho-1, a 19B-parameter general-purpose model that can process and generate text, images, video, and robot-control actions in a single neural network. Unlike most systems that route tasks to specialized models, Rho-1 places all modalities as tokens in one shared context window without calling tools or external models. It can generate continuous video in real time, respond instantly to new instructions without restarting, and use the same weights that predict camera images to drive robot actions.
The AIGC online film series Dream of Floating Life, produced by iQIYI and Changxin Media as part of Soul Ferry, surpassed RMB 10 million in revenue sharing. The first two films, Butterfly Dream and Dream of the Heavenly Maiden, launched exclusively on August 22 and recouped their production costs in the first week, with revenue sharing exceeding RMB 8 million in the first month. The third, Princess's Dream, launched October 1 and boosted interest in the series. The production method combines AI technology with transferred live-action performances; production created nearly 500 character assets, nearly 800 scene assets, and nearly 200 key-prop assets.
The Runway AI Summit closed with Runway co-founder and co-CEO Cristóbal Valenzuela reflecting on the evolution of generative video and introducing Continuum, the latest project from Runway Labs.
Sign up to get notified when the full talks are available at https://summit.runway.com/talks
Andrej Karpathy shared several ways to ask LLMs to make their outputs easier to understand: write using the ASD-STE100 controlled-language standard or relax it to 80%; generate diagrams; output an interactive webpage in HTML; or make a custom explainer video, for example with voiceover using an ElevenLabs API key. He thinks that as models improve, more work will move up to supervision and understanding, and models will be able to create large custom software artifacts that previously were not worth making.
Tavus launched Griffin, which the company calls the first Human Interaction Model (HIM). In live video calls, it can receive and generate speech, facial expressions, tone of voice, gestures, and pauses at the same time.
Aishi Technology fully launched PixVerse R2, available on the web for motion commands and interactive game-like experiences. R2 brings five growth dimensions—model capacity, data, tasks, control signals, and time scale—into one framework, advanced through two parts: the Omni Causal AR capability layer and the Real-Time Acceleration layer.
Leiphone compared HiDream-O1-Video-1.0, Seedance 2.5, and MiniMax H3 on three original image-to-video tasks, evaluating intent planning, temporal causality, and audio-video alignment.
Dreamore officially changed its name to CreaXene and moved its website to creaxene.ai, shifting from a single AI-generation tool to an integrated creative platform. CreaXene plans to upgrade its canvas in October, bringing ideation, generation, editing, and adjustment into one workspace and building a creative showcase. Around the end of October, it also plans to launch global cultural adaptation features that explore turning existing assets into advertising suited to different markets.
Tests found that Seedance 2.5 has stronger visual presentation and character consistency, but blocked a plot rewrite based on reference images from the series Journey to Love, first saying the images might depict public figures and then stopping generation over 'copyright-protected elements' after the references were removed. Kling VIDEO 3.0 generated a complete 15-second short film with a twist ending.
An AWS tutorial shows how to deploy two endpoints using the same vLLM-Omni DLC image on SageMaker AI: a real-time endpoint using FLUX.2-klein-4B for image generation and an asynchronous endpoint using Wan2.1-VACE-1.3B for image-conditioned video generation. A text prompt first produces a PNG, then the image and motion prompt are sent through Amazon S3 to the video endpoint. The generated MP4 is retrieved from S3. The example includes a command-line workflow and an optional Streamlit interface.
Runway has released a research preview of GWM Worlds 2, turning high-fidelity video and audio generation into a real-time interactive simulation. It introduces WorldPrompt, an input format that can hold parts of the environment—including the first frame—constant while generating timestamped events that can also be prompted in real time.
Google Research has introduced an AI video co-director multi-agent framework, an orchestration layer on top of Gemini and Veo. It models long-form video generation as a problem of global optimization and world-state tracking to mitigate semantic drift and cascading failures.
Why it matters: Google breaks long-video generation into four composable frameworks and reports continuity improvements across several benchmarks, illustrating how multi-agent orchestration can reduce semantic drift.
Google DeepMind has released Gemini 3.8 Live with Live Avatar, combining real-time video generation and voice to give Gemini's conversational model a near-real-time visual avatar, with accurate lip-sync, natural expressions, and smooth turn-taking.
Why it matters: Gemini 3.8 Live adds real-time video avatars, giving readers a view of how multimodal conversation is being applied in enterprise settings and where the feature is available.
With GPT-6 Astra, invideo achieved more precise editing plans, tripled its color-grading and correction efficiency, and produced 50 custom effects in a single day.
With GPT-6 Astra, Higgsfield AI launched a new video feature in a single day, making it easier for small businesses to create video ads and bringing new creative tools to market faster.
How do you recreate a memory that was never filmed?
Our team combined restored archival photos with pose-controlled models to capture Burt and Ethelle's mannerisms and micro-expressions.
That helped recreate the day they first met for *Love, Rendered*, a new documentary made with @PrimordialSoup_ and @StorySyndicate_.
Watch the full film on YouTube → https://goo.gle/3V8m94m
Google DeepMind has introduced agentic video understanding for Gemini 3.7 Flash, 3.6 Flash, and 3.5 Flash-Lite. Video analysis uses up to 88% fewer tokens and costs up to 66% less, while accuracy improves by up to 7%.
Why it matters: The article gives token and cost reductions and access details, helping readers assess how the economics of long-video analysis are changing.
Why it matters: The article details capabilities such as extending scenes, interpolating between first and last frames, and 4K upscaling, helping readers assess how controllable video-generation workflows are becoming.
Google DeepMind and A24 have announced their first research-focused partnership, a long-term collaboration across several projects that will involve A24 and its filmmakers in shaping new technology. Google has also invested in A24. Initial work will focus on bridging frontier technology and next-generation entertainment, with specific goals and technical outputs to evolve over time.
Why it matters: Both models are available to developers, with details on latency, pricing, and capability limits to help assess the cost and usability of the image-to-video pipeline.