Multimodal
Evidence check
  • Preprint
  • No code released
  • Not independently replicated

Vidu S2 Brings Real-Time 720p Interactive Avatars and Live Video Editing

Tsinghua/Shengshu's Vidu S2: real-time 720p avatars with dynamic references, plus streaming edits (style, try-on, character/background swap). Human GSB prefers it 85.7–100% on overall quality vs top baselines.

Christopher Ort
By Christopher Ort · 2 min read
Share
A luminous, adaptable avatar seamlessly blending with a real-time changing digital scene.
Illustration: i10X
On this page
  1. Quick Take
  2. What the study shows
  3. Why it matters: interaction needs milliseconds
  4. Method in brief
  5. What remains open
  6. Context
  7. What it means for interactive video products
  8. About the analysis
  9. i10x Perspective
i10X Quick Take

Quick Take

  1. The finding: Vidu S2-Avatar supports real-time 720p generation with dynamic references and stronger instruction following; S2-Editing edits a live stream (style, try-on, character/background replacement).
  2. Preference wins: In GSB tests, S2-Avatar is preferred for overall quality in 85.7% of comparisons vs Runway Character GWM-1 and 100% vs PixVerse Image Avatar and HeyGen.
  3. Editing too: S2-Editing wins majority preferences on video quality, consistency and semantic adherence against several commercial editors.

Interactive digital characters and live video edits need real-time models, not offline renders. Tsinghua University and Shengshu Technology present Vidu S2, spanning Avatar and Editing, and explore real-time spatial video for both.

Column chart: Vidu S2-Avatar preferred in 85.7 percent of comparisons versus Runway, and 100 percent versus PixVerse and HeyGen on overall quality.
i10X chart based on data from Zhang et al. (2026), arXiv:2609.11638, Figure 6 GSB results (CC BY 4.0).

What the study shows

Clip filtering keeps false rejection under 2% while avoiding cuts. Human preference studies cover motion, expression, semantic adherence and A/V sync.

  • Motion and expression: Unanimous preference over Runway and HeyGen on both dimensions in reported cells; 100% expression preference over PixVerse.
  • Demo available: Playable demo at vidu.com/vidu-stream.

Why it matters: interaction needs milliseconds

Streaming avatars and try-on only work if generation keeps up with user input. S2 targets that product surface.

Method in brief

GSB human preference comparisons; streaming architectures for Avatar and Editing.

What remains open

  • Vendor study: Authors affiliated with Shengshu / Vidu product.
  • Preference N: Some cells use small comparison sets.

Context

Related video generation in Multimodal.

What it means for interactive video products

  • Prioritize dynamic references: Users change outfits mid-stream.
  • Bundle editing with generation: Same real-time stack.
  • Validate with GSB: Not only automated scores.

About the analysis

Researched and written with AI assistance under the editorial responsibility of the i10X News team. The title image is an AI-generated illustration. Read our AI Use Policy. Spotted an error? Request a correction.

This article is based on the full text of the preprint “Vidu S2: Real-Time Interactive, Editable, and Spatial Video Generation” (arXiv:2609.11638v1, submitted September 10, 2026). All numbers are taken from the paper’s text, tables and figures; i10X did not rerun the experiments. The chart was redrawn by i10X from Figure 6 GSB results of the paper, which is published under a CC BY 4.0 license.

i10x Perspective

Vidu S2’s story is product timing: real-time 720p with live edits is where digital characters leave the demo reel. The sweep of preference wins suggests the latency constraint did not force a quality cliff.

Christopher Ort

Christopher Ort

Christopher Ort handles SEO, AI agent workflows and PR & partnerships at i10x.ai, the all-in-one AI workspace built by i10X Global Pte. Ltd. in Singapore. He is a graduate of Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU). He is the author of “The Style Penalty”, a study published on SSRN that analyses 1,576 evaluation decisions by four frontier AI models to show how AI-written CVs fare in automated hiring screens; the research has been covered by heise online and t3n.

Editor's picks

  1. Anthropic IPO Filing Reveals Extreme AI Safety Risks
  2. Grok Imagine Odyssey Pilot Exposes AI Video Limits
  3. Anthropic Files S-1 for Nasdaq IPO Under Ticker ANT
  4. Jakarta Agentic AI Milestone Delivers Standardized AI Agents for Java
  5. llm-deepseek Serialization Bug Replays Text After Tool Use