Diagnose
Inspect the generated video using object, motion, contact, and support evidence.
GENERATE. DIAGNOSE. REPAIR.
Keep the scene. Repair the physics.
Physical plausibility is essential for realistic video generation. Existing methods impose physical guidance before synthesis via simulations or refined prompts, but this can limit dynamic diversity, miss errors that emerge only after generation, and require repeated regeneration when inconsistencies remain. We therefore study a generate–diagnose–repair paradigm that preserves the original generation capability and selectively repairs physical inconsistencies afterward, raising two key questions: what to repair, and how to repair? To address them, we introduce PhysRepair, an agentic video generation framework that combines causal reasoning over the observed physical failure with prior repair experience to enable localized and adaptive correction. Specifically, Spatiotemporal Causal Constraints identify the first invalid physical state and its causally affected states, producing a repair specification that guides physically plausible local regeneration while preserving unaffected content. Experience-augmented In-context Learning combines the ongoing repair context with relevant experience from previous repairs, allowing the agent to adapt its repair decisions across diverse physical failures and accumulate completed trajectories for future cases. Experiments on Physics-IQ Verified across solid mechanics, fluid dynamics, optics, thermodynamics, and magnetism demonstrate that PhysRepair consistently improves the physical plausibility of generated videos over existing methods.
Observe the failure. Constrain the intervention. Verify what changed.
Inspect the generated video using object, motion, contact, and support evidence.
Separate the causally affected states from the states that must remain fixed.
Retrieve experience and simulate a plausible counterfactual to guide regeneration.
Check physics and preservation; distill the completed trajectory for later cases.
Video data could not be loaded. Please reload the page or serve the downloaded site over HTTP.
Physics-IQ Verified · 198 take-1 instances · 66 experiments · 3 viewpoints
| Method | SP ↑ | ST ↑ | WS ↑ | MSE score ↑ | Physics-IQ ↑ |
|---|
SP: Spatial IoU · ST: Spatiotemporal IoU · WS: Weighted Spatial IoU. “—” denotes an unreported value. Benchmark reference continuations and evaluator masks are used only for evaluation.
ABLATION
@misc{physrepair,
title = {Agentic Physics-Grounded Video Generation via
Memory-Augmented In-Context Reasoning},
author = {Guan, Xikang and Yang, Shaocong and Bao, Yanqi and Wang, Can and Gu, Zheng and Chen, Zhengqing and Chen, Kai and Huo, Jing and Gao, Yang},
note = {Manuscript}
}