GENERATE. DIAGNOSE. REPAIR.

PhysRepairAgentic Physics-Grounded Video Generation
via Memory-Augmented In-Context Reasoning

Keep the scene. Repair the physics.

Authors & affiliations
Xikang Guan1Shaocong Yang1Yanqi Bao2Can Wang3Zheng Gu4Zhengqing Chen2Kai Chen1Jing Huo1Yang Gao1
PHYSICAL INTERACTIONS · REPAIRED RESULTS Scroll to explore
01 / ABSTRACT

Abstract

Physical plausibility is essential for realistic video generation. Existing methods impose physical guidance before synthesis via simulations or refined prompts, but this can limit dynamic diversity, miss errors that emerge only after generation, and require repeated regeneration when inconsistencies remain. We therefore study a generate–diagnose–repair paradigm that preserves the original generation capability and selectively repairs physical inconsistencies afterward, raising two key questions: what to repair, and how to repair? To address them, we introduce PhysRepair, an agentic video generation framework that combines causal reasoning over the observed physical failure with prior repair experience to enable localized and adaptive correction. Specifically, Spatiotemporal Causal Constraints identify the first invalid physical state and its causally affected states, producing a repair specification that guides physically plausible local regeneration while preserving unaffected content. Experience-augmented In-context Learning combines the ongoing repair context with relevant experience from previous repairs, allowing the agent to adapt its repair decisions across diverse physical failures and accumulate completed trajectories for future cases. Experiments on Physics-IQ Verified across solid mechanics, fluid dynamics, optics, thermodynamics, and magnetism demonstrate that PhysRepair consistently improves the physical plausibility of generated videos over existing methods.

Comparison of physics-grounded video generation paradigms.
02 / THE FRAMEWORK

Pipline

Observe the failure. Constrain the intervention. Verify what changed.

Spatiotemporal causal constraints define what may change and what must remain fixed. Experience-augmented in-context learning guides localized repair, followed by physics-and-preservation verification and experience distillation.
01

Diagnose

Inspect the generated video using object, motion, contact, and support evidence.

02

Constrain

Separate the causally affected states from the states that must remain fixed.

03

Repair

Retrieve experience and simulate a plausible counterfactual to guide regeneration.

04

Verify & remember

Check physics and preservation; distill the completed trajectory for later cases.

03 / SEE THE DIFFERENCE

Qualitative comparison

04 / QUANTITATIVE EVALUATION

Better agreement with physical dynamics.

Physics-IQ Verified · 198 take-1 instances · 66 experiments · 3 viewpoints

43.6Physics-IQ score39.8 → 43.6 over MiniMax H3
+11.9Spatiotemporal IoU22.8 → 34.7
+3.7Weighted Spatial IoU40.5 → 44.2
Results reported in the supplied manuscript. Higher is better for all listed scores.
MethodSP ↑ST ↑WS ↑MSE score ↑Physics-IQ ↑

SP: Spatial IoU · ST: Spatiotemporal IoU · WS: Weighted Spatial IoU. “—” denotes an unreported value. Benchmark reference continuations and evaluator masks are used only for evaluation.

05 / ABLATION & ANALYSIS

Repair the whole causal story.

ABLATION

REFERENCE

Citation

@misc{physrepair,
  title = {Agentic Physics-Grounded Video Generation via
           Memory-Augmented In-Context Reasoning},
  author = {Guan, Xikang and Yang, Shaocong and Bao, Yanqi and Wang, Can and Gu, Zheng and Chen, Zhengqing and Chen, Kai and Huo, Jing and Gao, Yang},
  note = {Manuscript}
}
Expanded paper figure↑