VTWM p01rand — 40s long-horizon AR rollout

Diffusion-forcing world model rollouts. Each sample is ~2.7 s (16 raw frames @ 6 fps). Side-by-side videos show ground truth on the left, model prediction on the right. First half of each clip = history (GT), second half = autoregressively sampled future. Click a sample header to expand its videos (default-collapsed to keep the page light).

p01rand (0.0140) — 40s long-horizon AR rollout

Episode_random_no_contact tactile anchor fixed p01 memorization: val 0.0159→0.0140 (−12%), train/val gap 1.32×→1.07×. This space holds the 3-sample × 40s AR rollout.

Sections

Setup comparison

Click a run name to jump to its rollout videos. ✓ = feature on, ✗ = off. Lower val_loss is better.

runfusionviewstactileshift16delta-refcam-posegateval_loss
p01rand_val_0.0140

Rollout-latent metrics (10 val samples)

Latent-space MSE of predicted future vs ground truth. Contact/no-contact split uses tactile latent-to-reference energy (threshold 0.05).

runview MSETL MSETR MSEtactile contact MSEtactile no-contact MSE
p01rand_val_0.01401.6015811.9817002.0866212.0384321.695410

Other

p01rand_val_0.0140

sample_000  (click to expand videos)
panel for p01rand_val_0.0140/sample_000
view_left — GT | rollout
view_middle (top-down) — GT | rollout
view_right — GT | rollout
tactile_left — GT | rollout
tactile_right — GT | rollout
sample_001  (click to expand videos)
panel for p01rand_val_0.0140/sample_001
view_left — GT | rollout
view_middle (top-down) — GT | rollout
view_right — GT | rollout
tactile_left — GT | rollout
tactile_right — GT | rollout
sample_002  (click to expand videos)
panel for p01rand_val_0.0140/sample_002
view_left — GT | rollout
view_middle (top-down) — GT | rollout
view_right — GT | rollout
tactile_left — GT | rollout
tactile_right — GT | rollout