Audio-Visual Highlight · ablation · shared vs independent bridge time

Does each modality need its own diffusion time?

The bridge model draws a time t and asks the network to move audio and video that far toward the edited target. The baseline run draws two independent times (ta, tv) with a second timestep embedder; the ablation draws one shared t for both and is otherwise byte-identical — same data, architecture, bridge noise σ = 1, optimiser and seed. Both are decoded here on the same 84 held-out clips with the same sampler (Euler, t₀ = 0.02, 10 steps), so every difference comes from that one flag.

The ablation, at the matched checkpoint

Both runs saved a checkpoint at optimiser step 12,000. This is the only comparison in which nothing but the flag differs; everything below it is context. Edit size = ‖generated − input‖ / ‖target − input‖ on the waveform — 1.00 means the model moved the audio exactly as far as the ground truth did.

step 12,000 audio PSNR ↑LSD ↓clips > floor edit sizecos envelope video PSNR ↑SSIM ↑LPIPS ↓FVD ↓
pass-throughreturn the input unchanged 21.209.77– 0.00– 16.870.6000.302362
independent (ta, tv)baseline, 2 embedders 21.689.5442/84 0.710.40 18.120.6260.269289
shared tablation, 1 embedder 22.119.5342/84 0.710.43 17.600.6110.270310
shared − independentthe ablation effect +0.43-0.01 +0 +0.01+0.03 -0.51-0.015+0.001 +21

Every checkpoint scored on these 84 clips

Pass-through is the floor: return the input untouched. Because the target differs from the input by only one amplified object, a model that does nothing already scores 21.20 dB, so PSNR alone cannot tell you whether an edit happened — read it together with edit size.

audio video
checkpointsteps PSNR ↑LSD ↓clips > flooredit size PSNR ↑SSIM ↑LPIPS ↓FVD ↓
pass-throughreturn the input unchanged –21.209.77 –0.00 16.870.6000.302362
independent (ta, tv) — baseline run
epoch 895.6k steps5.6k21.319.7833/840.9318.150.6210.270317
step 8kscores only8k21.079.3728/840.8918.010.6350.265327
epoch 1529.5k steps9.5k21.849.3242/840.7518.160.6300.267306
epoch 161val-best, 10.0k10k20.8710.0932/840.8218.380.6380.262303
step 12kmatched point12k21.689.5442/840.7118.120.6260.269289
step 16kscores only16k22.009.2651/840.5218.090.6320.267297
epoch 32720.3k steps20.3k22.079.1451/840.5518.190.6300.269292
step 24kscores only24k21.679.7049/840.6218.150.6250.268319
shared t — ablation run
step 12kmatched point12k22.119.5342/840.7117.600.6110.270310
epoch 230latest, 14.3k14.3k21.829.7644/840.6418.190.6280.270302
earlier run, before the noise fix
earlier runsigma 0.01, epoch 98561.1k19.8110.5426/841.1417.850.6120.282666

Clip by clip

Each card: the three reference streams, then the baseline run’s checkpoints, then the ablation’s. The two tiles outlined in colour are the matched step-12k pair — the actual ablation. Videos carry their own audio; the players underneath compare the waveforms directly. PSNR vs floor is that clip’s generated PSNR minus its pass-through PSNR, so positive means the edit helped on that clip.

01

drum

multiple11 visible
EcMP56K2VvY
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89+7.781.19
epoch 152+9.271.05
epoch 161+8.801.07
step 12k+9.630.97
epoch 327+9.430.85
step 12k+9.741.04
epoch 230+9.611.03
earlier run+6.271.10
02

violinist

none0 visible
5a019Ilbr-U_000030
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89+4.601.09
epoch 152+4.850.83
epoch 161-0.290.79
step 12k+4.700.80
epoch 327+4.100.68
step 12k+3.130.76
epoch 230+3.680.72
earlier run+1.471.15
03

metal object

multiple2 visible
cP3dsI4hvww
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89+5.711.06
epoch 152+4.090.79
epoch 161+1.260.71
step 12k+1.950.66
epoch 327+1.480.57
step 12k+2.710.67
epoch 230+1.260.61
earlier run+5.191.02
04

tires

single1 visible
7E6QJ5Lxs94_000106
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89+7.761.00
epoch 152+7.840.99
epoch 161+6.480.92
step 12k+7.090.91
epoch 327+6.150.85
step 12k+7.830.98
epoch 230+6.520.90
earlier run+4.741.02
05

percussion

none0 visible
DemXBQgkyWA_000848
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89+3.991.17
epoch 152+4.741.04
epoch 161+4.011.06
step 12k+4.520.98
epoch 327+3.530.65
step 12k+4.801.02
epoch 230+4.750.96
earlier run+3.900.99
06

dog

single1 visible
FVy-wvJ0GVc_000030
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89+3.500.86
epoch 152+2.750.81
epoch 161-1.431.13
step 12k+1.960.85
epoch 327+4.700.83
step 12k+4.490.85
epoch 230+3.580.83
earlier run-2.301.45
07

drum groove

multiple3 visible
8J-A_qPn4Jg_000161
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89+4.371.02
epoch 152+4.040.91
epoch 161+3.570.91
step 12k+3.750.86
epoch 327+5.050.84
step 12k+4.410.94
epoch 230+4.090.90
earlier run+2.011.06
08

printer

multiple2 visible
lZy6qRuGamQ_000020
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89+5.121.01
epoch 152+4.700.91
epoch 161+3.990.91
step 12k+4.490.88
epoch 327+4.340.76
step 12k+4.740.89
epoch 230+3.330.64
earlier run+4.851.03
09

cattle mooing

single1 visible
QrVZQY98pO8
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89+2.410.90
epoch 152+2.630.82
epoch 161+1.390.85
step 12k+2.680.79
epoch 327+1.800.61
step 12k+2.880.83
epoch 230+1.600.72
earlier run+0.091.05
10

(no prompt on record)

unknowncount ?
owo5wbBQlAg_000090
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89+3.521.30
epoch 152+4.800.84
epoch 161+3.260.66
step 12k+4.240.74
epoch 327+2.770.51
step 12k+3.590.65
epoch 230+2.860.57
earlier run+2.151.27
11

drum

multiple4 visible
9Uhjj0cuPPE_000167
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89+2.071.54
epoch 152+3.381.41
epoch 161+2.901.45
step 12k+3.921.37
epoch 327+7.661.03
step 12k+4.361.35
epoch 230+4.021.38
earlier run+3.731.44
12

motorcycle

single1 visible
N-LO3sRsxyw_000030
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89+7.031.04
epoch 152+7.510.86
epoch 161+5.200.87
step 12k+5.300.73
epoch 327+3.680.56
step 12k+7.420.98
epoch 230+5.280.87
earlier run+1.450.76
13

table

single1 visible
h17Ya5FDe74
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89+9.481.05
epoch 152+4.620.93
epoch 161+1.810.97
step 12k+3.980.88
epoch 327+5.850.76
step 12k+4.990.77
epoch 230+3.220.67
earlier run-1.261.15
14

steam whistle

none0 visible
qsetyJ-Hcxk_001067
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89+5.291.03
epoch 152+5.990.79
epoch 161+1.630.50
step 12k+4.430.76
epoch 327-0.180.32
step 12k+3.410.54
epoch 230+1.470.40
earlier run+2.310.92
15

drums

single1 visible
ezKL1O_5OU4_000030
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89+1.580.91
epoch 152+1.700.79
epoch 161+1.060.71
step 12k+1.270.67
epoch 327+1.060.54
step 12k+1.460.72
epoch 230+1.330.70
earlier run+1.760.91
16

birds

single1 visible
uaVesjFTcVE
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89-2.221.22
epoch 152+1.160.80
epoch 161-1.270.78
step 12k+2.070.62
epoch 327+0.790.57
step 12k+2.410.74
epoch 230+4.430.75
earlier run-3.041.27
17

violin

single1 visible
Pq2CiWrIRMg
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89-1.001.23
epoch 152+1.210.65
epoch 161+1.080.49
step 12k+1.300.50
epoch 327+0.960.32
step 12k+1.190.69
epoch 230+1.430.55
earlier run+0.920.59
18

motor vehicle

single1 visible
JQVyOPl9hwM_000002
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89+1.151.00
epoch 152+2.591.06
epoch 161+1.050.94
step 12k+2.560.99
epoch 327+3.350.97
step 12k+2.461.07
epoch 230+2.841.00
earlier run+2.801.16
19

harp

single1 visible
mzY_qcsrneA_000211
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89+0.940.81
epoch 152+1.310.53
epoch 161+1.110.46
step 12k+1.230.45
epoch 327+1.040.38
step 12k+1.350.51
epoch 230+1.190.42
earlier run+0.730.88
20

violin

single1 visible
vrXjEZxFtPk_000030
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89+5.161.06
epoch 152+3.930.63
epoch 161+2.890.48
step 12k+3.330.50
epoch 327+1.500.26
step 12k+3.710.55
epoch 230+2.690.44
earlier run+2.710.57
21

birds

multiple8 visible
uCl6QEe-q_A
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89-2.340.57
epoch 152-0.320.35
epoch 161+0.400.35
step 12k+0.140.33
epoch 327+0.220.28
step 12k-0.250.34
epoch 230+0.520.32
earlier run+1.470.69
22

piano

single1 visible
gVs9LBoayNw_000170
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89-2.700.59
epoch 152-0.870.40
epoch 161-0.070.45
step 12k-0.360.35
epoch 327-0.200.24
step 12k-0.540.36
epoch 230-0.250.31
earlier run-1.650.85
23

helicopter rotor

single1 visible
5o-s547x2e8_000090
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89+0.481.30
epoch 152+1.141.20
epoch 161+0.981.13
step 12k+1.241.16
epoch 327+1.960.97
step 12k+1.141.13
epoch 230+0.781.12
earlier run+0.541.16
24

didgeridoo

none0 visible
g62Fz8BsMMY_000039
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89+0.651.27
epoch 152+2.570.96
epoch 161+2.220.93
step 12k+2.620.81
epoch 327+2.670.73
step 12k+2.191.06
epoch 230+2.411.00
earlier run+0.751.19
25

snack foods

single1 visible
XcWz4f3zZ34_000435
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89+0.540.67
epoch 152+0.650.61
epoch 161+0.470.64
step 12k+0.790.59
epoch 327+0.860.56
step 12k+0.840.60
epoch 230+0.630.62
earlier run+0.920.67
26

trumpet

multiple5 visible
CsZbo7CaoTM_000370
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89+0.091.12
epoch 152+1.040.87
epoch 161+0.820.75
step 12k+1.090.80
epoch 327+1.480.76
step 12k+1.270.79
epoch 230+1.370.70
earlier run+0.211.05
27

violin

multiple2 visible
92y57zHtbxA_000030
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89-2.660.88
epoch 152+0.100.30
epoch 161-0.160.42
step 12k+0.100.36
epoch 327+0.310.25
step 12k+0.070.31
epoch 230+0.130.27
earlier run-3.521.01
28

cymbal

none0 visible
9zSFeVA140A
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89-0.361.66
epoch 152+1.091.41
epoch 161-1.091.61
step 12k+0.071.50
epoch 327+2.251.12
step 12k-0.481.63
epoch 230-0.821.63
earlier run-1.451.35
29

train

single1 visible
Kl2n25A7DJU
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89+2.580.80
epoch 152+1.450.47
epoch 161-0.510.51
step 12k+0.470.47
epoch 327+0.060.40
step 12k+2.500.55
epoch 230-0.030.46
earlier run-2.291.08
30

leaves

none0 visible
WuwYZrP7PHs
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89-1.140.71
epoch 152-2.180.89
epoch 161-4.471.47
step 12k-3.791.26
epoch 327-1.170.64
step 12k-1.990.74
epoch 230-1.940.74
earlier run-3.091.41
31

water

single1 visible
4wjx1lfWPuc_000066
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89-0.830.54
epoch 152+1.040.49
epoch 161+1.170.66
step 12k+0.470.48
epoch 327+0.380.44
step 12k-0.110.49
epoch 230+0.940.46
earlier run+0.301.06
32

violin

single1 visible
VYwH6x11XU0_000060
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89+0.830.95
epoch 152+1.240.39
epoch 161-2.290.64
step 12k+0.860.34
epoch 327+0.470.25
step 12k+1.030.47
epoch 230+0.450.29
earlier run+1.760.93
33

male speaker

single1 visible
Xf4kEpP8Zdk_000200
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89+8.880.87
epoch 152+6.060.64
epoch 161+0.980.55
step 12k+1.570.49
epoch 327+1.320.36
step 12k+7.760.72
epoch 230+4.140.64
earlier run-0.180.88
34

birds

multiple2 visible
jCrQuzFfdGM_000020
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89+0.070.71
epoch 152-1.340.75
epoch 161-5.871.69
step 12k-2.030.87
epoch 327+1.180.50
step 12k+0.720.55
epoch 230-0.030.55
earlier run-4.151.39
35

computer keyboard

single1 visible
DEAF8XXAhUo_000030
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89-0.490.40
epoch 152-0.370.40
epoch 161-0.370.44
step 12k-0.270.36
epoch 327-0.120.32
step 12k-0.240.36
epoch 230-0.280.39
earlier run-0.510.40
36

individuals

multiple2 visible
afJFNGBfNgU_000070
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89-1.130.99
epoch 152+0.090.77
epoch 161+0.120.70
step 12k+0.340.71
epoch 327+0.500.53
step 12k-0.090.81
epoch 230+0.370.70
earlier run-0.740.97
37

engine

single1 visible
9qN2AmJnjQU
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89-1.600.66
epoch 152-0.650.49
epoch 161-0.250.62
step 12k-0.160.49
epoch 327+0.160.52
step 12k-0.540.47
epoch 230-0.150.52
earlier run-1.230.82
38

canine

single1 visible
uw3ZOQaQwA8_000436
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89-0.190.54
epoch 152-0.010.37
epoch 161-0.440.42
step 12k-0.340.37
epoch 327-0.100.34
step 12k-0.070.36
epoch 230-0.090.36
earlier run-0.080.56
39

train

single1 visible
jw6QZJZ4CfU_000046
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89-1.310.59
epoch 152+0.370.40
epoch 161+1.140.51
step 12k+0.560.41
epoch 327+0.750.38
step 12k-0.080.44
epoch 230+0.760.46
earlier run-1.791.08
40

wind

single1 visible
XC4Rx2g4Q34_000169
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89+6.640.96
epoch 152+1.690.78
epoch 161-0.630.89
step 12k+1.980.72
epoch 327+5.250.79
step 12k+4.460.71
epoch 230+2.680.62
earlier run+1.321.06
41

banjo

single1 visible
io94WhQJZ5k_000095
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89-2.661.77
epoch 152+1.331.14
epoch 161+2.300.70
step 12k+2.280.97
epoch 327+2.510.83
step 12k+2.610.85
epoch 230+1.990.59
earlier run-2.471.70
42

Hammond organ

single1 visible
LjE7dtwKTVI_000086
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89+1.030.77
epoch 152+1.250.59
epoch 161+0.920.64
step 12k+1.110.58
epoch 327+1.250.43
step 12k+1.300.64
epoch 230+1.520.54
earlier run-0.420.83
43

fast-moving water

single1 visible
f4BDxEci8Nk_000040
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89-1.210.65
epoch 152-0.360.43
epoch 161-1.230.67
step 12k-0.470.47
epoch 327-0.320.40
step 12k-0.230.38
epoch 230-0.510.46
earlier run-2.170.88
44

machine

single1 visible
jt4Tv8TOy0k_000457
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89-1.350.92
epoch 152+0.080.71
epoch 161-0.300.74
step 12k-0.040.70
epoch 327-0.100.65
step 12k-0.110.71
epoch 230-0.020.67
earlier run-1.430.92
45

birds

multiple3 visible
Z059OP-tpB0_000010
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89-1.550.43
epoch 152-1.460.45
epoch 161-1.940.61
step 12k-1.570.47
epoch 327-0.440.28
step 12k-1.530.41
epoch 230-1.750.49
earlier run-1.540.49
46

drum kit

multiple4 visible
ZL2KfhOJGuM_000030
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89-1.410.98
epoch 152+1.280.66
epoch 161+1.260.73
step 12k+0.920.66
epoch 327+0.100.70
step 12k+0.070.80
epoch 230+0.580.74
earlier run-2.361.19
47

machinery

single1 visible
gyR9ElSyem0
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89-2.941.19
epoch 152-2.191.06
epoch 161-1.470.98
step 12k-1.470.97
epoch 327-1.130.87
step 12k-1.771.01
epoch 230-1.190.94
earlier run-2.261.25
48

engine

none0 visible
dcsSiM5yrnE_000090
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89-2.570.96
epoch 152-1.670.80
epoch 161-1.310.81
step 12k-1.220.75
epoch 327-0.700.64
step 12k-1.260.74
epoch 230-1.170.72
earlier run-2.361.21
49

wind

single1 visible
PeHYeTnyhIk_000280
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89-0.920.90
epoch 152-0.230.74
epoch 161-0.820.77
step 12k-0.280.72
epoch 327-0.230.56
step 12k-0.080.74
epoch 230-0.540.73
earlier run-1.290.99
50

violin

single1 visible
lf8ZHFfJigw_000100
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89-0.930.77
epoch 152-0.070.46
epoch 161-2.170.82
step 12k-0.280.48
epoch 327+0.210.30
step 12k-0.100.46
epoch 230+0.440.30
earlier run-3.611.25
51

birds

multiple2 visible
ivO2J4Cx-sw_000347
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89-1.190.21
epoch 152-0.470.16
epoch 161-0.520.22
step 12k-1.640.28
epoch 327-0.860.18
step 12k-1.650.28
epoch 230-1.120.23
earlier run+2.970.78
52

train

single1 visible
thX677yyh9w
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89-1.990.96
epoch 152-1.370.80
epoch 161-1.730.82
step 12k-1.250.75
epoch 327-1.020.62
step 12k-1.240.79
epoch 230-1.240.78
earlier run-2.681.08
53

banjo

single1 visible
MpNPxd9dzLA_000080
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89-1.780.99
epoch 152-0.460.74
epoch 161-0.430.69
step 12k-0.160.64
epoch 327+0.340.48
step 12k-0.120.66
epoch 230+0.060.55
earlier run-1.641.01
54

wooden percussion

multiple2 visible
4rO0BUf85i8_000023
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89-2.300.84
epoch 152-0.720.49
epoch 161-0.790.51
step 12k-0.810.50
epoch 327-0.490.39
step 12k-0.920.50
epoch 230-0.750.44
earlier run-2.150.83
55

rooster

none0 visible
5XhVzviHgMI_000030
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89-0.060.78
epoch 152-0.570.59
epoch 161-1.190.60
step 12k-0.970.59
epoch 327+0.020.48
step 12k-0.190.56
epoch 230-0.760.53
earlier run-1.490.82
56

car

multiple2 visible
z4aJAng57Ss_000000
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89-1.981.21
epoch 152+0.630.79
epoch 161-1.911.01
step 12k-0.410.81
epoch 327-0.460.70
step 12k-0.070.73
epoch 230-1.050.72
earlier run-2.421.20
57

(no prompt on record)

unknowncount ?
X1NCGW2ildo_000030
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89-5.041.38
epoch 152-2.670.97
epoch 161-2.590.98
step 12k-2.330.87
epoch 327-1.390.70
step 12k-2.240.87
epoch 230-1.270.73
earlier run-3.361.29
58

trumpet

single1 visible
X6u_LdIscOs_000244
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89-2.171.09
epoch 152-0.430.62
epoch 161-2.290.94
step 12k-0.140.60
epoch 327+0.450.44
step 12k+0.140.61
epoch 230+0.290.46
earlier run-4.681.58
59

man

single1 visible
R8OZtGpsDos_000100
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89-2.030.71
epoch 152-1.010.37
epoch 161-3.580.83
step 12k-2.430.53
epoch 327-1.680.38
step 12k-1.610.45
epoch 230-2.780.55
earlier run-2.541.01
60

water

single1 visible
A-UlzQuBDvg_000030
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89-0.970.76
epoch 152-0.680.67
epoch 161-1.560.84
step 12k-0.730.69
epoch 327-0.840.70
step 12k-0.520.64
epoch 230-1.010.73
earlier run-2.411.13
61

individuals

multiple3 visible
dPpgoNlkbW8_000220
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89-2.931.46
epoch 152-1.511.19
epoch 161-1.191.09
step 12k-1.231.11
epoch 327-0.060.90
step 12k-0.501.00
epoch 230-0.320.95
earlier run-3.091.42
62

birds

multiple4 visible
FFKilY45t_g
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89-2.100.77
epoch 152-0.450.74
epoch 161-2.391.15
step 12k-0.130.64
epoch 327-0.520.57
step 12k-0.850.68
epoch 230-0.140.63
earlier run-3.351.73
63

birds

multiple6 visible
txsAOUYOPDg
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89+0.220.41
epoch 152+1.740.48
epoch 161+1.880.87
step 12k+2.010.64
epoch 327+0.770.20
step 12k+0.800.33
epoch 230+1.850.41
earlier run-5.642.33
64

saxophone

multiple2 visible
CB0yYGVNcOk_000030
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89-3.501.63
epoch 152-0.431.18
epoch 161+1.281.00
step 12k+0.821.04
epoch 327+1.550.64
step 12k+0.761.03
epoch 230+2.140.89
earlier run-1.851.38
65

screeching tires

single1 visible
2X94TArF_Jg_000070
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89-2.970.65
epoch 152-1.440.45
epoch 161-1.240.47
step 12k-1.170.48
epoch 327-1.490.45
step 12k-1.870.51
epoch 230-0.910.43
earlier run-2.530.65
66

piano

single1 visible
hZEb8IPs-tg
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89-2.590.76
epoch 152-0.970.54
epoch 161-1.220.75
step 12k-0.620.53
epoch 327+0.060.36
step 12k-0.930.54
epoch 230-0.480.51
earlier run-2.811.31
67

train

single1 visible
cIvTjBnxNck
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89+0.440.90
epoch 152+0.780.69
epoch 161+0.630.87
step 12k+0.890.73
epoch 327+0.840.58
step 12k+0.590.79
epoch 230+0.680.72
earlier run-0.781.25
68

bagpipes

none0 visible
fNhWxH_NUh8_000097
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89-0.520.93
epoch 152+0.050.68
epoch 161-2.181.00
step 12k-0.460.72
epoch 327-0.050.55
step 12k+0.260.58
epoch 230-0.580.62
earlier run-3.561.31
69

piano

single1 visible
kxyFBPjbT3o_000099
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89-4.281.18
epoch 152-1.230.57
epoch 161-0.900.59
step 12k-1.250.57
epoch 327-1.210.54
step 12k-0.940.52
epoch 230-0.550.46
earlier run-3.621.22
70

motorcycle engine

single1 visible
Z15myrYxsyo_000060
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89-2.770.84
epoch 152-2.710.84
epoch 161-4.001.19
step 12k-2.870.89
epoch 327-1.450.58
step 12k-2.620.79
epoch 230-2.940.89
earlier run-3.571.18
71

guitar

single1 visible
VyY3k_NXKRE
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89-0.160.81
epoch 152-0.010.55
epoch 161-1.960.82
step 12k-0.400.52
epoch 327+0.180.39
step 12k-0.320.53
epoch 230-0.460.48
earlier run-4.311.36
72

birds

single1 visible
FPKLZ3tHdkU
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89-4.251.21
epoch 152-2.480.75
epoch 161-3.891.12
step 12k-2.200.67
epoch 327-1.570.56
step 12k-3.940.92
epoch 230-2.020.59
earlier run-3.401.03
73

resonant piano

single1 visible
oUobU5EoHsc
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89-0.850.69
epoch 152-0.240.57
epoch 161-0.800.69
step 12k+0.400.54
epoch 327+1.210.26
step 12k+1.180.29
epoch 230+0.250.57
earlier run-6.032.03
74

birds

multiple10 visible
9UMBmxvrNoA
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89-0.740.39
epoch 152-0.000.48
epoch 161-0.970.76
step 12k+0.030.46
epoch 327+0.240.28
step 12k+0.330.18
epoch 230+0.140.39
earlier run-3.801.36
75

water

single1 visible
B79FYBjYc6Q_000046
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89-0.620.43
epoch 152-0.820.58
epoch 161-2.380.98
step 12k-0.510.51
epoch 327-0.360.47
step 12k-0.620.51
epoch 230-1.770.84
earlier run-5.131.67
76

birds

multiple2 visible
c9u0aS4fTOY
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89-1.490.93
epoch 152-0.010.85
epoch 161-0.561.05
step 12k-0.320.87
epoch 327+0.350.52
step 12k-0.620.79
epoch 230+0.080.75
earlier run-5.932.14
77

water

single1 visible
Kw9H1j4IskU_000180
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89-0.420.85
epoch 152+0.070.68
epoch 161-2.961.07
step 12k-1.130.77
epoch 327-0.880.62
step 12k-0.160.67
epoch 230-2.080.83
earlier run-2.621.24
78

gong

single1 visible
RVOpQ5tOChY_000085
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89-5.541.39
epoch 152-4.261.18
epoch 161-6.211.71
step 12k-2.980.92
epoch 327-0.300.35
step 12k-4.461.16
epoch 230-3.480.99
earlier run-4.771.77
79

saxophone

single1 visible
lOjC7F2oFUY_000000
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89-4.501.48
epoch 152-1.520.94
epoch 161-1.270.84
step 12k-1.490.91
epoch 327-0.750.80
step 12k-1.740.95
epoch 230-0.410.77
earlier run-4.661.56
80

birds

single1 visible
hqRVceACOF4_000032
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89+0.490.52
epoch 152-0.590.52
epoch 161-1.550.71
step 12k-0.530.54
epoch 327+0.420.38
step 12k+0.050.40
epoch 230-0.050.43
earlier run-3.771.23
81

rooster

single1 visible
usGU6m6XzjI
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89-5.901.72
epoch 152-1.990.98
epoch 161-1.040.85
step 12k-1.110.85
epoch 327-1.130.83
step 12k-1.020.91
epoch 230-0.430.76
earlier run-2.911.28
82

canine

none0 visible
wfS6n2GfdLE_000025
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89-2.061.08
epoch 152-3.311.19
epoch 161-1.220.94
step 12k-2.741.13
epoch 327-2.831.08
step 12k-3.751.28
epoch 230-2.060.99
earlier run-4.741.62
83

tuning fork

multiple3 visible
E_ZBELcyb3g_000008
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89+5.521.04
epoch 152-9.081.94
epoch 161-7.981.61
step 12k-7.241.41
epoch 327-1.600.30
step 12k+8.170.73
epoch 230-0.640.23
earlier run-9.222.29
84

water

single1 visible
eW7_vMFcGRA_000379
Reference
Inputthe untouched clip
Conditionmask latent decoded back to pixels — what the model is told to highlight
Targetground truth: object louder and visually lifted
Independent (t₀, tᵛ) — baseline
epoch 895.6k steps
epoch 1529.5k steps
epoch 161val-best, 10.0k
step 12kmatched point
epoch 32720.3k steps
Shared t — ablation
step 12kmatched point
epoch 230latest, 14.3k
earlier runsigma 0.01, 61.1k
Input mix
Target
baseline epoch 89
baseline epoch 152
baseline epoch 161
baseline step 12k
baseline epoch 327
shared-t step 12k
shared-t epoch 230
earlier run
checkpointPSNR vs flooredit size
epoch 89+0.390.93
epoch 152-1.680.88
epoch 161-5.391.53
step 12k-3.561.16
epoch 327-1.150.70
step 12k-0.870.80
epoch 230-4.101.24
earlier run-11.253.37