RESULTS_sensoronly_force_test_epoch009.md
4.0 KB · 73 lines · markdown Raw
1 # Sensor-only ± force, TEST sets, epoch_009 (both runs at the same checkpoint index)
2
3 wrist / tactile = mean of left & right; cells = mean over test cases; motherboard 20 cases, pushT 30 (28 long), rope 34.
4
5 ## PSNR ↑
6
7 | task | horizon | variant | video | wrist | tactile |
8 |---|---|---|---:|---:|---:|
9 | motherboard (n=20) | short | no force | 27.60 | 18.99 | 43.50 |
10 | motherboard (n=20) | short | + force | 27.64 | 19.02 | 43.47 |
11 | motherboard (n=20) | short | Δ (force − no force) | +0.04 | +0.04 | -0.02 |
12 | motherboard (n=20) | long | no force | 20.84 | 13.75 | 36.15 |
13 | motherboard (n=20) | long | + force | 21.13 | 13.84 | 35.99 |
14 | motherboard (n=20) | long | Δ (force − no force) | +0.28 | +0.09 | -0.16 |
15 | pushT (n=30) | short | no force | 29.18 | 22.28 | 46.60 |
16 | pushT (n=30) | short | + force | 29.20 | 22.18 | 46.98 |
17 | pushT (n=30) | short | Δ (force − no force) | +0.01 | -0.10 | +0.37 |
18 | pushT (n=30) | long | no force | 22.82 | 14.63 | 38.08 |
19 | pushT (n=30) | long | + force | 22.62 | 14.22 | 37.51 |
20 | pushT (n=30) | long | Δ (force − no force) | -0.19 | -0.41 | -0.57 |
21 | rope (n=34) | short | no force | 28.77 | 22.89 | 46.16 |
22 | rope (n=34) | short | + force | 28.74 | 22.67 | 46.11 |
23 | rope (n=34) | short | Δ (force − no force) | -0.03 | -0.22 | -0.05 |
24 | rope (n=34) | long | no force | 23.38 | 17.09 | 36.83 |
25 | rope (n=34) | long | + force | 23.32 | 17.11 | 37.27 |
26 | rope (n=34) | long | Δ (force − no force) | -0.07 | +0.02 | +0.44 |
27
28 ## SSIM ↑
29
30 | task | horizon | variant | video | wrist | tactile |
31 |---|---|---|---:|---:|---:|
32 | motherboard (n=20) | short | no force | 0.877 | 0.604 | 0.983 |
33 | motherboard (n=20) | short | + force | 0.879 | 0.605 | 0.983 |
34 | motherboard (n=20) | short | Δ (force − no force) | +0.001 | +0.001 | +0.000 |
35 | motherboard (n=20) | long | no force | 0.706 | 0.417 | 0.954 |
36 | motherboard (n=20) | long | + force | 0.713 | 0.419 | 0.955 |
37 | motherboard (n=20) | long | Δ (force − no force) | +0.007 | +0.002 | +0.001 |
38 | pushT (n=30) | short | no force | 0.920 | 0.828 | 0.988 |
39 | pushT (n=30) | short | + force | 0.920 | 0.826 | 0.988 |
40 | pushT (n=30) | short | Δ (force − no force) | -0.001 | -0.001 | -0.000 |
41 | pushT (n=30) | long | no force | 0.795 | 0.604 | 0.969 |
42 | pushT (n=30) | long | + force | 0.791 | 0.591 | 0.971 |
43 | pushT (n=30) | long | Δ (force − no force) | -0.004 | -0.014 | +0.002 |
44 | rope (n=34) | short | no force | 0.906 | 0.783 | 0.989 |
45 | rope (n=34) | short | + force | 0.905 | 0.777 | 0.989 |
46 | rope (n=34) | short | Δ (force − no force) | -0.002 | -0.005 | +0.000 |
47 | rope (n=34) | long | no force | 0.783 | 0.637 | 0.969 |
48 | rope (n=34) | long | + force | 0.782 | 0.636 | 0.969 |
49 | rope (n=34) | long | Δ (force − no force) | -0.001 | -0.001 | +0.000 |
50
51 ## LPIPS ↓
52
53 | task | horizon | variant | video | wrist | tactile |
54 |---|---|---|---:|---:|---:|
55 | motherboard (n=20) | short | no force | 0.048 | 0.216 | 0.032 |
56 | motherboard (n=20) | short | + force | 0.048 | 0.215 | 0.032 |
57 | motherboard (n=20) | short | Δ (force − no force) | +0.000 | -0.001 | -0.001 |
58 | motherboard (n=20) | long | no force | 0.203 | 0.452 | 0.181 |
59 | motherboard (n=20) | long | + force | 0.191 | 0.452 | 0.179 |
60 | motherboard (n=20) | long | Δ (force − no force) | -0.011 | +0.000 | -0.001 |
61 | pushT (n=30) | short | no force | 0.041 | 0.115 | 0.022 |
62 | pushT (n=30) | short | + force | 0.041 | 0.118 | 0.020 |
63 | pushT (n=30) | short | Δ (force − no force) | +0.000 | +0.002 | -0.001 |
64 | pushT (n=30) | long | no force | 0.169 | 0.364 | 0.115 |
65 | pushT (n=30) | long | + force | 0.172 | 0.380 | 0.107 |
66 | pushT (n=30) | long | Δ (force − no force) | +0.003 | +0.016 | -0.009 |
67 | rope (n=34) | short | no force | 0.046 | 0.133 | 0.021 |
68 | rope (n=34) | short | + force | 0.048 | 0.137 | 0.021 |
69 | rope (n=34) | short | Δ (force − no force) | +0.002 | +0.004 | +0.000 |
70 | rope (n=34) | long | no force | 0.172 | 0.303 | 0.115 |
71 | rope (n=34) | long | + force | 0.174 | 0.299 | 0.118 |
72 | rope (n=34) | long | Δ (force − no force) | +0.002 | -0.005 | +0.003 |
73