Full evaluation cohort. Left: box tracker at 1008; right: mask-to-box at 672. Dashed boxes: ground truth; solid boxes: predictions; colors: object IDs; p: presence probability. Low-confidence predictions remain visible.Teal: box tracker; orange: mask-to-box. Dips show when overlap degrades; gaps indicate no visible ground-truth object.
2 · sav_001676
Duration
Initial objects
Box IoU
Mask-to-box IoU
2.3 s
1
43.4%
28.9%
Full evaluation cohort. Left: box tracker at 1008; right: mask-to-box at 672. Dashed boxes: ground truth; solid boxes: predictions; colors: object IDs; p: presence probability. Low-confidence predictions remain visible.Teal: box tracker; orange: mask-to-box. Dips show when overlap degrades; gaps indicate no visible ground-truth object.
3 · sav_001799
Duration
Initial objects
Box IoU
Mask-to-box IoU
17.7 s
2
60.0%
71.8%
Full evaluation cohort. Left: box tracker at 1008; right: mask-to-box at 672. Dashed boxes: ground truth; solid boxes: predictions; colors: object IDs; p: presence probability. Low-confidence predictions remain visible.Teal: box tracker; orange: mask-to-box. Dips show when overlap degrades; gaps indicate no visible ground-truth object.
4 · sav_001826
Duration
Initial objects
Box IoU
Mask-to-box IoU
26.5 s
2
35.9%
38.1%
Full evaluation cohort. Left: box tracker at 1008; right: mask-to-box at 672. Dashed boxes: ground truth; solid boxes: predictions; colors: object IDs; p: presence probability. Low-confidence predictions remain visible.Teal: box tracker; orange: mask-to-box. Dips show when overlap degrades; gaps indicate no visible ground-truth object.
5 · sav_001877
Duration
Initial objects
Box IoU
Mask-to-box IoU
10.3 s
3
15.3%
22.3%
Full evaluation cohort. Left: box tracker at 1008; right: mask-to-box at 672. Dashed boxes: ground truth; solid boxes: predictions; colors: object IDs; p: presence probability. Low-confidence predictions remain visible.Teal: box tracker; orange: mask-to-box. Dips show when overlap degrades; gaps indicate no visible ground-truth object.
6 · sav_001964
Duration
Initial objects
Box IoU
Mask-to-box IoU
8.7 s
1
70.2%
79.2%
Full evaluation cohort. Left: box tracker at 1008; right: mask-to-box at 672. Dashed boxes: ground truth; solid boxes: predictions; colors: object IDs; p: presence probability. Low-confidence predictions remain visible.Teal: box tracker; orange: mask-to-box. Dips show when overlap degrades; gaps indicate no visible ground-truth object.
7 · sav_002534
Duration
Initial objects
Box IoU
Mask-to-box IoU
15.5 s
3
41.7%
50.2%
Full evaluation cohort. Left: box tracker at 1008; right: mask-to-box at 672. Dashed boxes: ground truth; solid boxes: predictions; colors: object IDs; p: presence probability. Low-confidence predictions remain visible.Teal: box tracker; orange: mask-to-box. Dips show when overlap degrades; gaps indicate no visible ground-truth object.
8 · sav_003501
Duration
Initial objects
Box IoU
Mask-to-box IoU
15.7 s
1
94.6%
99.0%
Full evaluation cohort. Left: box tracker at 1008; right: mask-to-box at 672. Dashed boxes: ground truth; solid boxes: predictions; colors: object IDs; p: presence probability. Low-confidence predictions remain visible.Teal: box tracker; orange: mask-to-box. Dips show when overlap degrades; gaps indicate no visible ground-truth object.
9 · sav_004164
Duration
Initial objects
Box IoU
Mask-to-box IoU
10.2 s
3
60.4%
84.3%
Full evaluation cohort. Left: box tracker at 1008; right: mask-to-box at 672. Dashed boxes: ground truth; solid boxes: predictions; colors: object IDs; p: presence probability. Low-confidence predictions remain visible.Teal: box tracker; orange: mask-to-box. Dips show when overlap degrades; gaps indicate no visible ground-truth object.
10 · sav_004380
Duration
Initial objects
Box IoU
Mask-to-box IoU
38.3 s
1
24.1%
25.6%
Full evaluation cohort. Left: box tracker at 1008; right: mask-to-box at 672. Dashed boxes: ground truth; solid boxes: predictions; colors: object IDs; p: presence probability. Low-confidence predictions remain visible.Teal: box tracker; orange: mask-to-box. Dips show when overlap degrades; gaps indicate no visible ground-truth object.
11 · sav_004844
Duration
Initial objects
Box IoU
Mask-to-box IoU
13.8 s
2
27.8%
52.6%
Full evaluation cohort. Left: box tracker at 1008; right: mask-to-box at 672. Dashed boxes: ground truth; solid boxes: predictions; colors: object IDs; p: presence probability. Low-confidence predictions remain visible.Teal: box tracker; orange: mask-to-box. Dips show when overlap degrades; gaps indicate no visible ground-truth object.
12 · sav_004873
Duration
Initial objects
Box IoU
Mask-to-box IoU
12.3 s
1
39.8%
39.9%
Full evaluation cohort. Left: box tracker at 1008; right: mask-to-box at 672. Dashed boxes: ground truth; solid boxes: predictions; colors: object IDs; p: presence probability. Low-confidence predictions remain visible.Teal: box tracker; orange: mask-to-box. Dips show when overlap degrades; gaps indicate no visible ground-truth object.
13 · sav_005270
Duration
Initial objects
Box IoU
Mask-to-box IoU
20.7 s
3
66.6%
59.2%
Full evaluation cohort. Left: box tracker at 1008; right: mask-to-box at 672. Dashed boxes: ground truth; solid boxes: predictions; colors: object IDs; p: presence probability. Low-confidence predictions remain visible.Teal: box tracker; orange: mask-to-box. Dips show when overlap degrades; gaps indicate no visible ground-truth object.
14 · sav_005574
Duration
Initial objects
Box IoU
Mask-to-box IoU
10.7 s
1
57.1%
95.3%
Full evaluation cohort. Left: box tracker at 1008; right: mask-to-box at 672. Dashed boxes: ground truth; solid boxes: predictions; colors: object IDs; p: presence probability. Low-confidence predictions remain visible.Teal: box tracker; orange: mask-to-box. Dips show when overlap degrades; gaps indicate no visible ground-truth object.
15 · sav_005961
Duration
Initial objects
Box IoU
Mask-to-box IoU
14.2 s
4
74.8%
89.4%
Full evaluation cohort. Left: box tracker at 1008; right: mask-to-box at 672. Dashed boxes: ground truth; solid boxes: predictions; colors: object IDs; p: presence probability. Low-confidence predictions remain visible.Teal: box tracker; orange: mask-to-box. Dips show when overlap degrades; gaps indicate no visible ground-truth object.
16 · sav_006114
Duration
Initial objects
Box IoU
Mask-to-box IoU
15.5 s
2
86.4%
89.9%
Full evaluation cohort. Left: box tracker at 1008; right: mask-to-box at 672. Dashed boxes: ground truth; solid boxes: predictions; colors: object IDs; p: presence probability. Low-confidence predictions remain visible.Teal: box tracker; orange: mask-to-box. Dips show when overlap degrades; gaps indicate no visible ground-truth object.
17 · sav_006251
Duration
Initial objects
Box IoU
Mask-to-box IoU
19.3 s
1
95.8%
98.8%
Full evaluation cohort. Left: box tracker at 1008; right: mask-to-box at 672. Dashed boxes: ground truth; solid boxes: predictions; colors: object IDs; p: presence probability. Low-confidence predictions remain visible.Teal: box tracker; orange: mask-to-box. Dips show when overlap degrades; gaps indicate no visible ground-truth object.
18 · sav_006298
Duration
Initial objects
Box IoU
Mask-to-box IoU
28.7 s
2
77.6%
85.3%
Full evaluation cohort. Left: box tracker at 1008; right: mask-to-box at 672. Dashed boxes: ground truth; solid boxes: predictions; colors: object IDs; p: presence probability. Low-confidence predictions remain visible.Teal: box tracker; orange: mask-to-box. Dips show when overlap degrades; gaps indicate no visible ground-truth object.
19 · sav_006493
Duration
Initial objects
Box IoU
Mask-to-box IoU
13.7 s
3
45.5%
40.4%
Full evaluation cohort. Left: box tracker at 1008; right: mask-to-box at 672. Dashed boxes: ground truth; solid boxes: predictions; colors: object IDs; p: presence probability. Low-confidence predictions remain visible.Teal: box tracker; orange: mask-to-box. Dips show when overlap degrades; gaps indicate no visible ground-truth object.
20 · sav_006751
Duration
Initial objects
Box IoU
Mask-to-box IoU
13.2 s
5
76.2%
79.4%
Full evaluation cohort. Left: box tracker at 1008; right: mask-to-box at 672. Dashed boxes: ground truth; solid boxes: predictions; colors: object IDs; p: presence probability. Low-confidence predictions remain visible.Teal: box tracker; orange: mask-to-box. Dips show when overlap degrades; gaps indicate no visible ground-truth object.
21 · sav_006941
Duration
Initial objects
Box IoU
Mask-to-box IoU
17.2 s
2
42.8%
47.7%
Full evaluation cohort. Left: box tracker at 1008; right: mask-to-box at 672. Dashed boxes: ground truth; solid boxes: predictions; colors: object IDs; p: presence probability. Low-confidence predictions remain visible.Teal: box tracker; orange: mask-to-box. Dips show when overlap degrades; gaps indicate no visible ground-truth object.
22 · sav_009079
Duration
Initial objects
Box IoU
Mask-to-box IoU
7.7 s
2
4.1%
51.6%
Full evaluation cohort. Left: box tracker at 1008; right: mask-to-box at 672. Dashed boxes: ground truth; solid boxes: predictions; colors: object IDs; p: presence probability. Low-confidence predictions remain visible.Teal: box tracker; orange: mask-to-box. Dips show when overlap degrades; gaps indicate no visible ground-truth object.
23 · sav_009503
Duration
Initial objects
Box IoU
Mask-to-box IoU
28.2 s
1
55.5%
77.1%
Full evaluation cohort. Left: box tracker at 1008; right: mask-to-box at 672. Dashed boxes: ground truth; solid boxes: predictions; colors: object IDs; p: presence probability. Low-confidence predictions remain visible.Teal: box tracker; orange: mask-to-box. Dips show when overlap degrades; gaps indicate no visible ground-truth object.
24 · sav_009628
Duration
Initial objects
Box IoU
Mask-to-box IoU
14.2 s
1
29.5%
36.9%
Full evaluation cohort. Left: box tracker at 1008; right: mask-to-box at 672. Dashed boxes: ground truth; solid boxes: predictions; colors: object IDs; p: presence probability. Low-confidence predictions remain visible.Teal: box tracker; orange: mask-to-box. Dips show when overlap degrades; gaps indicate no visible ground-truth object.
25 · sav_010291
Duration
Initial objects
Box IoU
Mask-to-box IoU
29.3 s
1
71.1%
35.3%
Full evaluation cohort. Left: box tracker at 1008; right: mask-to-box at 672. Dashed boxes: ground truth; solid boxes: predictions; colors: object IDs; p: presence probability. Low-confidence predictions remain visible.Teal: box tracker; orange: mask-to-box. Dips show when overlap degrades; gaps indicate no visible ground-truth object.
26 · sav_010406
Duration
Initial objects
Box IoU
Mask-to-box IoU
12.8 s
1
31.1%
27.5%
Full evaluation cohort. Left: box tracker at 1008; right: mask-to-box at 672. Dashed boxes: ground truth; solid boxes: predictions; colors: object IDs; p: presence probability. Low-confidence predictions remain visible.Teal: box tracker; orange: mask-to-box. Dips show when overlap degrades; gaps indicate no visible ground-truth object.
27 · sav_010810
Duration
Initial objects
Box IoU
Mask-to-box IoU
17.3 s
2
54.1%
61.5%
Full evaluation cohort. Left: box tracker at 1008; right: mask-to-box at 672. Dashed boxes: ground truth; solid boxes: predictions; colors: object IDs; p: presence probability. Low-confidence predictions remain visible.Teal: box tracker; orange: mask-to-box. Dips show when overlap degrades; gaps indicate no visible ground-truth object.
28 · sav_010922
Duration
Initial objects
Box IoU
Mask-to-box IoU
11.2 s
1
59.7%
45.0%
Full evaluation cohort. Left: box tracker at 1008; right: mask-to-box at 672. Dashed boxes: ground truth; solid boxes: predictions; colors: object IDs; p: presence probability. Low-confidence predictions remain visible.Teal: box tracker; orange: mask-to-box. Dips show when overlap degrades; gaps indicate no visible ground-truth object.
29 · sav_011301
Duration
Initial objects
Box IoU
Mask-to-box IoU
32.0 s
2
45.5%
57.0%
Full evaluation cohort. Left: box tracker at 1008; right: mask-to-box at 672. Dashed boxes: ground truth; solid boxes: predictions; colors: object IDs; p: presence probability. Low-confidence predictions remain visible.Teal: box tracker; orange: mask-to-box. Dips show when overlap degrades; gaps indicate no visible ground-truth object.
30 · sav_011413
Duration
Initial objects
Box IoU
Mask-to-box IoU
14.3 s
1
43.5%
75.7%
Full evaluation cohort. Left: box tracker at 1008; right: mask-to-box at 672. Dashed boxes: ground truth; solid boxes: predictions; colors: object IDs; p: presence probability. Low-confidence predictions remain visible.Teal: box tracker; orange: mask-to-box. Dips show when overlap degrades; gaps indicate no visible ground-truth object.
31 · sav_011732
Duration
Initial objects
Box IoU
Mask-to-box IoU
22.5 s
2
53.2%
57.8%
Full evaluation cohort. Left: box tracker at 1008; right: mask-to-box at 672. Dashed boxes: ground truth; solid boxes: predictions; colors: object IDs; p: presence probability. Low-confidence predictions remain visible.Teal: box tracker; orange: mask-to-box. Dips show when overlap degrades; gaps indicate no visible ground-truth object.
32 · sav_011944
Duration
Initial objects
Box IoU
Mask-to-box IoU
19.2 s
1
84.4%
68.3%
Full evaluation cohort. Left: box tracker at 1008; right: mask-to-box at 672. Dashed boxes: ground truth; solid boxes: predictions; colors: object IDs; p: presence probability. Low-confidence predictions remain visible.Teal: box tracker; orange: mask-to-box. Dips show when overlap degrades; gaps indicate no visible ground-truth object.
Interpretation and open questions
All 32 videos from this completed evaluation are included below in video-ID order. This cohort is a subset of SA-V validation, not the entire validation split.
Both trackers struggle on the longest clip; the student also fails on a short clip. Duration alone does not explain the failures.
Minute-scale tracking, recovery after prolonged occlusion, and transfer to other datasets remain open questions.
A same-resolution mask-to-box baseline and broader validation are needed before attributing the remaining gap to the box head or memory design.