← Back to project

3D Data · VLM Quality+Complexity Judge (ready_v4)

Qwen3.6-27B judged 1.04M PBR assets across 7 subsets · 4-view×1024px · 2026-07-06
data-filteringvlm-judgeready_v4ablation

TL;DR

1,039,752 PBR-present assets scored by a vision-LM judge (99.995% parse). recommended = yes: 440,229 (42.3%) — lands remarkably close to the ~500k ablation target with zero manual thresholding.
Each asset gets 6 independent 1-10 axes — 3 quality (structural / texture / aesthetic) + 3 complexity (part / detail / color) — plus style, validity, and hard-exclude issue flags. Complexity is scored separately from quality, so "well-made but simple" and "cluttered but sloppy" are distinguishable.
Confirmed at scale: "has-PBR" is a weak signal — 307k assets flagged untextured and 374k single_color despite all having PBR latents. The VLM catches material rot the PBR-file check cannot.

1 · Verdict distribution

① yes ≈ 440k lands near the 500k target — use yes directly, or top-up from no by score to reach 500-550k.

2 · Interactive sample gallery — YES vs NO (drag to spin)

Drag any thumbnail left/right to spin the object — each card cycles the 16 rendered viewpoints the VLM saw (a pseudo-3D turntable). The two groups are the model's actual verdict: kept vs excluded. Score bars: blue = quality, purple = complexity.

recommended = YES  ·  kept for the high-quality set

clean geometry + real materials, across styles & complexity

recommended = NO  ·  excluded

untextured / single-color / low-poly / scan — note several have decent geometry (str≥6) but dead materials (tex≤2)

3 · Six scoring axes

② Six axes. Texture (μ=3.9) is the main quality bottleneck; complexity axes spread widely — the pool spans trivial primitives to dense assemblies.

4 · Style mix (ablation control)

③ Style distribution — a free axis for controlling training-data composition.

5 · Issue flags (hard exclude)

④ Issue flags — an independent veto axis; the top-4 are all material/geometry poverty signals.

6 · How to reach the ablation set

VLM judge: Qwen3.6-27B (thinking off) · 4-view 1024px · temperature 0 · scored 1,039,752 / 1,108,309 PBR-present manifest entries (rest = missing renders). Scores at /fsx/home/weikai.huang/hyperpod/weikaih_cap/judge_scores.jsonl