← Back to project

Articraft · gpt-5.6-sol vs gpt-5.6-luna

Cost, retries, and geometry across four object categories · 2026-08-11

articulated-3d model-comparison cost-eval

1 · Setup

Articraft is an agentic system that writes Python code against a CAD-like SDK to build articulated 3D objects from a text prompt, compiles and validates the result, and exports a posable USDZ. It is the supported successor to the original mattzh72/articraft harness. Its default OpenAI model slug gpt-5.6 resolves internally to gpt-5.6-sol, the flagship tier; gpt-5.6-luna is the cheapest tier in the same family.

Articraft ships with no bundled dataset — each run writes only to its own local runs/ folder, with no retrieval or reference corpus. The only existing corpus of generated objects is a separate repository, Articraft-10K (CC BY 4.0): 10,788 records across 246 categories, entirely self-generated by running the original harness many times — not sourced from an external 3D asset dataset.

Four prompts, one per category, were each run once on gpt-5.6-sol and once on gpt-5.6-luna through an internal OpenAI-compatible gateway (default reasoning effort). All 8 runs are shown below as live, interactive viewers — drag a joint slider to move it through its articulated range.

2 · Cost and reliability

Luna succeeded on all 4 categories, at roughly 1/18 to 1/40 the cost of sol, needing on average about 2x the retries to converge.
CategoryModelAttemptsCostSol / luna
Furniture · folding step stoolgpt-5.6-sol3$2.8223.8x
gpt-5.6-luna6$0.12
Tool · needle-nose pliersgpt-5.6-sol2$2.7039.6x
gpt-5.6-luna5$0.07
Robotics · 2-joint arm + grippergpt-5.6-sol2$1.9224.5x
gpt-5.6-luna2$0.08
Electronics · laptop clamshellgpt-5.6-sol2$2.8318.3x
gpt-5.6-luna5$0.15
Total (4 categories)24.5x avg

Sol total $10.27 · luna total $0.42 · robotics is the only category where sol and luna took the same number of attempts.

3 · Live comparison

Each panel is a live three.js viewer (client-side USDZ parsing) — drag a joint slider on the right of each panel.

Furniture · “a small step stool that folds flat, with two hinged legs and a fold-down step held open by a friction hinge”
gpt-5.6-sol3 attempts · $2.82.usdz
gpt-5.6-luna6 attempts · $0.12.usdz
Tool · “a pair of needle-nose pliers with a spring-loaded jaw and a wire-cutter notch near the pivot”
gpt-5.6-sol2 attempts · $2.70.usdz
gpt-5.6-luna5 attempts · $0.07.usdz
Robotics · “a simple two-joint robotic arm with a revolute shoulder and elbow, ending in a two-finger parallel gripper”
gpt-5.6-sol2 attempts · $1.92.usdz
gpt-5.6-luna2 attempts · $0.08.usdz
Electronics · “a laptop-style clamshell with a hinged screen that opens from closed to 135°, with a keyboard deck below”
gpt-5.6-sol2 attempts · $2.83.usdz
gpt-5.6-luna5 attempts · $0.15.usdz

4 · Image → articulated asset

The same pipeline also reconstructs from a reference photo: the agent views the image with its view_image tool, infers the object's shape and how it should articulate, then writes the CAD code. All four below succeeded end-to-end on gpt-5.6-sol. Left: input photo · right: live viewer — drag a joint slider to pose it.

Scissors · input photo → revolute central pivot
input photoreference
gpt-5.6-sol1 joint · 3 attempts · $3.00.usdz
Needle-nose pliers · input photo → revolute pivot
input photoreference
gpt-5.6-sol1 joint · 1 attempt · $1.49.usdz
Folding chair · cluttered store photo → two fold hinges
input photoreference
gpt-5.6-sol2 hinges · 2 attempts · $2.13.usdz
Anglepoise desk lamp · input photo → three revolute joints
input photoreference
gpt-5.6-sol3 joints · 3 attempts · $3.07.usdz

5 · Takeaways