{
 "meta": {
  "finished_at": "2026-10-15T07:51:53+0900",
  "trials": 5,
  "plan": {
   "order": [
    "angelo-1",
    "angelo-2",
    "angelo-3",
    "angelo-4",
    "angelo-5"
   ],
   "runtime": "claude",
   "model": "claude-opus-5-5",
   "effort": "low",
   "fast": false,
   "task_set": "default",
   "gate_version": 2,
   "input_isolation": "on",
   "after_failure": "reset",
   "refusal_fallback": "disabled",
   "rate_limits": "a provider rate or usage limit makes its trial invalid (never a task failure) and stops the run; invalid trials are left out of every pass rate and counted",
   "angelo": {
    "observation": "turn-context",
    "trusted_scripts": false,
    "approval": "default",
    "always_allow_scripts": false,
    "context_rebase_tokens": 0,
    "cache_ttl": "product default",
    "stable_workspace": true,
    "returning_user": false,
    "opening_wait_s": 0
   },
   "mcp_tasks": [
    "read_only_question",
    "cube_creation",
    "transform",
    "bevel_and_shade",
    "material"
   ],
   "angelo_tasks": [
    "read_only_question",
    "cube_creation",
    "transform",
    "bevel_and_shade",
    "material",
    "preview_accept"
   ],
   "billed_prompts": {
    "mcp": 0,
    "angelo": 30
   },
   "billing": "Each prompt is one billed message on the selected Claude account; a message can contain several model calls. Failed tasks are recorded, never retried."
  },
  "method": [
   "Same Claude account on both sides: the Angelo connection's native Claude Code profile (CLAUDE_CONFIG_DIR).",
   "Same pinned model, --effort low and Fast off on both sides; the model each side actually used is read back from Claude Code's own output (MCP: init/result; Angelo: its session transcript).",
   "Same five prompts from eval_live_tasks.build_tasks(), one continuing chat per trial, factory default-cube scene.",
   "MCP side: stock Blender with a private copy of Blender Lab's MCP add-on (default 0.25 s active / 1 s idle socket polling), Blender Lab's installed MCP server, headless Claude Code with its default system prompt and built-in tools; --allowedTools mcp__blender (all of that server's tools), --permission-prompts none (any other prompt is denied and reported), --strict-mcp-config, --no-session-persistence.",
   "Angelo side: the unchanged live-eval harness (approvals on Ask; its test-only rule approves typed bounded scene tools and declines reviewed Python, file writes and the rest).",
   "Wall time = prompt sent -> final result (MCP: Claude Code's result line; Angelo: the request receipt's total_ms). The first prompt of each trial includes the runtime launch on both sides: by default Angelo readies nothing before it (ANGELO_EVAL_OPENING_WAIT 0; each trial's report records its opening).",
   "Before every MCP prompt the driver waits 6 s after its own last add-on request, so the add-on is on its default idle polling, as after a human pause; Angelo sends its next prompt immediately (it does not poll).",
   "Correctness: after each turn the driver (not the model) grades the scene with the Angelo harness's own predicates (verify() + eval_live_tasks checks + the session's scene_digest/bind_checks/smooth_shaded); MCP grading runs over the add-on socket. Failed checks count as failures; their time is still reported.",
   "Both sides start from a minimal environment (PATH, HOME, USER, locale; DISABLE_AUTOUPDATER=1) so no inherited ANTHROPIC_*/CLAUDE_CODE_* routing or session variable reaches either runtime.",
   "Trials alternate MCP, Angelo, MCP, Angelo...; each trial is a fresh process pair, scene and session; nothing is retried.",
   "Questions (gate set version 2; a side whose trials are reused from a version-1 run is named above and was not graded this way): each question keeps its wording and ends with one sentence that asks for an answer line. The driver, never the model, computes the truth from the scene before it sends the prompt and reads the turn's answer line against it (eval_answers); a question passes only on the right answer with the scene unchanged. So that neither answer can be given without reading the scene, the driver adds one small mesh before the opening question and moves the cube by a fixed offset before each later one, and undoes both after grading. An answer read with a liberty (units among the numbers, a count before the names) is counted as parsed leniently."
  ],
  "threats": [
   "Safety asymmetry: the MCP side executes model-written raw Python in the live scene with no staging, verification gate, approval or single-step Undo; Angelo stages typed operations, verifies and commits one Undo step. Equal latency would not mean equal risk, and Angelo's checks cost time the MCP side does not spend.",
   "Prompt wording: the prompts were written for Angelo's harness (explicit names, exact numbers). Other phrasings, vaguer requests or larger scenes may favour either side; five short tasks are not a general workload.",
   "Small sample: n = 5 trials per side and task; medians and p75 are reported with min/max, but differences of a few seconds are within run-to-run spread. No significance test is claimed.",
   "Network and service variance: both sides call the same hosted model over the internet; queueing, retries and time-of-day load move wall times. Alternation spreads drift across sides but does not remove it.",
   "Shared machine: other agents' builds/tests ran concurrently; load averages are recorded per trial.",
   "Context asymmetry by design: Angelo attaches a bounded scene observation to each prompt; the MCP side must call tools to see the scene. Angelo's Claude Code runs with a restricted tool set and structured output, the MCP side with Claude Code's full default tool set and system prompt. This is each product as shipped.",
   "Stock Blender 5.2.0 (MCP) vs the Angelo 5.2.2 build: different binaries; Blender-side execution is milliseconds on both, so this does not drive end-to-end time, but window focus behaviour differs (stock Blender may come to the front).",
   "The 6 s settle and the add-on's 1 s idle polling are the MCP add-on's defaults; a user who lowers the idle interval would see somewhat faster MCP tool round trips.",
   "Cost figures are Claude Code's own estimates, not a bill; this is a subscription account.",
   "Prompt cache: the MCP side reuses one empty working directory, so after its first trial its system prompt is served from the prompt cache. Each Angelo trial has a new workspace path (Claude's working directory) unless the run used --angelo-stable-workspace (see plan.angelo); see the first-message cache writes under Observations. Without it this mainly lowers the MCP cost estimate.",
   "Round-count variance: Angelo's number of model rounds depends on the model's own verify choice per plan, and Claude Code defers MCP tools behind ToolSearch on first use; both are counted as they happened, and n = 5 may under-sample how often each occurs.",
   "Wall-clock boundaries differ slightly: the MCP clock ends when the driver reads Claude Code's result line; Angelo's receipt total_ms ends inside the controller (the harness's send-to-idle time is also recorded)."
  ],
  "versions": {
   "runtime": "claude",
   "claude_code": "2.1.293 (Claude Code)",
   "codex": null,
   "codex_account": null,
   "models_reported": {
    "mcp": [],
    "angelo": [
     "claude-opus-5-5"
    ]
   },
   "requested_model": "claude-opus-5-5",
   "effort": "low",
   "fast_mode": false,
   "mcp_init_model": [],
   "mcp_server": {
    "extension_manifest_version": "1.0.1",
    "path": "<local profile>"
   },
   "mcp_addon": null,
   "stock_blender": null,
   "angelo_binary": [
    "Blender 5.2.2 LTS",
    "build date: 2026-10-14",
    "build hash: 3092c5ccba45",
    "build branch: angelo-v1.0-release",
    "build type: Release"
   ],
   "angelo_checkout_commit": "3092c5ccba457d380943ce52221596b3f19434c7",
   "angelo_checkout_branch": "",
   "angelo_checkout_dirty_files": 0,
   "angelo_python_source": "the add-on and harness Python load from this checkout (<local path>)",
   "machine": {
    "platform": "macOS-26.3-arm64-arm-64bit-Mach-O",
    "cpu": "Apple M4 Pro",
    "cores": 14,
    "memory_bytes": "51539607552"
   }
  },
  "trial_meta": [
   {
    "side": "angelo",
    "trial": 1,
    "harness_command": [
     "/Applications/Blender.app/Contents/Resources/5.2/python/bin/python3.13",
     "<local path>",
     "--authorize-billed-runs",
     "--connection-id",
     "<id>",
     "--source-connections-dir",
     "<local profile>",
     "--blender",
     "<local path>",
     "--effort",
     "low",
     "--model",
     "claude-opus-5-5",
     "--trials",
     "1",
     "--task-timeout",
     "300",
     "--output",
     "<campaign>/gate-opus-default/angelo-trial-01",
     "--task-set",
     "default",
     "--long-tasks",
     "40",
     "--observation",
     "turn-context",
     "--context-rebase-tokens",
     "0",
     "--input-isolation",
     "on",
     "--after-failure",
     "reset",
     "--stable-state-dir",
     "<campaign>/gate-opus-default/angelo-state"
    ],
    "load_average_start": [
     1.58740234375,
     2.39208984375,
     5.39892578125
    ],
    "started_at": "2026-10-15T07:49:32+0900",
    "exit_code": 0,
    "elapsed_s": 24.568,
    "load_average_end": [
     1.830078125,
     2.3896484375,
     5.310546875
    ],
    "version": "5.2.2 LTS",
    "binary": "<local path>",
    "aborted": null,
    "success": true,
    "invalid": null,
    "scenario": null
   },
   {
    "side": "angelo",
    "trial": 2,
    "harness_command": [
     "/Applications/Blender.app/Contents/Resources/5.2/python/bin/python3.13",
     "<local path>",
     "--authorize-billed-runs",
     "--connection-id",
     "<id>",
     "--source-connections-dir",
     "<local profile>",
     "--blender",
     "<local path>",
     "--effort",
     "low",
     "--model",
     "claude-opus-5-5",
     "--trials",
     "1",
     "--task-timeout",
     "300",
     "--output",
     "<campaign>/gate-opus-default/angelo-trial-02",
     "--task-set",
     "default",
     "--long-tasks",
     "40",
     "--observation",
     "turn-context",
     "--context-rebase-tokens",
     "0",
     "--input-isolation",
     "on",
     "--after-failure",
     "reset",
     "--stable-state-dir",
     "<campaign>/gate-opus-default/angelo-state"
    ],
    "load_average_start": [
     1.830078125,
     2.3896484375,
     5.310546875
    ],
    "started_at": "2026-10-15T07:49:57+0900",
    "exit_code": 0,
    "elapsed_s": 34.213,
    "load_average_end": [
     1.6640625,
     2.294921875,
     5.15771484375
    ],
    "version": "5.2.2 LTS",
    "binary": "<local path>",
    "aborted": null,
    "success": true,
    "invalid": null,
    "scenario": null
   },
   {
    "side": "angelo",
    "trial": 3,
    "harness_command": [
     "/Applications/Blender.app/Contents/Resources/5.2/python/bin/python3.13",
     "<local path>",
     "--authorize-billed-runs",
     "--connection-id",
     "<id>",
     "--source-connections-dir",
     "<local profile>",
     "--blender",
     "<local path>",
     "--effort",
     "low",
     "--model",
     "claude-opus-5-5",
     "--trials",
     "1",
     "--task-timeout",
     "300",
     "--output",
     "<campaign>/gate-opus-default/angelo-trial-03",
     "--task-set",
     "default",
     "--long-tasks",
     "40",
     "--observation",
     "turn-context",
     "--context-rebase-tokens",
     "0",
     "--input-isolation",
     "on",
     "--after-failure",
     "reset",
     "--stable-state-dir",
     "<campaign>/gate-opus-default/angelo-state"
    ],
    "load_average_start": [
     1.6640625,
     2.294921875,
     5.15771484375
    ],
    "started_at": "2026-10-15T07:50:31+0900",
    "exit_code": 0,
    "elapsed_s": 25.779,
    "load_average_end": [
     1.63916015625,
     2.23779296875,
     5.0537109375
    ],
    "version": "5.2.2 LTS",
    "binary": "<local path>",
    "aborted": null,
    "success": true,
    "invalid": null,
    "scenario": null
   },
   {
    "side": "angelo",
    "trial": 4,
    "harness_command": [
     "/Applications/Blender.app/Contents/Resources/5.2/python/bin/python3.13",
     "<local path>",
     "--authorize-billed-runs",
     "--connection-id",
     "<id>",
     "--source-connections-dir",
     "<local profile>",
     "--blender",
     "<local path>",
     "--effort",
     "low",
     "--model",
     "claude-opus-5-5",
     "--trials",
     "1",
     "--task-timeout",
     "300",
     "--output",
     "<campaign>/gate-opus-default/angelo-trial-04",
     "--task-set",
     "default",
     "--long-tasks",
     "40",
     "--observation",
     "turn-context",
     "--context-rebase-tokens",
     "0",
     "--input-isolation",
     "on",
     "--after-failure",
     "reset",
     "--stable-state-dir",
     "<campaign>/gate-opus-default/angelo-state"
    ],
    "load_average_start": [
     1.587890625,
     2.216796875,
     5.02978515625
    ],
    "started_at": "2026-10-15T07:50:58+0900",
    "exit_code": 0,
    "elapsed_s": 25.091,
    "load_average_end": [
     1.5185546875,
     2.14990234375,
     4.92333984375
    ],
    "version": "5.2.2 LTS",
    "binary": "<local path>",
    "aborted": null,
    "success": true,
    "invalid": null,
    "scenario": null
   },
   {
    "side": "angelo",
    "trial": 5,
    "harness_command": [
     "/Applications/Blender.app/Contents/Resources/5.2/python/bin/python3.13",
     "<local path>",
     "--authorize-billed-runs",
     "--connection-id",
     "<id>",
     "--source-connections-dir",
     "<local profile>",
     "--blender",
     "<local path>",
     "--effort",
     "low",
     "--model",
     "claude-opus-5-5",
     "--trials",
     "1",
     "--task-timeout",
     "300",
     "--output",
     "<campaign>/gate-opus-default/angelo-trial-05",
     "--task-set",
     "default",
     "--long-tasks",
     "40",
     "--observation",
     "turn-context",
     "--context-rebase-tokens",
     "0",
     "--input-isolation",
     "on",
     "--after-failure",
     "reset",
     "--stable-state-dir",
     "<campaign>/gate-opus-default/angelo-state"
    ],
    "load_average_start": [
     1.5185546875,
     2.14990234375,
     4.92333984375
    ],
    "started_at": "2026-10-15T07:51:23+0900",
    "exit_code": 0,
    "elapsed_s": 29.47,
    "load_average_end": [
     1.86474609375,
     2.1796875,
     4.837890625
    ],
    "version": "5.2.2 LTS",
    "binary": "<local path>",
    "aborted": null,
    "success": true,
    "invalid": null,
    "scenario": null
   }
  ],
  "stopped_sides": [],
  "rate_limited": null,
  "load_averages": [
   {
    "side": "angelo",
    "trial": 1,
    "start": [
     1.58740234375,
     2.39208984375,
     5.39892578125
    ],
    "end": [
     1.830078125,
     2.3896484375,
     5.310546875
    ]
   },
   {
    "side": "angelo",
    "trial": 2,
    "start": [
     1.830078125,
     2.3896484375,
     5.310546875
    ],
    "end": [
     1.6640625,
     2.294921875,
     5.15771484375
    ]
   },
   {
    "side": "angelo",
    "trial": 3,
    "start": [
     1.6640625,
     2.294921875,
     5.15771484375
    ],
    "end": [
     1.63916015625,
     2.23779296875,
     5.0537109375
    ]
   },
   {
    "side": "angelo",
    "trial": 4,
    "start": [
     1.587890625,
     2.216796875,
     5.02978515625
    ],
    "end": [
     1.5185546875,
     2.14990234375,
     4.92333984375
    ]
   },
   {
    "side": "angelo",
    "trial": 5,
    "start": [
     1.5185546875,
     2.14990234375,
     4.92333984375
    ],
    "end": [
     1.86474609375,
     2.1796875,
     4.837890625
    ]
   }
  ]
 },
 "summary": {
  "tasks": {
   "read_only_question": {
    "angelo": {
     "runs": 5,
     "skipped": 0,
     "passed": 5,
     "completed": 5,
     "pass_rate": 1,
     "graded": {
      "passed": 5,
      "failed": 0,
      "ungraded": 0,
      "skipped": 0,
      "total": 5
     },
     "answer_unchecked": false,
     "wall_ms": {
      "n": 5,
      "median": 3396.892,
      "p75": 4478.889,
      "min": 3059.084,
      "max": 5140.288
     },
     "wall_ms_passed_only": {
      "n": 5,
      "median": 3396.892,
      "p75": 4478.889,
      "min": 3059.084,
      "max": 5140.288
     },
     "first_text_ms": {
      "n": 5,
      "median": 3040.775,
      "p75": 3425.623,
      "min": 2344.545,
      "max": 4627.796
     },
     "first_feedback_ms": {
      "n": 5,
      "median": 3040.775,
      "p75": 3425.623,
      "min": 2344.545,
      "max": 4627.796
     },
     "input_tokens_per_call": {
      "n": 5,
      "median": 36269,
      "p75": 36269,
      "min": 36265,
      "max": 36270
     },
     "api_calls": {
      "n": 5,
      "median": 1,
      "p75": 1,
      "min": 1,
      "max": 1
     },
     "tool_calls": {
      "n": 5,
      "median": 0,
      "p75": 0,
      "min": 0,
      "max": 0
     },
     "input_tokens": {
      "n": 5,
      "median": 36269,
      "p75": 36269,
      "min": 36265,
      "max": 36270
     },
     "cached_input_tokens": {
      "n": 5,
      "median": 34543,
      "p75": 34543,
      "min": 0,
      "max": 34543
     },
     "cache_write_input_tokens": {
      "n": 5,
      "median": 1724,
      "p75": 1725,
      "min": 1720,
      "max": 36267
     },
     "output_tokens": {
      "n": 5,
      "median": 114,
      "p75": 122,
      "min": 112,
      "max": 122
     },
     "api_ms": {
      "n": 5,
      "median": 2386,
      "p75": 3442,
      "min": 2060,
      "max": 4143
     },
     "cost_usd": {
      "n": 5,
      "median": 0.023,
      "p75": 0.023,
      "min": 0.023,
      "max": 0.293
     }
    }
   },
   "cube_creation": {
    "angelo": {
     "runs": 5,
     "skipped": 0,
     "passed": 5,
     "completed": 5,
     "pass_rate": 1,
     "graded": {
      "passed": 5,
      "failed": 0,
      "ungraded": 0,
      "skipped": 0,
      "total": 5
     },
     "answer_unchecked": false,
     "wall_ms": {
      "n": 5,
      "median": 3415.084,
      "p75": 4018.312,
      "min": 2867.217,
      "max": 7676.031
     },
     "wall_ms_passed_only": {
      "n": 5,
      "median": 3415.084,
      "p75": 4018.312,
      "min": 2867.217,
      "max": 7676.031
     },
     "first_text_ms": {
      "n": 0
     },
     "first_feedback_ms": {
      "n": 0
     },
     "input_tokens_per_call": {
      "n": 5,
      "median": 36679,
      "p75": 36684,
      "min": 36675,
      "max": 36851.5
     },
     "api_calls": {
      "n": 5,
      "median": 1,
      "p75": 1,
      "min": 1,
      "max": 2
     },
     "tool_calls": {
      "n": 5,
      "median": 1,
      "p75": 1,
      "min": 1,
      "max": 2
     },
     "input_tokens": {
      "n": 5,
      "median": 36679,
      "p75": 36684,
      "min": 36675,
      "max": 73703
     },
     "cached_input_tokens": {
      "n": 5,
      "median": 36267,
      "p75": 36267,
      "min": 36263,
      "max": 72945
     },
     "cache_write_input_tokens": {
      "n": 5,
      "median": 414,
      "p75": 415,
      "min": 406,
      "max": 754
     },
     "output_tokens": {
      "n": 5,
      "median": 207,
      "p75": 208,
      "min": 149,
      "max": 391
     },
     "api_ms": {
      "n": 5,
      "median": 2240,
      "p75": 2854,
      "min": 1702,
      "max": 6505
     },
     "cost_usd": {
      "n": 5,
      "median": 0.015,
      "p75": 0.015,
      "min": 0.013,
      "max": 0.028
     }
    }
   },
   "transform": {
    "angelo": {
     "runs": 5,
     "skipped": 0,
     "passed": 5,
     "completed": 5,
     "pass_rate": 1,
     "graded": {
      "passed": 5,
      "failed": 0,
      "ungraded": 0,
      "skipped": 0,
      "total": 5
     },
     "answer_unchecked": false,
     "wall_ms": {
      "n": 5,
      "median": 3306.062,
      "p75": 3408.225,
      "min": 2825.552,
      "max": 3746.876
     },
     "wall_ms_passed_only": {
      "n": 5,
      "median": 3306.062,
      "p75": 3408.225,
      "min": 2825.552,
      "max": 3746.876
     },
     "first_text_ms": {
      "n": 1,
      "median": 1166.511,
      "p75": 1166.511,
      "min": 1166.511,
      "max": 1166.511
     },
     "first_feedback_ms": {
      "n": 1,
      "median": 1166.511,
      "p75": 1166.511,
      "min": 1166.511,
      "max": 1166.511
     },
     "input_tokens_per_call": {
      "n": 5,
      "median": 37344,
      "p75": 37351,
      "min": 37294,
      "max": 37677
     },
     "api_calls": {
      "n": 5,
      "median": 1,
      "p75": 1,
      "min": 1,
      "max": 1
     },
     "tool_calls": {
      "n": 5,
      "median": 1,
      "p75": 1,
      "min": 1,
      "max": 1
     },
     "input_tokens": {
      "n": 5,
      "median": 37344,
      "p75": 37351,
      "min": 37294,
      "max": 37677
     },
     "cached_input_tokens": {
      "n": 5,
      "median": 36677,
      "p75": 36682,
      "min": 36673,
      "max": 37022
     },
     "cache_write_input_tokens": {
      "n": 5,
      "median": 653,
      "p75": 667,
      "min": 619,
      "max": 667
     },
     "output_tokens": {
      "n": 5,
      "median": 183,
      "p75": 209,
      "min": 174,
      "max": 220
     },
     "api_ms": {
      "n": 5,
      "median": 2248,
      "p75": 2344,
      "min": 1763,
      "max": 2686
     },
     "cost_usd": {
      "n": 5,
      "median": 0.016,
      "p75": 0.017,
      "min": 0.016,
      "max": 0.017
     }
    }
   },
   "bevel_and_shade": {
    "angelo": {
     "runs": 5,
     "skipped": 0,
     "passed": 5,
     "completed": 5,
     "pass_rate": 1,
     "graded": {
      "passed": 5,
      "failed": 0,
      "ungraded": 0,
      "skipped": 0,
      "total": 5
     },
     "answer_unchecked": false,
     "wall_ms": {
      "n": 5,
      "median": 3627.213,
      "p75": 3627.478,
      "min": 2006.801,
      "max": 4507.815
     },
     "wall_ms_passed_only": {
      "n": 5,
      "median": 3627.213,
      "p75": 3627.478,
      "min": 2006.801,
      "max": 4507.815
     },
     "first_text_ms": {
      "n": 2,
      "median": 2604.088,
      "p75": 2631.588,
      "min": 2549.087,
      "max": 2659.088
     },
     "first_feedback_ms": {
      "n": 2,
      "median": 2604.088,
      "p75": 2631.588,
      "min": 2549.087,
      "max": 2659.088
     },
     "input_tokens_per_call": {
      "n": 5,
      "median": 37851,
      "p75": 37885,
      "min": 37823,
      "max": 38175
     },
     "api_calls": {
      "n": 5,
      "median": 1,
      "p75": 1,
      "min": 1,
      "max": 1
     },
     "tool_calls": {
      "n": 5,
      "median": 1,
      "p75": 1,
      "min": 1,
      "max": 1
     },
     "input_tokens": {
      "n": 5,
      "median": 37851,
      "p75": 37885,
      "min": 37823,
      "max": 38175
     },
     "cached_input_tokens": {
      "n": 5,
      "median": 37342,
      "p75": 37349,
      "min": 37292,
      "max": 37675
     },
     "cache_write_input_tokens": {
      "n": 5,
      "median": 507,
      "p75": 534,
      "min": 497,
      "max": 542
     },
     "output_tokens": {
      "n": 5,
      "median": 324,
      "p75": 337,
      "min": 191,
      "max": 352
     },
     "api_ms": {
      "n": 5,
      "median": 3546,
      "p75": 3549,
      "min": 1927,
      "max": 4437
     },
     "cost_usd": {
      "n": 5,
      "median": 0.018,
      "p75": 0.019,
      "min": 0.016,
      "max": 0.019
     }
    }
   },
   "material": {
    "angelo": {
     "runs": 5,
     "skipped": 0,
     "passed": 5,
     "completed": 5,
     "pass_rate": 1,
     "graded": {
      "passed": 5,
      "failed": 0,
      "ungraded": 0,
      "skipped": 0,
      "total": 5
     },
     "answer_unchecked": false,
     "wall_ms": {
      "n": 5,
      "median": 2253.292,
      "p75": 2527.3,
      "min": 1939.524,
      "max": 2596.949
     },
     "wall_ms_passed_only": {
      "n": 5,
      "median": 2253.292,
      "p75": 2527.3,
      "min": 1939.524,
      "max": 2596.949
     },
     "first_text_ms": {
      "n": 0
     },
     "first_feedback_ms": {
      "n": 0
     },
     "input_tokens_per_call": {
      "n": 5,
      "median": 38597,
      "p75": 38628,
      "min": 38461,
      "max": 38925
     },
     "api_calls": {
      "n": 5,
      "median": 1,
      "p75": 1,
      "min": 1,
      "max": 1
     },
     "tool_calls": {
      "n": 5,
      "median": 1,
      "p75": 1,
      "min": 1,
      "max": 1
     },
     "input_tokens": {
      "n": 5,
      "median": 38597,
      "p75": 38628,
      "min": 38461,
      "max": 38925
     },
     "cached_input_tokens": {
      "n": 5,
      "median": 37849,
      "p75": 37883,
      "min": 37821,
      "max": 38173
     },
     "cache_write_input_tokens": {
      "n": 5,
      "median": 750,
      "p75": 761,
      "min": 617,
      "max": 777
     },
     "output_tokens": {
      "n": 5,
      "median": 167,
      "p75": 167,
      "min": 167,
      "max": 230
     },
     "api_ms": {
      "n": 5,
      "median": 2161,
      "p75": 2424,
      "min": 1847,
      "max": 2510
     },
     "cost_usd": {
      "n": 5,
      "median": 0.017,
      "p75": 0.017,
      "min": 0.016,
      "max": 0.018
     }
    }
   },
   "preview_accept": {
    "angelo": {
     "runs": 5,
     "skipped": 0,
     "passed": 5,
     "completed": 5,
     "pass_rate": 1,
     "graded": {
      "passed": 5,
      "failed": 0,
      "ungraded": 0,
      "skipped": 0,
      "total": 5
     },
     "answer_unchecked": false,
     "wall_ms": {
      "n": 5,
      "median": 2179.931,
      "p75": 2306.869,
      "min": 1587.094,
      "max": 2376.609
     },
     "wall_ms_passed_only": {
      "n": 5,
      "median": 2179.931,
      "p75": 2306.869,
      "min": 1587.094,
      "max": 2376.609
     },
     "first_text_ms": {
      "n": 0
     },
     "first_feedback_ms": {
      "n": 0
     },
     "input_tokens_per_call": {
      "n": 5,
      "median": 39273,
      "p75": 39292,
      "min": 39138,
      "max": 39600
     },
     "api_calls": {
      "n": 5,
      "median": 1,
      "p75": 1,
      "min": 1,
      "max": 1
     },
     "tool_calls": {
      "n": 5,
      "median": 1,
      "p75": 1,
      "min": 1,
      "max": 1
     },
     "input_tokens": {
      "n": 5,
      "median": 39273,
      "p75": 39292,
      "min": 39138,
      "max": 39600
     },
     "cached_input_tokens": {
      "n": 5,
      "median": 38595,
      "p75": 38626,
      "min": 38459,
      "max": 38923
     },
     "cache_write_input_tokens": {
      "n": 5,
      "median": 676,
      "p75": 676,
      "min": 664,
      "max": 677
     },
     "output_tokens": {
      "n": 5,
      "median": 130,
      "p75": 130,
      "min": 130,
      "max": 130
     },
     "api_ms": {
      "n": 5,
      "median": 2100,
      "p75": 2205,
      "min": 1484,
      "max": 2288
     },
     "cost_usd": {
      "n": 5,
      "median": 0.016,
      "p75": 0.016,
      "min": 0.016,
      "max": 0.016
     }
    }
   }
  },
  "totals": {
   "mcp": {
    "trials": 0,
    "trials_with_all_five_timed": 0,
    "trials_all_five_passed": 0,
    "wall_ms": {
     "n": 0
    },
    "api_calls": {
     "n": 0
    },
    "cost_usd": {
     "n": 0
    },
    "head_to_head_pass_rate": 0,
    "graded": {
     "passed": 0,
     "failed": 0,
     "ungraded": 0,
     "skipped": 0,
     "total": 0,
     "not_run": 0
    },
    "answers": {
     "read": 0,
     "parsed_leniently": 0
    },
    "answer_unchecked_tasks": []
   },
   "angelo": {
    "trials": 5,
    "trials_with_all_five_timed": 5,
    "trials_all_five_passed": 5,
    "wall_ms": {
     "n": 5,
     "median": 14998.77,
     "p75": 18949.718,
     "min": 14171.937,
     "max": 22598.26
    },
    "api_calls": {
     "n": 5,
     "median": 5,
     "p75": 5,
     "min": 5,
     "max": 6
    },
    "cost_usd": {
     "n": 5,
     "median": 0.091,
     "p75": 0.103,
     "min": 0.085,
     "max": 0.356
    },
    "head_to_head_pass_rate": 1,
    "graded": {
     "passed": 25,
     "failed": 0,
     "ungraded": 0,
     "skipped": 0,
     "total": 25,
     "not_run": 0
    },
    "answers": {
     "read": 5,
     "parsed_leniently": 0
    },
    "answer_unchecked_tasks": []
   }
  },
  "gate_versions": {
   "angelo": 2
  },
  "invalid_rate_limited": {}
 },
 "observations": [
  "Model API time as a share of head-to-head wall time: MCP –, Angelo 80%.",
  "Model API calls per trial (5 tasks): MCP [0, 0, 0, 0, 0]; Angelo [5, 6, 5, 5, 5].",
  "Wall s per trial (5 tasks): MCP [0.0, 0.0, 0.0, 0.0, 0.0]; Angelo [14.2, 22.6, 14.8, 15.0, 18.9].",
  "MCP add-on socket round trips per trial, s (includes its 0.25/1 s polling): [0.0, 0.0, 0.0, 0.0, 0.0].",
  "Angelo opening before the first prompt, per trial: ['none', 'none', 'none', 'none', 'none'].",
  "MCP cold start (process spawn to Claude Code init), ms: [].",
  "MCP first-message prompt-cache writes per trial (tokens): [].",
  "MCP permission denials 0, API retries 0, add-on script errors 0; Angelo declined tools 0, Python fallbacks 0."
 ],
 "tool_usage": {
  "angelo": {
   "read_only_question": {},
   "cube_creation": {
    "angelo_scene_program": 6
   },
   "transform": {
    "angelo_scene_program": 5
   },
   "bevel_and_shade": {
    "angelo_apply_recipe": 5
   },
   "material": {
    "angelo_apply_recipe": 4,
    "angelo_scene_program": 1
   },
   "preview_accept": {
    "angelo_scene_program": 5
   }
  }
 },
 "session_curve": {
  "mcp": {
   "5": {
    "cost_usd": {
     "n": 0
    },
    "api_calls": {
     "n": 0
    },
    "input_tokens_per_call": {
     "n": 0
    }
   }
  },
  "angelo": {
   "5": {
    "cost_usd": {
     "n": 5,
     "median": 0.091,
     "p75": 0.103,
     "min": 0.085,
     "max": 0.356
    },
    "api_calls": {
     "n": 5,
     "median": 5,
     "p75": 5,
     "min": 5,
     "max": 6
    },
    "input_tokens_per_call": {
     "n": 5,
     "median": 38597,
     "p75": 38628,
     "min": 38461,
     "max": 38925
    }
   }
  }
 },
 "records": [
  {
   "side": "angelo",
   "trial": 1,
   "task": "read_only_question",
   "kind": "read_only",
   "status": "completed",
   "runtime_start": "cold",
   "wall_ms": 3396.892,
   "send_to_idle_ms": 3432.114,
   "first_text_ms": 2594.488,
   "first_verified_result_ms": null,
   "model_rounds": 1,
   "provider_turn_requests": 1,
   "native_tool_invocations": null,
   "python_fallbacks": 0,
   "api_calls": 1,
   "tool_names": [],
   "plans": [
    []
   ],
   "models": [
    "claude-opus-5-5"
   ],
   "tool_call_count": 0,
   "approved": [],
   "declined": [],
   "grade": "passed",
   "gate_version": 2,
   "answer": {
    "form": "mesh_names",
    "outcome": "right",
    "answered": [
     "Brass Marker",
     "Cube"
    ],
    "stated": "Cube, Brass Marker",
    "parsed": "exactly"
   },
   "approval": "AUTO_BOUNDED",
   "always_allow_scripts": false,
   "grading_contract": 4,
   "provider_usage": {
    "input_tokens": 36269,
    "cached_input_tokens": 0,
    "cache_write_input_tokens": 36267,
    "output_tokens": 122,
    "reasoning_output_tokens": 0,
    "api_ms": 2386,
    "cost_usd": 0.292584,
    "turn_ms": 2411,
    "requests": 1,
    "turns": 1
   },
   "host_check_passed": true,
   "warm_ups": 0,
   "warm_up_usage": null,
   "opening": {
    "prepared": false,
    "runtime_live": false,
    "bases": [],
    "waited_s": 0.097,
    "wait_limit_s": 0
   },
   "environment": {
    "frame_before": 1,
    "input_isolated": true,
    "frame_after": 1,
    "playback": false,
    "external_input_suspected": false
   },
   "harness_reset": null,
   "receipt_counts": null,
   "accept": null,
   "uncached_input_tokens": 36269,
   "list_price_usd": 0.2926,
   "list_price_basis": "model_profiles list prices, 1h cache writes"
  },
  {
   "side": "angelo",
   "trial": 1,
   "task": "cube_creation",
   "kind": "edit",
   "status": "completed",
   "runtime_start": "warm",
   "wall_ms": 3415.084,
   "send_to_idle_ms": 3420.588,
   "first_text_ms": null,
   "first_verified_result_ms": 2404.355,
   "model_rounds": 1,
   "provider_turn_requests": 1,
   "native_tool_invocations": 1,
   "python_fallbacks": 0,
   "api_calls": 1,
   "tool_names": [
    "angelo_scene_program"
   ],
   "plans": [
    [
     "angelo_scene_program"
    ]
   ],
   "models": [
    "claude-opus-5-5"
   ],
   "tool_call_count": 1,
   "approved": [],
   "declined": [],
   "grade": "passed",
   "gate_version": 2,
   "answer": null,
   "approval": "AUTO_BOUNDED",
   "always_allow_scripts": false,
   "grading_contract": 4,
   "provider_usage": {
    "input_tokens": 36684,
    "cached_input_tokens": 36267,
    "cache_write_input_tokens": 415,
    "output_tokens": 207,
    "reasoning_output_tokens": 0,
    "api_ms": 2240,
    "cost_usd": 0.014721,
    "turn_ms": 2250,
    "requests": 1,
    "turns": 1
   },
   "host_check_passed": true,
   "warm_ups": 0,
   "warm_up_usage": null,
   "opening": null,
   "environment": {
    "frame_before": 1,
    "input_isolated": true,
    "frame_after": 1,
    "playback": false,
    "external_input_suspected": false
   },
   "harness_reset": null,
   "receipt_counts": null,
   "accept": null,
   "uncached_input_tokens": 417,
   "list_price_usd": 0.0147,
   "list_price_basis": "model_profiles list prices, 1h cache writes"
  },
  {
   "side": "angelo",
   "trial": 1,
   "task": "transform",
   "kind": "edit",
   "status": "completed",
   "runtime_start": "warm",
   "wall_ms": 3125.848,
   "send_to_idle_ms": 3131.152,
   "first_text_ms": null,
   "first_verified_result_ms": 2119.39,
   "model_rounds": 1,
   "provider_turn_requests": 1,
   "native_tool_invocations": 1,
   "python_fallbacks": 0,
   "api_calls": 1,
   "tool_names": [
    "angelo_scene_program"
   ],
   "plans": [
    [
     "angelo_scene_program"
    ]
   ],
   "models": [
    "claude-opus-5-5"
   ],
   "tool_call_count": 1,
   "approved": [],
   "declined": [],
   "grade": "passed",
   "gate_version": 2,
   "answer": null,
   "approval": "AUTO_BOUNDED",
   "always_allow_scripts": false,
   "grading_contract": 4,
   "provider_usage": {
    "input_tokens": 37351,
    "cached_input_tokens": 36682,
    "cache_write_input_tokens": 667,
    "output_tokens": 209,
    "reasoning_output_tokens": 25,
    "api_ms": 2077,
    "cost_usd": 0.01686,
    "turn_ms": 2084,
    "requests": 1,
    "turns": 1
   },
   "host_check_passed": true,
   "warm_ups": 0,
   "warm_up_usage": null,
   "opening": null,
   "environment": {
    "frame_before": 1,
    "input_isolated": true,
    "frame_after": 1,
    "playback": false,
    "external_input_suspected": false
   },
   "harness_reset": null,
   "receipt_counts": null,
   "accept": null,
   "uncached_input_tokens": 669,
   "list_price_usd": 0.0169,
   "list_price_basis": "model_profiles list prices, 1h cache writes"
  },
  {
   "side": "angelo",
   "trial": 1,
   "task": "bevel_and_shade",
   "kind": "edit",
   "status": "completed",
   "runtime_start": "warm",
   "wall_ms": 2006.801,
   "send_to_idle_ms": 2008.586,
   "first_text_ms": null,
   "first_verified_result_ms": 2004.312,
   "model_rounds": 1,
   "provider_turn_requests": 1,
   "native_tool_invocations": 1,
   "python_fallbacks": 0,
   "api_calls": 1,
   "tool_names": [
    "angelo_apply_recipe"
   ],
   "plans": [
    [
     "angelo_apply_recipe"
    ]
   ],
   "models": [
    "claude-opus-5-5"
   ],
   "tool_call_count": 1,
   "approved": [],
   "declined": [],
   "grade": "passed",
   "gate_version": 2,
   "answer": null,
   "approval": "AUTO_BOUNDED",
   "always_allow_scripts": false,
   "grading_contract": 4,
   "provider_usage": {
    "input_tokens": 37885,
    "cached_input_tokens": 37349,
    "cache_write_input_tokens": 534,
    "output_tokens": 191,
    "reasoning_output_tokens": 50,
    "api_ms": 1927,
    "cost_usd": 0.01557,
    "turn_ms": 1934,
    "requests": 1,
    "turns": 1
   },
   "host_check_passed": true,
   "warm_ups": 0,
   "warm_up_usage": null,
   "opening": null,
   "environment": {
    "frame_before": 1,
    "input_isolated": true,
    "frame_after": 1,
    "playback": false,
    "external_input_suspected": false
   },
   "harness_reset": null,
   "receipt_counts": null,
   "accept": null,
   "uncached_input_tokens": 536,
   "list_price_usd": 0.0156,
   "list_price_basis": "model_profiles list prices, 1h cache writes"
  },
  {
   "side": "angelo",
   "trial": 1,
   "task": "material",
   "kind": "edit",
   "status": "completed",
   "runtime_start": "warm",
   "wall_ms": 2227.312,
   "send_to_idle_ms": 3236.701,
   "first_text_ms": null,
   "first_verified_result_ms": 2224.762,
   "model_rounds": 1,
   "provider_turn_requests": 1,
   "native_tool_invocations": 1,
   "python_fallbacks": 0,
   "api_calls": 1,
   "tool_names": [
    "angelo_apply_recipe"
   ],
   "plans": [
    [
     "angelo_apply_recipe"
    ]
   ],
   "models": [
    "claude-opus-5-5"
   ],
   "tool_call_count": 1,
   "approved": [],
   "declined": [],
   "grade": "passed",
   "gate_version": 2,
   "answer": null,
   "approval": "AUTO_BOUNDED",
   "always_allow_scripts": false,
   "grading_contract": 4,
   "provider_usage": {
    "input_tokens": 38502,
    "cached_input_tokens": 37883,
    "cache_write_input_tokens": 617,
    "output_tokens": 167,
    "reasoning_output_tokens": 0,
    "api_ms": 2130,
    "cost_usd": 0.015861,
    "turn_ms": 2140,
    "requests": 1,
    "turns": 1
   },
   "host_check_passed": true,
   "warm_ups": 0,
   "warm_up_usage": null,
   "opening": null,
   "environment": {
    "frame_before": 1,
    "input_isolated": true,
    "frame_after": 1,
    "playback": false,
    "external_input_suspected": false
   },
   "harness_reset": null,
   "receipt_counts": null,
   "accept": null,
   "uncached_input_tokens": 619,
   "list_price_usd": 0.0159,
   "list_price_basis": "model_profiles list prices, 1h cache writes"
  },
  {
   "side": "angelo",
   "trial": 1,
   "task": "preview_accept",
   "kind": "preview",
   "status": "completed",
   "runtime_start": "warm",
   "wall_ms": 2179.931,
   "send_to_idle_ms": 2182.902,
   "first_text_ms": null,
   "first_verified_result_ms": null,
   "model_rounds": 1,
   "provider_turn_requests": 1,
   "native_tool_invocations": 1,
   "python_fallbacks": 0,
   "api_calls": 1,
   "tool_names": [
    "angelo_scene_program"
   ],
   "plans": [
    [
     "angelo_scene_program"
    ]
   ],
   "models": [
    "claude-opus-5-5"
   ],
   "tool_call_count": 1,
   "approved": [],
   "declined": [],
   "grade": "passed",
   "gate_version": 2,
   "answer": null,
   "approval": "AUTO_BOUNDED",
   "always_allow_scripts": false,
   "grading_contract": 4,
   "provider_usage": {
    "input_tokens": 39178,
    "cached_input_tokens": 38500,
    "cache_write_input_tokens": 676,
    "output_tokens": 130,
    "reasoning_output_tokens": 0,
    "api_ms": 2100,
    "cost_usd": 0.015716,
    "turn_ms": 2106,
    "requests": 1,
    "turns": 1
   },
   "host_check_passed": true,
   "warm_ups": 0,
   "warm_up_usage": null,
   "opening": null,
   "environment": {
    "frame_before": 1,
    "input_isolated": true,
    "frame_after": 1,
    "playback": false,
    "external_input_suspected": false
   },
   "harness_reset": null,
   "receipt_counts": null,
   "accept": {
    "accepted": true,
    "accept_to_commit_ms": 1114.626
   },
   "uncached_input_tokens": 678,
   "list_price_usd": 0.0157,
   "list_price_basis": "model_profiles list prices, 1h cache writes"
  },
  {
   "side": "angelo",
   "trial": 2,
   "task": "read_only_question",
   "kind": "read_only",
   "status": "completed",
   "runtime_start": "cold",
   "wall_ms": 4478.889,
   "send_to_idle_ms": 4481.839,
   "first_text_ms": 3425.623,
   "first_verified_result_ms": null,
   "model_rounds": 1,
   "provider_turn_requests": 1,
   "native_tool_invocations": null,
   "python_fallbacks": 0,
   "api_calls": 1,
   "tool_names": [],
   "plans": [
    []
   ],
   "models": [
    "claude-opus-5-5"
   ],
   "tool_call_count": 0,
   "approved": [],
   "declined": [],
   "grade": "passed",
   "gate_version": 2,
   "answer": {
    "form": "mesh_names",
    "outcome": "right",
    "answered": [
     "Brass Marker",
     "Cube"
    ],
    "stated": "Cube, Brass Marker",
    "parsed": "exactly"
   },
   "approval": "AUTO_BOUNDED",
   "always_allow_scripts": false,
   "grading_contract": 4,
   "provider_usage": {
    "input_tokens": 36270,
    "cached_input_tokens": 34543,
    "cache_write_input_tokens": 1725,
    "output_tokens": 114,
    "reasoning_output_tokens": 0,
    "api_ms": 3442,
    "cost_usd": 0.022997,
    "turn_ms": 3459,
    "requests": 1,
    "turns": 1
   },
   "host_check_passed": true,
   "warm_ups": 0,
   "warm_up_usage": null,
   "opening": {
    "prepared": false,
    "runtime_live": false,
    "bases": [],
    "waited_s": 0.097,
    "wait_limit_s": 0
   },
   "environment": {
    "frame_before": 1,
    "input_isolated": true,
    "frame_after": 1,
    "playback": false,
    "external_input_suspected": false
   },
   "harness_reset": null,
   "receipt_counts": null,
   "accept": null,
   "uncached_input_tokens": 1727,
   "list_price_usd": 0.023,
   "list_price_basis": "model_profiles list prices, 1h cache writes"
  },
  {
   "side": "angelo",
   "trial": 2,
   "task": "cube_creation",
   "kind": "edit",
   "status": "completed",
   "runtime_start": "warm",
   "wall_ms": 7676.031,
   "send_to_idle_ms": 7681.232,
   "first_text_ms": null,
   "first_verified_result_ms": 6665.315,
   "model_rounds": 2,
   "provider_turn_requests": 2,
   "native_tool_invocations": 1,
   "python_fallbacks": 0,
   "api_calls": 2,
   "tool_names": [
    "angelo_scene_program",
    "angelo_scene_program"
   ],
   "plans": [
    [
     "angelo_scene_program"
    ],
    [
     "angelo_scene_program"
    ]
   ],
   "models": [
    "claude-opus-5-5"
   ],
   "tool_call_count": 2,
   "approved": [],
   "declined": [],
   "grade": "passed",
   "gate_version": 2,
   "answer": null,
   "approval": "AUTO_BOUNDED",
   "always_allow_scripts": false,
   "grading_contract": 4,
   "provider_usage": {
    "input_tokens": 73703,
    "cached_input_tokens": 72945,
    "cache_write_input_tokens": 754,
    "output_tokens": 391,
    "reasoning_output_tokens": 0,
    "api_ms": 6505,
    "cost_usd": 0.028457,
    "turn_ms": 6521,
    "requests": 2,
    "turns": 2
   },
   "host_check_passed": true,
   "warm_ups": 0,
   "warm_up_usage": null,
   "opening": null,
   "environment": {
    "frame_before": 1,
    "input_isolated": true,
    "frame_after": 1,
    "playback": false,
    "external_input_suspected": false
   },
   "harness_reset": null,
   "receipt_counts": null,
   "accept": null,
   "uncached_input_tokens": 758,
   "list_price_usd": 0.0285,
   "list_price_basis": "model_profiles list prices, 1h cache writes"
  },
  {
   "side": "angelo",
   "trial": 2,
   "task": "transform",
   "kind": "edit",
   "status": "completed",
   "runtime_start": "warm",
   "wall_ms": 3408.225,
   "send_to_idle_ms": 3415.41,
   "first_text_ms": null,
   "first_verified_result_ms": 2401.434,
   "model_rounds": 1,
   "provider_turn_requests": 1,
   "native_tool_invocations": 1,
   "python_fallbacks": 0,
   "api_calls": 1,
   "tool_names": [
    "angelo_scene_program"
   ],
   "plans": [
    [
     "angelo_scene_program"
    ]
   ],
   "models": [
    "claude-opus-5-5"
   ],
   "tool_call_count": 1,
   "approved": [],
   "declined": [],
   "grade": "passed",
   "gate_version": 2,
   "answer": null,
   "approval": "AUTO_BOUNDED",
   "always_allow_scripts": false,
   "grading_contract": 4,
   "provider_usage": {
    "input_tokens": 37677,
    "cached_input_tokens": 37022,
    "cache_write_input_tokens": 653,
    "output_tokens": 174,
    "reasoning_output_tokens": 0,
    "api_ms": 2344,
    "cost_usd": 0.016116,
    "turn_ms": 2351,
    "requests": 1,
    "turns": 1
   },
   "host_check_passed": true,
   "warm_ups": 0,
   "warm_up_usage": null,
   "opening": null,
   "environment": {
    "frame_before": 1,
    "input_isolated": true,
    "frame_after": 1,
    "playback": false,
    "external_input_suspected": false
   },
   "harness_reset": null,
   "receipt_counts": null,
   "accept": null,
   "uncached_input_tokens": 655,
   "list_price_usd": 0.0161,
   "list_price_basis": "model_profiles list prices, 1h cache writes"
  },
  {
   "side": "angelo",
   "trial": 2,
   "task": "bevel_and_shade",
   "kind": "edit",
   "status": "completed",
   "runtime_start": "warm",
   "wall_ms": 4507.815,
   "send_to_idle_ms": 4509.75,
   "first_text_ms": null,
   "first_verified_result_ms": 4505.246,
   "model_rounds": 1,
   "provider_turn_requests": 1,
   "native_tool_invocations": 1,
   "python_fallbacks": 0,
   "api_calls": 1,
   "tool_names": [
    "angelo_apply_recipe"
   ],
   "plans": [
    [
     "angelo_apply_recipe"
    ]
   ],
   "models": [
    "claude-opus-5-5"
   ],
   "tool_call_count": 1,
   "approved": [],
   "declined": [],
   "grade": "passed",
   "gate_version": 2,
   "answer": null,
   "approval": "AUTO_BOUNDED",
   "always_allow_scripts": false,
   "grading_contract": 4,
   "provider_usage": {
    "input_tokens": 38175,
    "cached_input_tokens": 37675,
    "cache_write_input_tokens": 498,
    "output_tokens": 324,
    "reasoning_output_tokens": 183,
    "api_ms": 4437,
    "cost_usd": 0.018007,
    "turn_ms": 4444,
    "requests": 1,
    "turns": 1
   },
   "host_check_passed": true,
   "warm_ups": 0,
   "warm_up_usage": null,
   "opening": null,
   "environment": {
    "frame_before": 1,
    "input_isolated": true,
    "frame_after": 1,
    "playback": false,
    "external_input_suspected": false
   },
   "harness_reset": null,
   "receipt_counts": null,
   "accept": null,
   "uncached_input_tokens": 500,
   "list_price_usd": 0.018,
   "list_price_basis": "model_profiles list prices, 1h cache writes"
  },
  {
   "side": "angelo",
   "trial": 2,
   "task": "material",
   "kind": "edit",
   "status": "completed",
   "runtime_start": "warm",
   "wall_ms": 2527.3,
   "send_to_idle_ms": 3538.205,
   "first_text_ms": null,
   "first_verified_result_ms": 2524.606,
   "model_rounds": 1,
   "provider_turn_requests": 1,
   "native_tool_invocations": 1,
   "python_fallbacks": 0,
   "api_calls": 1,
   "tool_names": [
    "angelo_apply_recipe"
   ],
   "plans": [
    [
     "angelo_apply_recipe"
    ]
   ],
   "models": [
    "claude-opus-5-5"
   ],
   "tool_call_count": 1,
   "approved": [],
   "declined": [],
   "grade": "passed",
   "gate_version": 2,
   "answer": null,
   "approval": "AUTO_BOUNDED",
   "always_allow_scripts": false,
   "grading_contract": 4,
   "provider_usage": {
    "input_tokens": 38925,
    "cached_input_tokens": 38173,
    "cache_write_input_tokens": 750,
    "output_tokens": 167,
    "reasoning_output_tokens": 0,
    "api_ms": 2424,
    "cost_usd": 0.016983,
    "turn_ms": 2433,
    "requests": 1,
    "turns": 1
   },
   "host_check_passed": true,
   "warm_ups": 0,
   "warm_up_usage": null,
   "opening": null,
   "environment": {
    "frame_before": 1,
    "input_isolated": true,
    "frame_after": 1,
    "playback": false,
    "external_input_suspected": false
   },
   "harness_reset": null,
   "receipt_counts": null,
   "accept": null,
   "uncached_input_tokens": 752,
   "list_price_usd": 0.017,
   "list_price_basis": "model_profiles list prices, 1h cache writes"
  },
  {
   "side": "angelo",
   "trial": 2,
   "task": "preview_accept",
   "kind": "preview",
   "status": "completed",
   "runtime_start": "warm",
   "wall_ms": 2306.869,
   "send_to_idle_ms": 2309.708,
   "first_text_ms": null,
   "first_verified_result_ms": null,
   "model_rounds": 1,
   "provider_turn_requests": 1,
   "native_tool_invocations": 1,
   "python_fallbacks": 0,
   "api_calls": 1,
   "tool_names": [
    "angelo_scene_program"
   ],
   "plans": [
    [
     "angelo_scene_program"
    ]
   ],
   "models": [
    "claude-opus-5-5"
   ],
   "tool_call_count": 1,
   "approved": [],
   "declined": [],
   "grade": "passed",
   "gate_version": 2,
   "answer": null,
   "approval": "AUTO_BOUNDED",
   "always_allow_scripts": false,
   "grading_contract": 4,
   "provider_usage": {
    "input_tokens": 39600,
    "cached_input_tokens": 38923,
    "cache_write_input_tokens": 675,
    "output_tokens": 130,
    "reasoning_output_tokens": 0,
    "api_ms": 2205,
    "cost_usd": 0.015793,
    "turn_ms": 2214,
    "requests": 1,
    "turns": 1
   },
   "host_check_passed": true,
   "warm_ups": 0,
   "warm_up_usage": null,
   "opening": null,
   "environment": {
    "frame_before": 1,
    "input_isolated": true,
    "frame_after": 1,
    "playback": false,
    "external_input_suspected": false
   },
   "harness_reset": null,
   "receipt_counts": null,
   "accept": {
    "accepted": true,
    "accept_to_commit_ms": 1108.3
   },
   "uncached_input_tokens": 677,
   "list_price_usd": 0.0158,
   "list_price_basis": "model_profiles list prices, 1h cache writes"
  },
  {
   "side": "angelo",
   "trial": 3,
   "task": "read_only_question",
   "kind": "read_only",
   "status": "completed",
   "runtime_start": "cold",
   "wall_ms": 3059.084,
   "send_to_idle_ms": 3081.801,
   "first_text_ms": 3040.775,
   "first_verified_result_ms": null,
   "model_rounds": 1,
   "provider_turn_requests": 1,
   "native_tool_invocations": null,
   "python_fallbacks": 0,
   "api_calls": 1,
   "tool_names": [],
   "plans": [
    []
   ],
   "models": [
    "claude-opus-5-5"
   ],
   "tool_call_count": 0,
   "approved": [],
   "declined": [],
   "grade": "passed",
   "gate_version": 2,
   "answer": {
    "form": "mesh_names",
    "outcome": "right",
    "answered": [
     "Brass Marker",
     "Cube"
    ],
    "stated": "Cube, Brass Marker",
    "parsed": "exactly"
   },
   "approval": "AUTO_BOUNDED",
   "always_allow_scripts": false,
   "grading_contract": 4,
   "provider_usage": {
    "input_tokens": 36269,
    "cached_input_tokens": 34543,
    "cache_write_input_tokens": 1724,
    "output_tokens": 112,
    "reasoning_output_tokens": 0,
    "api_ms": 2060,
    "cost_usd": 0.022949,
    "turn_ms": 2078,
    "requests": 1,
    "turns": 1
   },
   "host_check_passed": true,
   "warm_ups": 0,
   "warm_up_usage": null,
   "opening": {
    "prepared": false,
    "runtime_live": false,
    "bases": [],
    "waited_s": 0.097,
    "wait_limit_s": 0
   },
   "environment": {
    "frame_before": 1,
    "input_isolated": true,
    "frame_after": 1,
    "playback": false,
    "external_input_suspected": false
   },
   "harness_reset": null,
   "receipt_counts": null,
   "accept": null,
   "uncached_input_tokens": 1726,
   "list_price_usd": 0.0229,
   "list_price_basis": "model_profiles list prices, 1h cache writes"
  },
  {
   "side": "angelo",
   "trial": 3,
   "task": "cube_creation",
   "kind": "edit",
   "status": "completed",
   "runtime_start": "warm",
   "wall_ms": 2867.217,
   "send_to_idle_ms": 2873.154,
   "first_text_ms": null,
   "first_verified_result_ms": 1856.322,
   "model_rounds": 1,
   "provider_turn_requests": 1,
   "native_tool_invocations": 1,
   "python_fallbacks": 0,
   "api_calls": 1,
   "tool_names": [
    "angelo_scene_program"
   ],
   "plans": [
    [
     "angelo_scene_program"
    ]
   ],
   "models": [
    "claude-opus-5-5"
   ],
   "tool_call_count": 1,
   "approved": [],
   "declined": [],
   "grade": "passed",
   "gate_version": 2,
   "answer": null,
   "approval": "AUTO_BOUNDED",
   "always_allow_scripts": false,
   "grading_contract": 4,
   "provider_usage": {
    "input_tokens": 36675,
    "cached_input_tokens": 36267,
    "cache_write_input_tokens": 406,
    "output_tokens": 149,
    "reasoning_output_tokens": 0,
    "api_ms": 1702,
    "cost_usd": 0.013489,
    "turn_ms": 1711,
    "requests": 1,
    "turns": 1
   },
   "host_check_passed": true,
   "warm_ups": 0,
   "warm_up_usage": null,
   "opening": null,
   "environment": {
    "frame_before": 1,
    "input_isolated": true,
    "frame_after": 1,
    "playback": false,
    "external_input_suspected": false
   },
   "harness_reset": null,
   "receipt_counts": null,
   "accept": null,
   "uncached_input_tokens": 408,
   "list_price_usd": 0.0135,
   "list_price_basis": "model_profiles list prices, 1h cache writes"
  },
  {
   "side": "angelo",
   "trial": 3,
   "task": "transform",
   "kind": "edit",
   "status": "completed",
   "runtime_start": "warm",
   "wall_ms": 3306.062,
   "send_to_idle_ms": 3311.413,
   "first_text_ms": 1166.511,
   "first_verified_result_ms": 2299.58,
   "model_rounds": 1,
   "provider_turn_requests": 1,
   "native_tool_invocations": 1,
   "python_fallbacks": 0,
   "api_calls": 1,
   "tool_names": [
    "angelo_scene_program"
   ],
   "plans": [
    [
     "angelo_scene_program"
    ]
   ],
   "models": [
    "claude-opus-5-5"
   ],
   "tool_call_count": 1,
   "approved": [],
   "declined": [],
   "grade": "passed",
   "gate_version": 2,
   "answer": null,
   "approval": "AUTO_BOUNDED",
   "always_allow_scripts": false,
   "grading_contract": 4,
   "provider_usage": {
    "input_tokens": 37294,
    "cached_input_tokens": 36673,
    "cache_write_input_tokens": 619,
    "output_tokens": 220,
    "reasoning_output_tokens": 0,
    "api_ms": 2248,
    "cost_usd": 0.016695,
    "turn_ms": 2255,
    "requests": 1,
    "turns": 1
   },
   "host_check_passed": true,
   "warm_ups": 0,
   "warm_up_usage": null,
   "opening": null,
   "environment": {
    "frame_before": 1,
    "input_isolated": true,
    "frame_after": 1,
    "playback": false,
    "external_input_suspected": false
   },
   "harness_reset": null,
   "receipt_counts": null,
   "accept": null,
   "uncached_input_tokens": 621,
   "list_price_usd": 0.0167,
   "list_price_basis": "model_profiles list prices, 1h cache writes"
  },
  {
   "side": "angelo",
   "trial": 3,
   "task": "bevel_and_shade",
   "kind": "edit",
   "status": "completed",
   "runtime_start": "warm",
   "wall_ms": 3627.478,
   "send_to_idle_ms": 4636.262,
   "first_text_ms": 2549.087,
   "first_verified_result_ms": 3625.061,
   "model_rounds": 1,
   "provider_turn_requests": 1,
   "native_tool_invocations": 1,
   "python_fallbacks": 0,
   "api_calls": 1,
   "tool_names": [
    "angelo_apply_recipe"
   ],
   "plans": [
    [
     "angelo_apply_recipe"
    ]
   ],
   "models": [
    "claude-opus-5-5"
   ],
   "tool_call_count": 1,
   "approved": [],
   "declined": [],
   "grade": "passed",
   "gate_version": 2,
   "answer": null,
   "approval": "AUTO_BOUNDED",
   "always_allow_scripts": false,
   "grading_contract": 4,
   "provider_usage": {
    "input_tokens": 37836,
    "cached_input_tokens": 37292,
    "cache_write_input_tokens": 542,
    "output_tokens": 337,
    "reasoning_output_tokens": 93,
    "api_ms": 3546,
    "cost_usd": 0.018542,
    "turn_ms": 3553,
    "requests": 1,
    "turns": 1
   },
   "host_check_passed": true,
   "warm_ups": 0,
   "warm_up_usage": null,
   "opening": null,
   "environment": {
    "frame_before": 1,
    "input_isolated": true,
    "frame_after": 1,
    "playback": false,
    "external_input_suspected": false
   },
   "harness_reset": null,
   "receipt_counts": null,
   "accept": null,
   "uncached_input_tokens": 544,
   "list_price_usd": 0.0185,
   "list_price_basis": "model_profiles list prices, 1h cache writes"
  },
  {
   "side": "angelo",
   "trial": 3,
   "task": "material",
   "kind": "edit",
   "status": "completed",
   "runtime_start": "warm",
   "wall_ms": 1939.524,
   "send_to_idle_ms": 2949.26,
   "first_text_ms": null,
   "first_verified_result_ms": 1936.696,
   "model_rounds": 1,
   "provider_turn_requests": 1,
   "native_tool_invocations": 1,
   "python_fallbacks": 0,
   "api_calls": 1,
   "tool_names": [
    "angelo_apply_recipe"
   ],
   "plans": [
    [
     "angelo_apply_recipe"
    ]
   ],
   "models": [
    "claude-opus-5-5"
   ],
   "tool_call_count": 1,
   "approved": [],
   "declined": [],
   "grade": "passed",
   "gate_version": 2,
   "answer": null,
   "approval": "AUTO_BOUNDED",
   "always_allow_scripts": false,
   "grading_contract": 4,
   "provider_usage": {
    "input_tokens": 38597,
    "cached_input_tokens": 37834,
    "cache_write_input_tokens": 761,
    "output_tokens": 167,
    "reasoning_output_tokens": 0,
    "api_ms": 1847,
    "cost_usd": 0.017003,
    "turn_ms": 1854,
    "requests": 1,
    "turns": 1
   },
   "host_check_passed": true,
   "warm_ups": 0,
   "warm_up_usage": null,
   "opening": null,
   "environment": {
    "frame_before": 1,
    "input_isolated": true,
    "frame_after": 1,
    "playback": false,
    "external_input_suspected": false
   },
   "harness_reset": null,
   "receipt_counts": null,
   "accept": null,
   "uncached_input_tokens": 763,
   "list_price_usd": 0.017,
   "list_price_basis": "model_profiles list prices, 1h cache writes"
  },
  {
   "side": "angelo",
   "trial": 3,
   "task": "preview_accept",
   "kind": "preview",
   "status": "completed",
   "runtime_start": "warm",
   "wall_ms": 1587.094,
   "send_to_idle_ms": 2616.812,
   "first_text_ms": null,
   "first_verified_result_ms": null,
   "model_rounds": 1,
   "provider_turn_requests": 1,
   "native_tool_invocations": 1,
   "python_fallbacks": 0,
   "api_calls": 1,
   "tool_names": [
    "angelo_scene_program"
   ],
   "plans": [
    [
     "angelo_scene_program"
    ]
   ],
   "models": [
    "claude-opus-5-5"
   ],
   "tool_call_count": 1,
   "approved": [],
   "declined": [],
   "grade": "passed",
   "gate_version": 2,
   "answer": null,
   "approval": "AUTO_BOUNDED",
   "always_allow_scripts": false,
   "grading_contract": 4,
   "provider_usage": {
    "input_tokens": 39273,
    "cached_input_tokens": 38595,
    "cache_write_input_tokens": 676,
    "output_tokens": 130,
    "reasoning_output_tokens": 0,
    "api_ms": 1484,
    "cost_usd": 0.015735,
    "turn_ms": 1494,
    "requests": 1,
    "turns": 1
   },
   "host_check_passed": true,
   "warm_ups": 0,
   "warm_up_usage": null,
   "opening": null,
   "environment": {
    "frame_before": 1,
    "input_isolated": true,
    "frame_after": 1,
    "playback": false,
    "external_input_suspected": false
   },
   "harness_reset": null,
   "receipt_counts": null,
   "accept": {
    "accepted": true,
    "accept_to_commit_ms": 163.237
   },
   "uncached_input_tokens": 678,
   "list_price_usd": 0.0157,
   "list_price_basis": "model_profiles list prices, 1h cache writes"
  },
  {
   "side": "angelo",
   "trial": 4,
   "task": "read_only_question",
   "kind": "read_only",
   "status": "completed",
   "runtime_start": "cold",
   "wall_ms": 3134.78,
   "send_to_idle_ms": 3181.883,
   "first_text_ms": 2344.545,
   "first_verified_result_ms": null,
   "model_rounds": 1,
   "provider_turn_requests": 1,
   "native_tool_invocations": null,
   "python_fallbacks": 0,
   "api_calls": 1,
   "tool_names": [],
   "plans": [
    []
   ],
   "models": [
    "claude-opus-5-5"
   ],
   "tool_call_count": 0,
   "approved": [],
   "declined": [],
   "grade": "passed",
   "gate_version": 2,
   "answer": {
    "form": "mesh_names",
    "outcome": "right",
    "answered": [
     "Brass Marker",
     "Cube"
    ],
    "stated": "Cube, Brass Marker",
    "parsed": "exactly"
   },
   "approval": "AUTO_BOUNDED",
   "always_allow_scripts": false,
   "grading_contract": 4,
   "provider_usage": {
    "input_tokens": 36269,
    "cached_input_tokens": 34543,
    "cache_write_input_tokens": 1724,
    "output_tokens": 114,
    "reasoning_output_tokens": 0,
    "api_ms": 2105,
    "cost_usd": 0.022989,
    "turn_ms": 2123,
    "requests": 1,
    "turns": 1
   },
   "host_check_passed": true,
   "warm_ups": 0,
   "warm_up_usage": null,
   "opening": {
    "prepared": false,
    "runtime_live": false,
    "bases": [],
    "waited_s": 0.097,
    "wait_limit_s": 0
   },
   "environment": {
    "frame_before": 1,
    "input_isolated": true,
    "frame_after": 1,
    "playback": false,
    "external_input_suspected": false
   },
   "harness_reset": null,
   "receipt_counts": null,
   "accept": null,
   "uncached_input_tokens": 1726,
   "list_price_usd": 0.023,
   "list_price_basis": "model_profiles list prices, 1h cache writes"
  },
  {
   "side": "angelo",
   "trial": 4,
   "task": "cube_creation",
   "kind": "edit",
   "status": "completed",
   "runtime_start": "warm",
   "wall_ms": 3157.933,
   "send_to_idle_ms": 3163.687,
   "first_text_ms": null,
   "first_verified_result_ms": 2146.908,
   "model_rounds": 1,
   "provider_turn_requests": 1,
   "native_tool_invocations": 1,
   "python_fallbacks": 0,
   "api_calls": 1,
   "tool_names": [
    "angelo_scene_program"
   ],
   "plans": [
    [
     "angelo_scene_program"
    ]
   ],
   "models": [
    "claude-opus-5-5"
   ],
   "tool_call_count": 1,
   "approved": [],
   "declined": [],
   "grade": "passed",
   "gate_version": 2,
   "answer": null,
   "approval": "AUTO_BOUNDED",
   "always_allow_scripts": false,
   "grading_contract": 4,
   "provider_usage": {
    "input_tokens": 36677,
    "cached_input_tokens": 36267,
    "cache_write_input_tokens": 408,
    "output_tokens": 208,
    "reasoning_output_tokens": 0,
    "api_ms": 2002,
    "cost_usd": 0.014685,
    "turn_ms": 2011,
    "requests": 1,
    "turns": 1
   },
   "host_check_passed": true,
   "warm_ups": 0,
   "warm_up_usage": null,
   "opening": null,
   "environment": {
    "frame_before": 1,
    "input_isolated": true,
    "frame_after": 1,
    "playback": false,
    "external_input_suspected": false
   },
   "harness_reset": null,
   "receipt_counts": null,
   "accept": null,
   "uncached_input_tokens": 410,
   "list_price_usd": 0.0147,
   "list_price_basis": "model_profiles list prices, 1h cache writes"
  },
  {
   "side": "angelo",
   "trial": 4,
   "task": "transform",
   "kind": "edit",
   "status": "completed",
   "runtime_start": "warm",
   "wall_ms": 2825.552,
   "send_to_idle_ms": 2831.723,
   "first_text_ms": null,
   "first_verified_result_ms": 1819.407,
   "model_rounds": 1,
   "provider_turn_requests": 1,
   "native_tool_invocations": 1,
   "python_fallbacks": 0,
   "api_calls": 1,
   "tool_names": [
    "angelo_scene_program"
   ],
   "plans": [
    [
     "angelo_scene_program"
    ]
   ],
   "models": [
    "claude-opus-5-5"
   ],
   "tool_call_count": 1,
   "approved": [],
   "declined": [],
   "grade": "passed",
   "gate_version": 2,
   "answer": null,
   "approval": "AUTO_BOUNDED",
   "always_allow_scripts": false,
   "grading_contract": 4,
   "provider_usage": {
    "input_tokens": 37344,
    "cached_input_tokens": 36675,
    "cache_write_input_tokens": 667,
    "output_tokens": 183,
    "reasoning_output_tokens": 0,
    "api_ms": 1763,
    "cost_usd": 0.016339,
    "turn_ms": 1770,
    "requests": 1,
    "turns": 1
   },
   "host_check_passed": true,
   "warm_ups": 0,
   "warm_up_usage": null,
   "opening": null,
   "environment": {
    "frame_before": 1,
    "input_isolated": true,
    "frame_after": 1,
    "playback": false,
    "external_input_suspected": false
   },
   "harness_reset": null,
   "receipt_counts": null,
   "accept": null,
   "uncached_input_tokens": 669,
   "list_price_usd": 0.0163,
   "list_price_basis": "model_profiles list prices, 1h cache writes"
  },
  {
   "side": "angelo",
   "trial": 4,
   "task": "bevel_and_shade",
   "kind": "edit",
   "status": "completed",
   "runtime_start": "warm",
   "wall_ms": 3627.213,
   "send_to_idle_ms": 4635.9,
   "first_text_ms": 2659.088,
   "first_verified_result_ms": 3624.619,
   "model_rounds": 1,
   "provider_turn_requests": 1,
   "native_tool_invocations": 1,
   "python_fallbacks": 0,
   "api_calls": 1,
   "tool_names": [
    "angelo_apply_recipe"
   ],
   "plans": [
    [
     "angelo_apply_recipe"
    ]
   ],
   "models": [
    "claude-opus-5-5"
   ],
   "tool_call_count": 1,
   "approved": [],
   "declined": [],
   "grade": "passed",
   "gate_version": 2,
   "answer": null,
   "approval": "AUTO_BOUNDED",
   "always_allow_scripts": false,
   "grading_contract": 4,
   "provider_usage": {
    "input_tokens": 37851,
    "cached_input_tokens": 37342,
    "cache_write_input_tokens": 507,
    "output_tokens": 352,
    "reasoning_output_tokens": 122,
    "api_ms": 3549,
    "cost_usd": 0.018572,
    "turn_ms": 3557,
    "requests": 1,
    "turns": 1
   },
   "host_check_passed": true,
   "warm_ups": 0,
   "warm_up_usage": null,
   "opening": null,
   "environment": {
    "frame_before": 1,
    "input_isolated": true,
    "frame_after": 1,
    "playback": false,
    "external_input_suspected": false
   },
   "harness_reset": null,
   "receipt_counts": null,
   "accept": null,
   "uncached_input_tokens": 509,
   "list_price_usd": 0.0186,
   "list_price_basis": "model_profiles list prices, 1h cache writes"
  },
  {
   "side": "angelo",
   "trial": 4,
   "task": "material",
   "kind": "edit",
   "status": "completed",
   "runtime_start": "warm",
   "wall_ms": 2253.292,
   "send_to_idle_ms": 3261.535,
   "first_text_ms": null,
   "first_verified_result_ms": 2250.879,
   "model_rounds": 1,
   "provider_turn_requests": 1,
   "native_tool_invocations": 1,
   "python_fallbacks": 0,
   "api_calls": 1,
   "tool_names": [
    "angelo_scene_program"
   ],
   "plans": [
    [
     "angelo_scene_program"
    ]
   ],
   "models": [
    "claude-opus-5-5"
   ],
   "tool_call_count": 1,
   "approved": [],
   "declined": [],
   "grade": "passed",
   "gate_version": 2,
   "answer": null,
   "approval": "AUTO_BOUNDED",
   "always_allow_scripts": false,
   "grading_contract": 4,
   "provider_usage": {
    "input_tokens": 38628,
    "cached_input_tokens": 37849,
    "cache_write_input_tokens": 777,
    "output_tokens": 230,
    "reasoning_output_tokens": 0,
    "api_ms": 2161,
    "cost_usd": 0.018394,
    "turn_ms": 2169,
    "requests": 1,
    "turns": 1
   },
   "host_check_passed": true,
   "warm_ups": 0,
   "warm_up_usage": null,
   "opening": null,
   "environment": {
    "frame_before": 1,
    "input_isolated": true,
    "frame_after": 1,
    "playback": false,
    "external_input_suspected": false
   },
   "harness_reset": null,
   "receipt_counts": null,
   "accept": null,
   "uncached_input_tokens": 779,
   "list_price_usd": 0.0184,
   "list_price_basis": "model_profiles list prices, 1h cache writes"
  },
  {
   "side": "angelo",
   "trial": 4,
   "task": "preview_accept",
   "kind": "preview",
   "status": "completed",
   "runtime_start": "warm",
   "wall_ms": 1738.787,
   "send_to_idle_ms": 1741.377,
   "first_text_ms": null,
   "first_verified_result_ms": null,
   "model_rounds": 1,
   "provider_turn_requests": 1,
   "native_tool_invocations": 1,
   "python_fallbacks": 0,
   "api_calls": 1,
   "tool_names": [
    "angelo_scene_program"
   ],
   "plans": [
    [
     "angelo_scene_program"
    ]
   ],
   "models": [
    "claude-opus-5-5"
   ],
   "tool_call_count": 1,
   "approved": [],
   "declined": [],
   "grade": "passed",
   "gate_version": 2,
   "answer": null,
   "approval": "AUTO_BOUNDED",
   "always_allow_scripts": false,
   "grading_contract": 4,
   "provider_usage": {
    "input_tokens": 39292,
    "cached_input_tokens": 38626,
    "cache_write_input_tokens": 664,
    "output_tokens": 130,
    "reasoning_output_tokens": 0,
    "api_ms": 1649,
    "cost_usd": 0.015645,
    "turn_ms": 1655,
    "requests": 1,
    "turns": 1
   },
   "host_check_passed": true,
   "warm_ups": 0,
   "warm_up_usage": null,
   "opening": null,
   "environment": {
    "frame_before": 1,
    "input_isolated": true,
    "frame_after": 1,
    "playback": false,
    "external_input_suspected": false
   },
   "harness_reset": null,
   "receipt_counts": null,
   "accept": {
    "accepted": true,
    "accept_to_commit_ms": 1113.167
   },
   "uncached_input_tokens": 666,
   "list_price_usd": 0.0156,
   "list_price_basis": "model_profiles list prices, 1h cache writes"
  },
  {
   "side": "angelo",
   "trial": 5,
   "task": "read_only_question",
   "kind": "read_only",
   "status": "completed",
   "runtime_start": "cold",
   "wall_ms": 5140.288,
   "send_to_idle_ms": 5181.843,
   "first_text_ms": 4627.796,
   "first_verified_result_ms": null,
   "model_rounds": 1,
   "provider_turn_requests": 1,
   "native_tool_invocations": null,
   "python_fallbacks": 0,
   "api_calls": 1,
   "tool_names": [],
   "plans": [
    []
   ],
   "models": [
    "claude-opus-5-5"
   ],
   "tool_call_count": 0,
   "approved": [],
   "declined": [],
   "grade": "passed",
   "gate_version": 2,
   "answer": {
    "form": "mesh_names",
    "outcome": "right",
    "answered": [
     "Brass Marker",
     "Cube"
    ],
    "stated": "Cube, Brass Marker",
    "parsed": "exactly"
   },
   "approval": "AUTO_BOUNDED",
   "always_allow_scripts": false,
   "grading_contract": 4,
   "provider_usage": {
    "input_tokens": 36265,
    "cached_input_tokens": 34543,
    "cache_write_input_tokens": 1720,
    "output_tokens": 122,
    "reasoning_output_tokens": 0,
    "api_ms": 4143,
    "cost_usd": 0.023117,
    "turn_ms": 4162,
    "requests": 1,
    "turns": 1
   },
   "host_check_passed": true,
   "warm_ups": 0,
   "warm_up_usage": null,
   "opening": {
    "prepared": false,
    "runtime_live": false,
    "bases": [],
    "waited_s": 0.097,
    "wait_limit_s": 0
   },
   "environment": {
    "frame_before": 1,
    "input_isolated": true,
    "frame_after": 1,
    "playback": false,
    "external_input_suspected": false
   },
   "harness_reset": null,
   "receipt_counts": null,
   "accept": null,
   "uncached_input_tokens": 1722,
   "list_price_usd": 0.0231,
   "list_price_basis": "model_profiles list prices, 1h cache writes"
  },
  {
   "side": "angelo",
   "trial": 5,
   "task": "cube_creation",
   "kind": "edit",
   "status": "completed",
   "runtime_start": "warm",
   "wall_ms": 4018.312,
   "send_to_idle_ms": 4023.696,
   "first_text_ms": null,
   "first_verified_result_ms": 3007.549,
   "model_rounds": 1,
   "provider_turn_requests": 1,
   "native_tool_invocations": 1,
   "python_fallbacks": 0,
   "api_calls": 1,
   "tool_names": [
    "angelo_scene_program"
   ],
   "plans": [
    [
     "angelo_scene_program"
    ]
   ],
   "models": [
    "claude-opus-5-5"
   ],
   "tool_call_count": 1,
   "approved": [],
   "declined": [],
   "grade": "passed",
   "gate_version": 2,
   "answer": null,
   "approval": "AUTO_BOUNDED",
   "always_allow_scripts": false,
   "grading_contract": 4,
   "provider_usage": {
    "input_tokens": 36679,
    "cached_input_tokens": 36263,
    "cache_write_input_tokens": 414,
    "output_tokens": 190,
    "reasoning_output_tokens": 0,
    "api_ms": 2854,
    "cost_usd": 0.014373,
    "turn_ms": 2864,
    "requests": 1,
    "turns": 1
   },
   "host_check_passed": true,
   "warm_ups": 0,
   "warm_up_usage": null,
   "opening": null,
   "environment": {
    "frame_before": 1,
    "input_isolated": true,
    "frame_after": 1,
    "playback": false,
    "external_input_suspected": false
   },
   "harness_reset": null,
   "receipt_counts": null,
   "accept": null,
   "uncached_input_tokens": 416,
   "list_price_usd": 0.0144,
   "list_price_basis": "model_profiles list prices, 1h cache writes"
  },
  {
   "side": "angelo",
   "trial": 5,
   "task": "transform",
   "kind": "edit",
   "status": "completed",
   "runtime_start": "warm",
   "wall_ms": 3746.876,
   "send_to_idle_ms": 3752.891,
   "first_text_ms": null,
   "first_verified_result_ms": 2739.946,
   "model_rounds": 1,
   "provider_turn_requests": 1,
   "native_tool_invocations": 1,
   "python_fallbacks": 0,
   "api_calls": 1,
   "tool_names": [
    "angelo_scene_program"
   ],
   "plans": [
    [
     "angelo_scene_program"
    ]
   ],
   "models": [
    "claude-opus-5-5"
   ],
   "tool_call_count": 1,
   "approved": [],
   "declined": [],
   "grade": "passed",
   "gate_version": 2,
   "answer": null,
   "approval": "AUTO_BOUNDED",
   "always_allow_scripts": false,
   "grading_contract": 4,
   "provider_usage": {
    "input_tokens": 37326,
    "cached_input_tokens": 36677,
    "cache_write_input_tokens": 647,
    "output_tokens": 174,
    "reasoning_output_tokens": 0,
    "api_ms": 2686,
    "cost_usd": 0.015999,
    "turn_ms": 2692,
    "requests": 1,
    "turns": 1
   },
   "host_check_passed": true,
   "warm_ups": 0,
   "warm_up_usage": null,
   "opening": null,
   "environment": {
    "frame_before": 1,
    "input_isolated": true,
    "frame_after": 1,
    "playback": false,
    "external_input_suspected": false
   },
   "harness_reset": null,
   "receipt_counts": null,
   "accept": null,
   "uncached_input_tokens": 649,
   "list_price_usd": 0.016,
   "list_price_basis": "model_profiles list prices, 1h cache writes"
  },
  {
   "side": "angelo",
   "trial": 5,
   "task": "bevel_and_shade",
   "kind": "edit",
   "status": "completed",
   "runtime_start": "warm",
   "wall_ms": 3447.293,
   "send_to_idle_ms": 3449.078,
   "first_text_ms": null,
   "first_verified_result_ms": 3444.675,
   "model_rounds": 1,
   "provider_turn_requests": 1,
   "native_tool_invocations": 1,
   "python_fallbacks": 0,
   "api_calls": 1,
   "tool_names": [
    "angelo_apply_recipe"
   ],
   "plans": [
    [
     "angelo_apply_recipe"
    ]
   ],
   "models": [
    "claude-opus-5-5"
   ],
   "tool_call_count": 1,
   "approved": [],
   "declined": [],
   "grade": "passed",
   "gate_version": 2,
   "answer": null,
   "approval": "AUTO_BOUNDED",
   "always_allow_scripts": false,
   "grading_contract": 4,
   "provider_usage": {
    "input_tokens": 37823,
    "cached_input_tokens": 37324,
    "cache_write_input_tokens": 497,
    "output_tokens": 212,
    "reasoning_output_tokens": 71,
    "api_ms": 3378,
    "cost_usd": 0.015689,
    "turn_ms": 3386,
    "requests": 1,
    "turns": 1
   },
   "host_check_passed": true,
   "warm_ups": 0,
   "warm_up_usage": null,
   "opening": null,
   "environment": {
    "frame_before": 1,
    "input_isolated": true,
    "frame_after": 1,
    "playback": false,
    "external_input_suspected": false
   },
   "harness_reset": null,
   "receipt_counts": null,
   "accept": null,
   "uncached_input_tokens": 499,
   "list_price_usd": 0.0157,
   "list_price_basis": "model_profiles list prices, 1h cache writes"
  },
  {
   "side": "angelo",
   "trial": 5,
   "task": "material",
   "kind": "edit",
   "status": "completed",
   "runtime_start": "warm",
   "wall_ms": 2596.949,
   "send_to_idle_ms": 2599.133,
   "first_text_ms": null,
   "first_verified_result_ms": 2594.431,
   "model_rounds": 1,
   "provider_turn_requests": 1,
   "native_tool_invocations": 1,
   "python_fallbacks": 0,
   "api_calls": 1,
   "tool_names": [
    "angelo_apply_recipe"
   ],
   "plans": [
    [
     "angelo_apply_recipe"
    ]
   ],
   "models": [
    "claude-opus-5-5"
   ],
   "tool_call_count": 1,
   "approved": [],
   "declined": [],
   "grade": "passed",
   "gate_version": 2,
   "answer": null,
   "approval": "AUTO_BOUNDED",
   "always_allow_scripts": false,
   "grading_contract": 4,
   "provider_usage": {
    "input_tokens": 38461,
    "cached_input_tokens": 37821,
    "cache_write_input_tokens": 638,
    "output_tokens": 167,
    "reasoning_output_tokens": 0,
    "api_ms": 2510,
    "cost_usd": 0.016016,
    "turn_ms": 2519,
    "requests": 1,
    "turns": 1
   },
   "host_check_passed": true,
   "warm_ups": 0,
   "warm_up_usage": null,
   "opening": null,
   "environment": {
    "frame_before": 1,
    "input_isolated": true,
    "frame_after": 1,
    "playback": false,
    "external_input_suspected": false
   },
   "harness_reset": null,
   "receipt_counts": null,
   "accept": null,
   "uncached_input_tokens": 640,
   "list_price_usd": 0.016,
   "list_price_basis": "model_profiles list prices, 1h cache writes"
  },
  {
   "side": "angelo",
   "trial": 5,
   "task": "preview_accept",
   "kind": "preview",
   "status": "completed",
   "runtime_start": "warm",
   "wall_ms": 2376.609,
   "send_to_idle_ms": 2379.335,
   "first_text_ms": null,
   "first_verified_result_ms": null,
   "model_rounds": 1,
   "provider_turn_requests": 1,
   "native_tool_invocations": 1,
   "python_fallbacks": 0,
   "api_calls": 1,
   "tool_names": [
    "angelo_scene_program"
   ],
   "plans": [
    [
     "angelo_scene_program"
    ]
   ],
   "models": [
    "claude-opus-5-5"
   ],
   "tool_call_count": 1,
   "approved": [],
   "declined": [],
   "grade": "passed",
   "gate_version": 2,
   "answer": null,
   "approval": "AUTO_BOUNDED",
   "always_allow_scripts": false,
   "grading_contract": 4,
   "provider_usage": {
    "input_tokens": 39138,
    "cached_input_tokens": 38459,
    "cache_write_input_tokens": 677,
    "output_tokens": 130,
    "reasoning_output_tokens": 0,
    "api_ms": 2288,
    "cost_usd": 0.015716,
    "turn_ms": 2297,
    "requests": 1,
    "turns": 1
   },
   "host_check_passed": true,
   "warm_ups": 0,
   "warm_up_usage": null,
   "opening": null,
   "environment": {
    "frame_before": 1,
    "input_isolated": true,
    "frame_after": 1,
    "playback": false,
    "external_input_suspected": false
   },
   "harness_reset": null,
   "receipt_counts": null,
   "accept": {
    "accepted": true,
    "accept_to_commit_ms": 1104.168
   },
   "uncached_input_tokens": 679,
   "list_price_usd": 0.0157,
   "list_price_basis": "model_profiles list prices, 1h cache writes"
  }
 ]
}