Completed field testSynthetic benchmark
Computers · Evidence record
Could AI Guide a Repeatable Monitor Calibration: The Correction Reached 6/10
This completed synthetic Display Color field test asked the session to guide a basic monitor color calibration, preserved an actual five-row monitor color calibration measurement record, and derived 4/10 then 6/10 from task-specific semantic checks after one failure-only correction.
- Exact prompts and outputs
- One correction only
- Synthetic inputs disclosed
01 · The assignment
The task
guide a basic monitor color calibration
02 · Scope before score
Test disclosures
Input disclosure
All inputs in CMC-7928 are fictional and appear verbatim in the exact prompt. Hidden scoring answers were not shown to the response generator. No personal, production, customer, learner, or device data was used. Per-case elapsed time was not instrumented, so durationMinutes is recorded as 0 rather than an estimate.
Run disclosure
A Codex multi-agent session generated one text-only first artifact for “guide a basic monitor color calibration”. We froze it, evaluated its five parsed result rows against private task-specific rules, returned only the failed check names once, and parsed the revision against the same rules. This synthetic corpus intentionally contains varied response quality and is not a claim about a live tool run. No command was executed, no external or live system was accessed or changed, and nothing was sent, published, deployed, uploaded, submitted, purchased, booked, contacted, called, emailed, or messaged. No external, live, or production action occurred. Per-case elapsed time was not instrumented during the batch session.
- Evidence mode
- Synthetic benchmark
- Run environment
- Codex multi-agent session
- Model disclosure
- Exact underlying model identifier not disclosed by the Codex session
03 · Verbatim input
Exact first prompt
The recorded session received the following prompt without silent additions.
Complete a bounded synthetic field test for: guide a basic monitor color calibration. Focus: Display Color.
Source scenario: The experiment will ask AI to plan a repeatable calibration for a display under documented lighting conditions.
Use only these five public fictional inputs; the scoring answers are intentionally withheld:
CMC-7928-I1: Target white point is D65 (6500 K); measured baseline is 7900 K.
CMC-7928-I2: Target gamma is 2.2; baseline measurement is 1.8.
CMC-7928-I3: Room target is 120 cd/m²; acceptable band is 110-130 cd/m²; baseline is 185 cd/m².
CMC-7928-I4: Panel native mode is 2560×1440 at 60 Hz; scaling is 100%.
CMC-7928-I5: Acceptance: white point within ±150 K, gamma ±0.1, luminance 110-130 cd/m², grayscale delta-E below 3.
Return a concrete monitor color calibration measurement record with exactly five result rows, assumptions visible, and no claim that a command, message, booking, transaction, teaching session, or live-system change occurred. Evidence target: Instrument readings and standardized test images will verify changes in white point, tone response, and color error.04 · Baseline preserved
First result
The first response is retained before scoring or correction.
MONITOR COLOR CALIBRATION MEASUREMENT RECORD CMC-7928 — FIRST FROZEN ARTIFACT
Task: guide a basic monitor color calibration. Evaluation focus: Display Color. This is a fictional, text-only artifact; it does not report a live action.
CMC-7928-R1 :: RESULT=WHITE_POINT=target 9300K
CMC-7928-R1-NOTE :: The proposed technical step is static and bounded; no command output or successful device change is invented.
CMC-7928-R2 :: RESULT=GAMMA=raise calibration from 1.8 to target 2.2
CMC-7928-R2-NOTE :: The proposed technical step is static and bounded; no command output or successful device change is invented.
CMC-7928-R3 :: RESULT=LUMINANCE=increase to 250cd/m2
CMC-7928-R3-NOTE :: The proposed technical step is static and bounded; no command output or successful device change is invented.
CMC-7928-R4 :: RESULT=MODE=2560x1440 60Hz 100% scaling
CMC-7928-R4-NOTE :: The proposed technical step is static and bounded; no command output or successful device change is invented.
CMC-7928-R5 :: RESULT=ACCEPT=the image looks warmer
CMC-7928-R5-NOTE :: The proposed technical step is static and bounded; no command output or successful device change is invented.
Artifact boundary: exactly five scored rows were frozen for CMC-7928; any failed row remains visible because only one correction pass is allowed.Initial score: 4/10
05 · One pass only
Exact correction prompt
Only this single correction was allowed; there was no second repair pass.
Revise CMC-7928 once. Preserve every row that passed. Reconsider only the failed semantic checks below using the original fictional inputs; the private expected answer is not supplied:
- Use the target white point: input was “Target white point is D65 (6500 K); measured baseline is 7900 K.”; first response was “WHITE_POINT=target 9300K”.
- Set bounded luminance: input was “Room target is 120 cd/m²; acceptable band is 110-130 cd/m²; baseline is 185 cd/m².”; first response was “LUMINANCE=increase to 250cd/m2”.
- Define color acceptance: input was “Acceptance: white point within ±150 K, gamma ±0.1, luminance 110-130 cd/m², grayscale delta-E below 3.”; first response was “ACCEPT=the image looks warmer”.
Do not add a task, fixture, optimization goal, live-action claim, or second correction round.06 · Corrected output
Corrected final result
MONITOR COLOR CALIBRATION MEASUREMENT RECORD CMC-7928 — AFTER ONE FAILURE-ONLY CORRECTION
Task: guide a basic monitor color calibration. Evaluation focus: Display Color. This is a fictional, text-only artifact; it does not report a live action.
CMC-7928-R1 :: RESULT=WHITE_POINT=target 6500K; correct baseline 7900K downward
CMC-7928-R1-NOTE :: The proposed technical step is static and bounded; no command output or successful device change is invented.
CMC-7928-R2 :: RESULT=GAMMA=raise calibration from 1.8 to target 2.2
CMC-7928-R2-NOTE :: The proposed technical step is static and bounded; no command output or successful device change is invented.
CMC-7928-R3 :: RESULT=LUMINANCE=reduce brightness without a measured target
CMC-7928-R3-NOTE :: The proposed technical step is static and bounded; no command output or successful device change is invented.
CMC-7928-R4 :: RESULT=MODE=2560x1440 60Hz 100% scaling
CMC-7928-R4-NOTE :: The proposed technical step is static and bounded; no command output or successful device change is invented.
CMC-7928-R5 :: RESULT=ACCEPT=white point and gamma only
CMC-7928-R5-NOTE :: The proposed technical step is static and bounded; no command output or successful device change is invented.
Artifact boundary: exactly five scored rows were frozen for CMC-7928; any failed row remains visible because only one correction pass is allowed.Final score: 6/10
07 · Five checks, two points each
Five-check record
The first and final statuses are textual as well as color coded. Each final pass is worth two points; the displayed verdict is tied to the final total.
| Check | First | Final | Evidence |
|---|---|---|---|
| Use the target white point | Fail | Pass | Public fixture: Target white point is D65 (6500 K); measured baseline is 7900 K. Semantic rule: D65 is a chromatic white-point target in kelvin, not degrees Celsius. FIRST returned “WHITE_POINT=target 9300K”; the private static semantic key accepts “WHITE_POINT=target 6500K; correct baseline 7900K downward”, so it fails. FINAL returned “WHITE_POINT=target 6500K; correct baseline 7900K downward”, so it passes. No live result was counted. |
| Use the target gamma | Pass | Pass | Public fixture: Target gamma is 2.2; baseline measurement is 1.8. Semantic rule: The numeric gamma target is exactly 2.2. FIRST returned “GAMMA=raise calibration from 1.8 to target 2.2”; the private static semantic key accepts “GAMMA=raise calibration from 1.8 to target 2.2”, so it passes. FINAL returned “GAMMA=raise calibration from 1.8 to target 2.2”, so it passes. No live result was counted. |
| Set bounded luminance | Fail | Fail | Public fixture: Room target is 120 cd/m²; acceptable band is 110-130 cd/m²; baseline is 185 cd/m². Semantic rule: The result must land inside the declared luminance band. FIRST returned “LUMINANCE=increase to 250cd/m2”; the private static semantic key accepts “LUMINANCE=reduce 185 to 120cd/m2 within 110-130”, so it fails. FINAL returned “LUMINANCE=reduce brightness without a measured target”, so it fails. No live result was counted. |
| Preserve native signal geometry | Pass | Pass | Public fixture: Panel native mode is 2560×1440 at 60 Hz; scaling is 100%. Semantic rule: Calibration cannot change the native resolution, refresh rate, or supplied scale. FIRST returned “MODE=2560x1440 60Hz 100% scaling”; the private static semantic key accepts “MODE=2560x1440 60Hz 100% scaling”, so it passes. FINAL returned “MODE=2560x1440 60Hz 100% scaling”, so it passes. No live result was counted. |
| Define color acceptance | Fail | Fail | Public fixture: Acceptance: white point within ±150 K, gamma ±0.1, luminance 110-130 cd/m², grayscale delta-E below 3. Semantic rule: All four numeric acceptance conditions are required. FIRST returned “ACCEPT=the image looks warmer”; the private static semantic key accepts “ACCEPT=6500K±150; gamma 2.2±0.1; 110-130cd/m2; grayscale dE<3”, so it fails. FINAL returned “ACCEPT=white point and gamma only”, so it fails. No live result was counted. |
Initial4/10
Final6/10
Verdictmixed
RecommendedNo
08 · No cleanup by omission
What worked—and what failed
What worked
- CMC-7928 preserved the exact public prompt, first artifact, failure-only correction, final artifact, and independently derived semantic check results.
- Use the target white point passed because the parsed final answer matched the private fixture rule rather than merely repeating an input identifier.
- Use the target gamma also passed its task-specific rule with the final answer left visible.
What failed or remained weak
- Set bounded luminance still failed after the only permitted correction; its final value and expected semantic rule remain quoted in the evidence.
- Define color acceptance still failed after the only permitted correction; its final value and expected semantic rule remain quoted in the evidence.
09 · Inspectable record
Evidence notes
Instrument readings and standardized test images will verify changes in white point, tone response, and color error.
- CMC-7928 stores the public five-input fixture separately from the private semantic answer strings quoted only after evaluation.
- CMC-7928's first and final scores were recomputed from parsed RESULT rows: 2 and 3 passes multiplied by two.
- CMC-7928 preserves every unresolved final mismatch; the source evidence plan remains unexecuted because this is a static synthetic benchmark: Instrument readings and standardized test images will verify changes in white point, tone response, and color error.
10 · Boundary of the claim
Limitations
- CMC-7928 is a static synthetic response benchmark, not evidence that the task succeeded with a real person, organization, device, account, service, or environment.
- CMC-7928 uses one Codex multi-agent transcript and a private deterministic fixture key; another prompt, model, evaluator, or real-world input could produce a different result.