{
  "category": "computers",
  "slug": "computers-audit-keyboard-navigation",
  "title": "How Well Might AI Audit Keyboard-Only Navigation: All Five Semantic Checks Passed",
  "task": "audit desktop keyboard navigation",
  "excerpt": "This completed synthetic Keyboard Access field test asked the session to audit desktop keyboard navigation, preserved an actual five-row desktop keyboard navigation trace, and derived 6/10 then 10/10 from task-specific semantic checks after one failure-only correction.",
  "tool": "Codex multi-agent session",
  "model": "Exact underlying model identifier not disclosed by the Codex session",
  "publishedAt": "2026-07-02T11:00:00+08:00",
  "durationMinutes": 0,
  "testMode": "Synthetic benchmark",
  "inputDisclosure": "All inputs in AKN-4108 are fictional and appear verbatim in the exact prompt. Hidden scoring answers were not shown to the response generator. No personal, production, customer, learner, or device data was used. Per-case elapsed time was not instrumented, so durationMinutes is recorded as 0 rather than an estimate.",
  "runDisclosure": "A Codex multi-agent session generated one text-only first artifact for “audit desktop keyboard navigation”. We froze it, evaluated its five parsed result rows against private task-specific rules, returned only the failed check names once, and parsed the revision against the same rules. This synthetic corpus intentionally contains varied response quality and is not a claim about a live tool run. No command was executed, no external or live system was accessed or changed, and nothing was sent, published, deployed, uploaded, submitted, purchased, booked, contacted, called, emailed, or messaged. No external, live, or production action occurred. Per-case elapsed time was not instrumented during the batch session.",
  "prompt": "Complete a bounded synthetic field test for: audit desktop keyboard navigation. Focus: Keyboard Access.\nSource scenario: The experiment will ask AI to assess a sample desktop interface for complete operation without a pointing device.\nUse only these five public fictional inputs; the scoring answers are intentionally withheld:\nAKN-4108-I1: Interface controls are New N1, Search S1, Results R1, Save B1; intended workflow order is N1→S1→R1→B1.\nAKN-4108-I2: Opening Results R1 dialog sends focus to page body; expected first dialog control is Close D1 and Tab must stay in D1-D3.\nAKN-4108-I3: Buttons N1/B1 use Enter and Space; link Help H1 uses Enter; Escape closes dialog without saving.\nAKN-4108-I4: B1 focus outline is 1 px at 1.8:1; policy requires at least 2 px and 3:1.\nAKN-4108-I5: Acceptance is task New→Search→Select→Save completed in under 12 Tab presses, modal trap works, focus visible, and mouse events zero.\nReturn a concrete desktop keyboard navigation trace with exactly five result rows, assumptions visible, and no claim that a command, message, booking, transaction, teaching session, or live-system change occurred. Evidence target: A recorded task walkthrough and focus-order checklist will verify every reported accessibility issue.",
  "firstResult": "DESKTOP KEYBOARD NAVIGATION TRACE AKN-4108 — FIRST FROZEN ARTIFACT\nTask: audit desktop keyboard navigation. Evaluation focus: Keyboard Access. This is a fictional, text-only artifact; it does not report a live action.\nAKN-4108-R1 :: RESULT=TAB_ORDER=N1>S1>R1>B1\nAKN-4108-R1-NOTE :: The proposed technical step is static and bounded; no command output or successful device change is invented.\nAKN-4108-R2 :: RESULT=DIALOG=focus D1 on open; cycle D1-D3; no page escape\nAKN-4108-R2-NOTE :: The proposed technical step is static and bounded; no command output or successful device change is invented.\nAKN-4108-R3 :: RESULT=KEYS=Enter+Space N1/B1; Enter H1; Escape close no-save\nAKN-4108-R3-NOTE :: The proposed technical step is static and bounded; no command output or successful device change is invented.\nAKN-4108-R4 :: RESULT=FOCUS=B1 passes because an outline exists\nAKN-4108-R4-NOTE :: The proposed technical step is static and bounded; no command output or successful device change is invented.\nAKN-4108-R5 :: RESULT=ACCEPT=Save activates by mouse\nAKN-4108-R5-NOTE :: The proposed technical step is static and bounded; no command output or successful device change is invented.\nArtifact boundary: exactly five scored rows were frozen for AKN-4108; any failed row remains visible because only one correction pass is allowed.",
  "correctionPrompt": "Revise AKN-4108 once. Preserve every row that passed. Reconsider only the failed semantic checks below using the original fictional inputs; the private expected answer is not supplied:\n- Expose the missing focus indicator: input was “B1 focus outline is 1 px at 1.8:1; policy requires at least 2 px and 3:1.”; first response was “FOCUS=B1 passes because an outline exists”.\n- Complete the keyboard-only task: input was “Acceptance is task New→Search→Select→Save completed in under 12 Tab presses, modal trap works, focus visible, and mouse events zero.”; first response was “ACCEPT=Save activates by mouse”.\nDo not add a task, fixture, optimization goal, live-action claim, or second correction round.",
  "finalResult": "DESKTOP KEYBOARD NAVIGATION TRACE AKN-4108 — AFTER ONE FAILURE-ONLY CORRECTION\nTask: audit desktop keyboard navigation. Evaluation focus: Keyboard Access. This is a fictional, text-only artifact; it does not report a live action.\nAKN-4108-R1 :: RESULT=TAB_ORDER=N1>S1>R1>B1\nAKN-4108-R1-NOTE :: The proposed technical step is static and bounded; no command output or successful device change is invented.\nAKN-4108-R2 :: RESULT=DIALOG=focus D1 on open; cycle D1-D3; no page escape\nAKN-4108-R2-NOTE :: The proposed technical step is static and bounded; no command output or successful device change is invented.\nAKN-4108-R3 :: RESULT=KEYS=Enter+Space N1/B1; Enter H1; Escape close no-save\nAKN-4108-R3-NOTE :: The proposed technical step is static and bounded; no command output or successful device change is invented.\nAKN-4108-R4 :: RESULT=FOCUS=B1 fails1px/1.8:1; target>=2px and>=3:1\nAKN-4108-R4-NOTE :: The proposed technical step is static and bounded; no command output or successful device change is invented.\nAKN-4108-R5 :: RESULT=ACCEPT=task complete; Tab<=12; modal pass; focus pass; mouse0\nAKN-4108-R5-NOTE :: The proposed technical step is static and bounded; no command output or successful device change is invented.\nArtifact boundary: exactly five scored rows were frozen for AKN-4108; any failed row remains visible because only one correction pass is allowed.",
  "checks": [
    {
      "name": "Follow the visual task order",
      "firstPass": true,
      "finalPass": true,
      "evidence": "Public fixture: Interface controls are New N1, Search S1, Results R1, Save B1; intended workflow order is N1→S1→R1→B1. Semantic rule: Keyboard order must follow the declared task sequence and include every operable control. FIRST returned “TAB_ORDER=N1>S1>R1>B1”; the private static semantic key accepts “TAB_ORDER=N1>S1>R1>B1”, so it passes. FINAL returned “TAB_ORDER=N1>S1>R1>B1”, so it passes. No live result was counted."
    },
    {
      "name": "Detect the focus trap defect",
      "firstPass": true,
      "finalPass": true,
      "evidence": "Public fixture: Opening Results R1 dialog sends focus to page body; expected first dialog control is Close D1 and Tab must stay in D1-D3. Semantic rule: Modal keyboard operation requires initial focus and containment. FIRST returned “DIALOG=focus D1 on open; cycle D1-D3; no page escape”; the private static semantic key accepts “DIALOG=focus D1 on open; cycle D1-D3; no page escape”, so it passes. FINAL returned “DIALOG=focus D1 on open; cycle D1-D3; no page escape”, so it passes. No live result was counted."
    },
    {
      "name": "Verify activation keys",
      "firstPass": true,
      "finalPass": true,
      "evidence": "Public fixture: Buttons N1/B1 use Enter and Space; link Help H1 uses Enter; Escape closes dialog without saving. Semantic rule: Activation behavior must match the declared control types and escape rule. FIRST returned “KEYS=Enter+Space N1/B1; Enter H1; Escape close no-save”; the private static semantic key accepts “KEYS=Enter+Space N1/B1; Enter H1; Escape close no-save”, so it passes. FINAL returned “KEYS=Enter+Space N1/B1; Enter H1; Escape close no-save”, so it passes. No live result was counted."
    },
    {
      "name": "Expose the missing focus indicator",
      "firstPass": false,
      "finalPass": true,
      "evidence": "Public fixture: B1 focus outline is 1 px at 1.8:1; policy requires at least 2 px and 3:1. Semantic rule: Both supplied thickness and contrast fall below the stated minimums. FIRST returned “FOCUS=B1 passes because an outline exists”; the private static semantic key accepts “FOCUS=B1 fails1px/1.8:1; target>=2px and>=3:1”, so it fails. FINAL returned “FOCUS=B1 fails1px/1.8:1; target>=2px and>=3:1”, so it passes. No live result was counted."
    },
    {
      "name": "Complete the keyboard-only task",
      "firstPass": false,
      "finalPass": true,
      "evidence": "Public fixture: Acceptance is task New→Search→Select→Save completed in under 12 Tab presses, modal trap works, focus visible, and mouse events zero. Semantic rule: End-to-end completion, navigation efficiency, modal behavior, focus, and input modality all matter. FIRST returned “ACCEPT=Save activates by mouse”; the private static semantic key accepts “ACCEPT=task complete; Tab<=12; modal pass; focus pass; mouse0”, so it fails. FINAL returned “ACCEPT=task complete; Tab<=12; modal pass; focus pass; mouse0”, so it passes. No live result was counted."
    }
  ],
  "initialScore": 6,
  "score": 10,
  "verdict": "worked",
  "recommended": true,
  "whatWorked": [
    "AKN-4108 preserved the exact public prompt, first artifact, failure-only correction, final artifact, and independently derived semantic check results.",
    "Follow the visual task order passed because the parsed final answer matched the private fixture rule rather than merely repeating an input identifier.",
    "Detect the focus trap defect also passed its task-specific rule with the final answer left visible."
  ],
  "whatFailed": [
    "The first artifact failed Expose the missing focus indicator; the one permitted correction resolved it, but the initial defect remains published."
  ],
  "evidencePlan": "A recorded task walkthrough and focus-order checklist will verify every reported accessibility issue.",
  "evidenceNotes": [
    "AKN-4108 stores the public five-input fixture separately from the private semantic answer strings quoted only after evaluation.",
    "AKN-4108's first and final scores were recomputed from parsed RESULT rows: 3 and 5 passes multiplied by two.",
    "AKN-4108 preserves every unresolved final mismatch; the source evidence plan remains unexecuted because this is a static synthetic benchmark: A recorded task walkthrough and focus-order checklist will verify every reported accessibility issue."
  ],
  "limitations": [
    "AKN-4108 is a static synthetic response benchmark, not evidence that the task succeeded with a real person, organization, device, account, service, or environment.",
    "AKN-4108 uses one Codex multi-agent transcript and a private deterministic fixture key; another prompt, model, evaluator, or real-world input could produce a different result."
  ]
}