{
  "category": "computers",
  "slug": "computers-inventory-home-network",
  "title": "AI and the Privacy-Conscious Home Network Inventory: The Correction Reached 6/10",
  "task": "create a privacy-conscious home network inventory",
  "excerpt": "This completed synthetic Asset Inventory field test asked the session to create a privacy-conscious home network inventory, preserved an actual five-row privacy-minimized home network inventory, and derived 4/10 then 6/10 from task-specific semantic checks after one failure-only correction.",
  "tool": "Codex multi-agent session",
  "model": "Exact underlying model identifier not disclosed by the Codex session",
  "publishedAt": "2026-07-21T14:00:00+08:00",
  "durationMinutes": 0,
  "testMode": "Synthetic benchmark",
  "inputDisclosure": "All inputs in IHN-1115 are fictional and appear verbatim in the exact prompt. Hidden scoring answers were not shown to the response generator. No personal, production, customer, learner, or device data was used. Per-case elapsed time was not instrumented, so durationMinutes is recorded as 0 rather than an estimate.",
  "runDisclosure": "A Codex multi-agent session generated one text-only first artifact for “create a privacy-conscious home network inventory”. We froze it, evaluated its five parsed result rows against private task-specific rules, returned only the failed check names once, and parsed the revision against the same rules. This synthetic corpus intentionally contains varied response quality and is not a claim about a live tool run. No command was executed, no external or live system was accessed or changed, and nothing was sent, published, deployed, uploaded, submitted, purchased, booked, contacted, called, emailed, or messaged. No external, live, or production action occurred. Per-case elapsed time was not instrumented during the batch session.",
  "prompt": "Complete a bounded synthetic field test for: create a privacy-conscious home network inventory. Focus: Asset Inventory.\nSource scenario: The experiment will supply sanitized discovery data and ask AI to identify devices without contacting outside services.\nUse only these five public fictional inputs; the scoring answers are intentionally withheld:\nIHN-1115-I1: Lease R1 has 192.0.2.1, MAC prefix 02:00:00, hostname gateway, and role default route.\nIHN-1115-I2: Lease U7 at 192.0.2.77 has randomized MAC, no hostname, and only mDNS type _airplay._tcp.\nIHN-1115-I3: DHCP D4 and ARP A9 share MAC 02:11:22:33:44:55 and address 192.0.2.44 within one minute.\nIHN-1115-I4: Policy permits local lease, ARP, and mDNS fields; it forbids external vendor lookup and stored browsing history.\nIHN-1115-I5: Ground truth has router 1, computers 2, phones 3, printer 1, media endpoints 2, and unknown 1.\nReturn a concrete privacy-minimized home network inventory with exactly five result rows, assumptions visible, and no claim that a command, message, booking, transaction, teaching session, or live-system change occurred. Evidence target: A ground-truth device list will verify identification accuracy, uncertainty labels, and data minimization.",
  "firstResult": "PRIVACY-MINIMIZED HOME NETWORK INVENTORY IHN-1115 — FIRST FROZEN ARTIFACT\nTask: create a privacy-conscious home network inventory. Evaluation focus: Asset Inventory. This is a fictional, text-only artifact; it does not report a live action.\nIHN-1115-R1 :: RESULT=R1=smart television based on MAC prefix alone\nIHN-1115-R1-NOTE :: The proposed technical step is static and bounded; no command output or successful device change is invented.\nIHN-1115-R2 :: RESULT=U7=probable media endpoint; confidence low; evidence _airplay._tcp\nIHN-1115-R2-NOTE :: The proposed technical step is static and bounded; no command output or successful device change is invented.\nIHN-1115-R3 :: RESULT=MERGE=count D4 and A9 as two devices\nIHN-1115-R3-NOTE :: The proposed technical step is static and bounded; no command output or successful device change is invented.\nIHN-1115-R4 :: RESULT=PRIVACY=use DHCP+ARP+mDNS only; no vendor lookup; no browsing history\nIHN-1115-R4-NOTE :: The proposed technical step is static and bounded; no command output or successful device change is invented.\nIHN-1115-R5 :: RESULT=TOTAL=11 devices after double-counting D4 and A9\nIHN-1115-R5-NOTE :: The proposed technical step is static and bounded; no command output or successful device change is invented.\nArtifact boundary: exactly five scored rows were frozen for IHN-1115; any failed row remains visible because only one correction pass is allowed.",
  "correctionPrompt": "Revise IHN-1115 once. Preserve every row that passed. Reconsider only the failed semantic checks below using the original fictional inputs; the private expected answer is not supplied:\n- Identify the router from local evidence: input was “Lease R1 has 192.0.2.1, MAC prefix 02:00:00, hostname gateway, and role default route.”; first response was “R1=smart television based on MAC prefix alone”.\n- Merge duplicate observations: input was “DHCP D4 and ARP A9 share MAC 02:11:22:33:44:55 and address 192.0.2.44 within one minute.”; first response was “MERGE=count D4 and A9 as two devices”.\n- Reconcile the ground-truth count: input was “Ground truth has router 1, computers 2, phones 3, printer 1, media endpoints 2, and unknown 1.”; first response was “TOTAL=11 devices after double-counting D4 and A9”.\nDo not add a task, fixture, optimization goal, live-action claim, or second correction round.",
  "finalResult": "PRIVACY-MINIMIZED HOME NETWORK INVENTORY IHN-1115 — AFTER ONE FAILURE-ONLY CORRECTION\nTask: create a privacy-conscious home network inventory. Evaluation focus: Asset Inventory. This is a fictional, text-only artifact; it does not report a live action.\nIHN-1115-R1 :: RESULT=R1=router; 192.0.2.1; evidence default-route+gateway hostname\nIHN-1115-R1-NOTE :: The proposed technical step is static and bounded; no command output or successful device change is invented.\nIHN-1115-R2 :: RESULT=U7=probable media endpoint; confidence low; evidence _airplay._tcp\nIHN-1115-R2-NOTE :: The proposed technical step is static and bounded; no command output or successful device change is invented.\nIHN-1115-R3 :: RESULT=MERGE=D4+A9 one device at 192.0.2.44\nIHN-1115-R3-NOTE :: The proposed technical step is static and bounded; no command output or successful device change is invented.\nIHN-1115-R4 :: RESULT=PRIVACY=use DHCP+ARP+mDNS only; no vendor lookup; no browsing history\nIHN-1115-R4-NOTE :: The proposed technical step is static and bounded; no command output or successful device change is invented.\nIHN-1115-R5 :: RESULT=TOTAL=10 devices; router1; computers2; phones3; printer1; media2\nIHN-1115-R5-NOTE :: The proposed technical step is static and bounded; no command output or successful device change is invented.\nArtifact boundary: exactly five scored rows were frozen for IHN-1115; any failed row remains visible because only one correction pass is allowed.",
  "checks": [
    {
      "name": "Identify the router from local evidence",
      "firstPass": false,
      "finalPass": true,
      "evidence": "Public fixture: Lease R1 has 192.0.2.1, MAC prefix 02:00:00, hostname gateway, and role default route. Semantic rule: The default-route role and local hostname support router classification without external lookup. FIRST returned “R1=smart television based on MAC prefix alone”; the private static semantic key accepts “R1=router; 192.0.2.1; evidence default-route+gateway hostname”, so it fails. FINAL returned “R1=router; 192.0.2.1; evidence default-route+gateway hostname”, so it passes. No live result was counted."
    },
    {
      "name": "Label an uncertain device honestly",
      "firstPass": true,
      "finalPass": true,
      "evidence": "Public fixture: Lease U7 at 192.0.2.77 has randomized MAC, no hostname, and only mDNS type _airplay._tcp. Semantic rule: Sparse local service evidence supports a bounded role guess, not a vendor identity. FIRST returned “U7=probable media endpoint; confidence low; evidence _airplay._tcp”; the private static semantic key accepts “U7=probable media endpoint; confidence low; evidence _airplay._tcp”, so it passes. FINAL returned “U7=probable media endpoint; confidence low; evidence _airplay._tcp”, so it passes. No live result was counted."
    },
    {
      "name": "Merge duplicate observations",
      "firstPass": false,
      "finalPass": false,
      "evidence": "Public fixture: DHCP D4 and ARP A9 share MAC 02:11:22:33:44:55 and address 192.0.2.44 within one minute. Semantic rule: Matching local identifiers and time window require one inventory row with provenance preserved. FIRST returned “MERGE=count D4 and A9 as two devices”; the private static semantic key accepts “MERGE=D4+A9 one device at 192.0.2.44; retain both timestamps”, so it fails. FINAL returned “MERGE=D4+A9 one device at 192.0.2.44”, so it fails. No live result was counted."
    },
    {
      "name": "Exclude private or external enrichment",
      "firstPass": true,
      "finalPass": true,
      "evidence": "Public fixture: Policy permits local lease, ARP, and mDNS fields; it forbids external vendor lookup and stored browsing history. Semantic rule: The experiment's inventory boundary explicitly excludes external contact and unrelated personal data. FIRST returned “PRIVACY=use DHCP+ARP+mDNS only; no vendor lookup; no browsing history”; the private static semantic key accepts “PRIVACY=use DHCP+ARP+mDNS only; no vendor lookup; no browsing history”, so it passes. FINAL returned “PRIVACY=use DHCP+ARP+mDNS only; no vendor lookup; no browsing history”, so it passes. No live result was counted."
    },
    {
      "name": "Reconcile the ground-truth count",
      "firstPass": false,
      "finalPass": false,
      "evidence": "Public fixture: Ground truth has router 1, computers 2, phones 3, printer 1, media endpoints 2, and unknown 1. Semantic rule: The category counts sum to ten after the declared duplicate merge. FIRST returned “TOTAL=11 devices after double-counting D4 and A9”; the private static semantic key accepts “TOTAL=10 devices; router1; computers2; phones3; printer1; media2; unknown1”, so it fails. FINAL returned “TOTAL=10 devices; router1; computers2; phones3; printer1; media2”, so it fails. No live result was counted."
    }
  ],
  "initialScore": 4,
  "score": 6,
  "verdict": "mixed",
  "recommended": false,
  "whatWorked": [
    "IHN-1115 preserved the exact public prompt, first artifact, failure-only correction, final artifact, and independently derived semantic check results.",
    "Identify the router from local evidence passed because the parsed final answer matched the private fixture rule rather than merely repeating an input identifier.",
    "Label an uncertain device honestly also passed its task-specific rule with the final answer left visible."
  ],
  "whatFailed": [
    "Merge duplicate observations still failed after the only permitted correction; its final value and expected semantic rule remain quoted in the evidence.",
    "Reconcile the ground-truth count still failed after the only permitted correction; its final value and expected semantic rule remain quoted in the evidence."
  ],
  "evidencePlan": "A ground-truth device list will verify identification accuracy, uncertainty labels, and data minimization.",
  "evidenceNotes": [
    "IHN-1115 stores the public five-input fixture separately from the private semantic answer strings quoted only after evaluation.",
    "IHN-1115's first and final scores were recomputed from parsed RESULT rows: 2 and 3 passes multiplied by two.",
    "IHN-1115 preserves every unresolved final mismatch; the source evidence plan remains unexecuted because this is a static synthetic benchmark: A ground-truth device list will verify identification accuracy, uncertainty labels, and data minimization."
  ],
  "limitations": [
    "IHN-1115 is a static synthetic response benchmark, not evidence that the task succeeded with a real person, organization, device, account, service, or environment.",
    "IHN-1115 uses one Codex multi-agent transcript and a private deterministic fixture key; another prompt, model, evaluator, or real-world input could produce a different result."
  ]
}