Topic 03 · Completed field tests
Completed tests of AI for installing software, writing code, and troubleshooting concrete computer problems.
Published evidence
Every case is clickable. Synthetic records disclose their generated inputs, Codex multi-agent run, honest model disclosure, checks, and evidence limits.
Completed field testSynthetic benchmark
This completed synthetic Incident Evidence field test asked the session to preserve useful evidence after a security alert, preserved an actual five-row incident evidence chain-of-custody ledger, and derived 6/10 then 10/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic File Cleanup field test asked the session to find duplicate files without deleting originals, preserved an actual five-row duplicate file classification audit, and derived 0/10 then 4/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic Sync Conflict Recovery field test asked the session to resolve file-sync conflicts without losing valid edits, preserved an actual five-row file-sync conflict resolution ledger, and derived 2/10 then 6/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic Credential Hygiene field test asked the session to plan a safe password-vault migration, preserved an actual five-row password-vault migration reconciliation, and derived 4/10 then 8/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic Disk Encryption field test asked the session to enable full-disk encryption without data loss, preserved an actual five-row full-disk encryption safety runbook, and derived 0/10 then 4/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic Account Recovery field test asked the session to guide recovery of a locked local account, preserved an actual five-row authorized local-account recovery plan, and derived 2/10 then 8/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic Accessibility Inspection field test asked the session to verify that an interface accessibility tree matches its visual controls, preserved an actual five-row visual-to-accessibility tree audit, and derived 2/10 then 6/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic Data Recovery field test asked the session to guide recovery of accidentally deleted photos, preserved an actual five-row deleted photo recovery ledger, and derived 2/10 then 6/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic Boot Recovery field test asked the session to repair a broken boot configuration, preserved an actual five-row virtual boot repair decision log, and derived 4/10 then 6/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic Wireless Planning field test asked the session to plan Wi-Fi channels and power levels for a crowded office floor, preserved an actual five-row office wi-fi channel and power plan, and derived 4/10 then 8/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic Bluetooth Audio field test asked the session to troubleshoot distorted bluetooth audio, preserved an actual five-row bluetooth audio fault-isolation log, and derived 4/10 then 8/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic CPU Performance field test asked the session to diagnose unexplained high cpu usage, preserved an actual five-row high-cpu causal trace, and derived 0/10 then 6/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic Asset Inventory field test asked the session to create a privacy-conscious home network inventory, preserved an actual five-row privacy-minimized home network inventory, and derived 4/10 then 6/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic OS Installation field test asked the session to plan a clean operating system reinstall, preserved an actual five-row clean os reinstall runbook, and derived 6/10 then 10/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic Threat Triage field test asked the session to assess a malware warning without running the file, preserved an actual five-row inert-file malware-warning triage, and derived 6/10 then 10/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic Router Hardening field test asked the session to harden a home router while preserving required device connectivity, preserved an actual five-row router hardening and legacy-compatibility matrix, and derived 4/10 then 8/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic Memory Debugging field test asked the session to debug a reproducible memory leak, preserved an actual five-row software patch and test record, and derived 2/10 then 6/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic Power Resilience field test asked the session to configure an orderly shutdown during a power failure, preserved an actual five-row ups shutdown policy and simulation matrix, and derived 0/10 then 6/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic Keyboard Access field test asked the session to audit desktop keyboard navigation, preserved an actual five-row desktop keyboard navigation trace, and derived 6/10 then 10/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic System Auditing field test asked the session to audit unexpected scheduled tasks defensively, preserved an actual five-row scheduled-task defensive classification, and derived 0/10 then 10/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic File Repair field test asked the session to repair a corrupted office document, preserved an actual five-row corrupted document repair report, and derived 4/10 then 6/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic Query Performance field test asked the session to triage a slow SQL query using a supplied execution plan, preserved an actual five-row software patch and test record, and derived 6/10 then 10/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic Log Management field test asked the session to configure reliable log rotation, preserved an actual five-row service log rotation specification, and derived 0/10 then 6/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic File Permissions field test asked the session to set least-privilege shared-folder permissions, preserved an actual five-row shared-folder least-privilege matrix, and derived 4/10 then 8/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic Refactoring field test asked the session to refactor a fragile legacy script, preserved an actual five-row legacy script refactor diff, and derived 0/10 then 2/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic Container Inspection field test asked the session to check a container image for seeded secrets and risky defaults, preserved an actual five-row container secret and defaults audit, and derived 6/10 then 10/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic Version Control field test asked the session to resolve a complex merge conflict correctly, preserved an actual five-row three-way merge resolution record, and derived 2/10 then 8/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic Attachment Safety field test asked the session to triage a suspicious email attachment safely, preserved an actual five-row suspicious attachment static triage record, and derived 6/10 then 10/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic Kernel Diagnostics field test asked the session to diagnose a kernel panic from a bounded evidence packet, preserved an actual five-row kernel panic causal analysis, and derived 4/10 then 10/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic Display Color field test asked the session to guide a basic monitor color calibration, preserved an actual five-row monitor color calibration measurement record, and derived 4/10 then 6/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic Portability field test asked the session to port a shell automation between operating systems, preserved an actual five-row cross-platform shell portability matrix, and derived 0/10 then 6/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic Bug Reproduction field test asked the session to reproduce an environment-specific software bug, preserved an actual five-row environment-specific bug matrix, and derived 4/10 then 10/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic Restore Testing field test asked the session to build a repeatable backup restore drill for a small service, preserved an actual five-row service restore drill record, and derived 4/10 then 10/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic Router Security field test asked the session to harden a home router safely, preserved an actual five-row home router hardening audit, and derived 4/10 then 8/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic Storage Devices field test asked the session to troubleshoot an external drive that will not mount, preserved an actual five-row external-drive non-destructive diagnosis, and derived 6/10 then 10/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic Software Integrity field test asked the session to verify that a software download is authentic, preserved an actual five-row software download authenticity verdict, and derived 0/10 then 10/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic Startup Performance field test asked the session to reduce a computer's startup delay, preserved an actual five-row startup delay prioritization ledger, and derived 2/10 then 8/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic Permission Auditing field test asked the session to audit browser extension permissions against declared functionality, preserved an actual five-row extension feature-to-permission audit, and derived 0/10 then 6/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic Crash Analysis field test asked the session to explain a kernel crash report, preserved an actual five-row kernel crash report analysis, and derived 4/10 then 6/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic Secret Detection field test asked the session to find exposed secrets in a sample repository, preserved an actual five-row seeded repository secret-detection report, and derived 4/10 then 10/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic Backup Testing field test asked the session to automate backup verification, preserved an actual five-row read-only backup verification matrix, and derived 4/10 then 8/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic Browser Hygiene field test asked the session to remove unwanted browser notification spam, preserved an actual five-row browser notification permission cleanup, and derived 2/10 then 6/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic Version-Control Recovery field test asked the session to recover a corrupted Git branch without overwriting healthy history, preserved an actual five-row reversible git branch recovery plan, and derived 0/10 then 8/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic Battery Life field test asked the session to extend laptop battery life without crippling usability, preserved an actual five-row laptop battery usability trial, and derived 0/10 then 4/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic Account Security field test asked the session to configure a safer everyday user account, preserved an actual five-row least-privilege account access matrix, and derived 0/10 then 4/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic Visual Access field test asked the session to design a readable high-contrast terminal theme, preserved an actual five-row high-contrast terminal theme specification, and derived 6/10 then 10/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic DNS Filtering field test asked the session to configure family-safe dns filtering, preserved an actual five-row family dns filter policy, and derived 0/10 then 2/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic Photo Organization field test asked the session to organize a photo library without moving the originals, preserved an actual five-row read-only photo catalog, and derived 4/10 then 8/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic Dependencies field test asked the session to resolve a software dependency conflict, preserved an actual five-row dependency resolution lock report, and derived 2/10 then 6/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic Rate-Limit Testing field test asked the session to design a rate-limit test for bursty API traffic, preserved an actual five-row tiered api rate-limit test matrix, and derived 0/10 then 8/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic Device Privacy field test asked the session to lock down camera and microphone access, preserved an actual five-row camera and microphone permission matrix, and derived 6/10 then 10/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic Firmware field test asked the session to plan a low-risk firmware update, preserved an actual five-row firmware update safety checklist, and derived 0/10 then 4/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic Database Migration field test asked the session to plan a zero-downtime database migration with a safe rollback, preserved an actual five-row zero-downtime migration traffic and rollback plan, and derived 0/10 then 6/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic Data Disposal field test asked the session to plan verifiable data removal from a retired drive, preserved an actual five-row retired-drive sanitization decision record, and derived 4/10 then 8/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic Wi-Fi field test asked the session to diagnose intermittent wi-fi drops, preserved an actual five-row wi-fi drop diagnostic record, and derived 4/10 then 8/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic Supply Chain field test asked the session to inventory a project's software components, preserved an actual five-row software bill of materials audit, and derived 4/10 then 10/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic App Packaging field test asked the session to package a command-line application for clean installation, preserved an actual five-row cli package lifecycle record, and derived 0/10 then 4/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic Backups field test asked the session to design a backup that can actually be restored, preserved an actual five-row restorable backup design, and derived 0/10 then 4/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic TLS Diagnosis field test asked the session to debug a certificate-chain failure that affects one client, preserved an actual five-row tls chain diagnostic record, and derived 2/10 then 10/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic Time Sync field test asked the session to diagnose and correct computer clock drift, preserved an actual five-row performance hypothesis and measurement record, and derived 4/10 then 6/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic Dev Environments field test asked the session to build a reproducible development environment, preserved an actual five-row reproducible development environment manifest, and derived 2/10 then 6/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic Profile Migration field test asked the session to migrate a browser profile between computers, preserved an actual five-row browser profile migration manifest, and derived 6/10 then 10/10 from task-specific semantic checks after one failure-only correction.
Completed field testSynthetic benchmark
This completed synthetic Screen Readers field test asked the session to fix missing screen-reader labels in a desktop app, preserved an actual five-row screen-reader label repair matrix, and derived 0/10 then 2/10 from task-specific semantic checks after one failure-only correction.