Completed field testSynthetic benchmark
Computers · Evidence record
An AI Wi-Fi Channel Plan for a Crowded Floor: One Verified Gap Remained
This completed synthetic Wireless Planning field test asked the session to plan Wi-Fi channels and power levels for a crowded office floor, preserved an actual five-row office wi-fi channel and power plan, and derived 4/10 then 8/10 from task-specific semantic checks after one failure-only correction.
- Exact prompts and outputs
- One correction only
- Synthetic inputs disclosed
01 · The assignment
The task
plan Wi-Fi channels and power levels for a crowded office floor
02 · Scope before score
Test disclosures
Input disclosure
All inputs in PWCL-5454 are fictional and appear verbatim in the exact prompt. Hidden scoring answers were not shown to the response generator. No personal, production, customer, learner, or device data was used. Per-case elapsed time was not instrumented, so durationMinutes is recorded as 0 rather than an estimate.
Run disclosure
A Codex multi-agent session generated one text-only first artifact for “plan Wi-Fi channels and power levels for a crowded office floor”. We froze it, evaluated its five parsed result rows against private task-specific rules, returned only the failed check names once, and parsed the revision against the same rules. This synthetic corpus intentionally contains varied response quality and is not a claim about a live tool run. No command was executed, no external or live system was accessed or changed, and nothing was sent, published, deployed, uploaded, submitted, purchased, booked, contacted, called, emailed, or messaged. No external, live, or production action occurred. Per-case elapsed time was not instrumented during the batch session.
- Evidence mode
- Synthetic benchmark
- Run environment
- Codex multi-agent session
- Model disclosure
- Exact underlying model identifier not disclosed by the Codex session
03 · Verbatim input
Exact first prompt
The recorded session received the following prompt without silent additions.
Complete a bounded synthetic field test for: plan Wi-Fi channels and power levels for a crowded office floor. Focus: Wireless Planning.
Source scenario: The experiment will provide a synthetic floor plan, access-point inventory, neighboring scans, client density, band support, and fixed coverage goals.
Use only these five public fictional inputs; the scoring answers are intentionally withheld:
PWCL-5454-I1: AP1, AP2, and AP3 overlap in one corridor; allowed 20 MHz channels are 1, 6, and 11.
PWCL-5454-I2: Neighbor scan shows channel 36 at -48 dBm near AP1; channels 44 and 149 are clear; AP1 clients support both.
PWCL-5454-I3: Scanner S7 supports 2.4 GHz only in warehouse zone Z3; AP3 must cover Z3 at at least -67 dBm.
PWCL-5454-I4: Simulator predicts AP1/AP2 overlap at -58 dBm with 20 dBm power and -69 dBm with 14 dBm; target overlap is at most -67 dBm.
PWCL-5454-I5: Pass requires all desk points at least -67 dBm, corridor overlap at most -67 dBm, scanner S7 connected, and channel utilization under 45%.
Return a concrete office wi-fi channel and power plan with exactly five result rows, assumptions visible, and no claim that a command, message, booking, transaction, teaching session, or live-system change occurred. Evidence target: A radio-planning simulator and rule audit will verify overlap, co-channel contention, coverage, client compatibility, and stated assumptions.04 · Baseline preserved
First result
The first response is retained before scoring or correction.
OFFICE WI-FI CHANNEL AND POWER PLAN PWCL-5454 — FIRST FROZEN ARTIFACT
Task: plan Wi-Fi channels and power levels for a crowded office floor. Evaluation focus: Wireless Planning. This is a fictional, text-only artifact; it does not report a live action.
PWCL-5454-R1 :: RESULT=2G=AP1 ch1; AP2 ch6; AP3 ch11; width20MHz
PWCL-5454-R1-NOTE :: The proposed technical step is static and bounded; no command output or successful device change is invented.
PWCL-5454-R2 :: RESULT=AP1_5G=channel36 at maximum power
PWCL-5454-R2-NOTE :: The proposed technical step is static and bounded; no command output or successful device change is invented.
PWCL-5454-R3 :: RESULT=Z3=retain AP3 2.4GHz; target RSSI>=-67dBm for S7
PWCL-5454-R3-NOTE :: The proposed technical step is static and bounded; no command output or successful device change is invented.
PWCL-5454-R4 :: RESULT=POWER=20dBm on both for maximum coverage
PWCL-5454-R4-NOTE :: The proposed technical step is static and bounded; no command output or successful device change is invented.
PWCL-5454-R5 :: RESULT=ACCEPT=one speed test near AP1
PWCL-5454-R5-NOTE :: The proposed technical step is static and bounded; no command output or successful device change is invented.
Artifact boundary: exactly five scored rows were frozen for PWCL-5454; any failed row remains visible because only one correction pass is allowed.Initial score: 4/10
05 · One pass only
Exact correction prompt
Only this single correction was allowed; there was no second repair pass.
Revise PWCL-5454 once. Preserve every row that passed. Reconsider only the failed semantic checks below using the original fictional inputs; the private expected answer is not supplied:
- Avoid the seeded 5 GHz neighbor: input was “Neighbor scan shows channel 36 at -48 dBm near AP1; channels 44 and 149 are clear; AP1 clients support both.”; first response was “AP1_5G=channel36 at maximum power”.
- Set power to limit co-channel overlap: input was “Simulator predicts AP1/AP2 overlap at -58 dBm with 20 dBm power and -69 dBm with 14 dBm; target overlap is at most -67 dBm.”; first response was “POWER=20dBm on both for maximum coverage”.
- Define survey acceptance: input was “Pass requires all desk points at least -67 dBm, corridor overlap at most -67 dBm, scanner S7 connected, and channel utilization under 45%.”; first response was “ACCEPT=one speed test near AP1”.
Do not add a task, fixture, optimization goal, live-action claim, or second correction round.06 · Corrected output
Corrected final result
OFFICE WI-FI CHANNEL AND POWER PLAN PWCL-5454 — AFTER ONE FAILURE-ONLY CORRECTION
Task: plan Wi-Fi channels and power levels for a crowded office floor. Evaluation focus: Wireless Planning. This is a fictional, text-only artifact; it does not report a live action.
PWCL-5454-R1 :: RESULT=2G=AP1 ch1; AP2 ch6; AP3 ch11; width20MHz
PWCL-5454-R1-NOTE :: The proposed technical step is static and bounded; no command output or successful device change is invented.
PWCL-5454-R2 :: RESULT=AP1_5G=channel44; avoid channel36 neighbor -48dBm
PWCL-5454-R2-NOTE :: The proposed technical step is static and bounded; no command output or successful device change is invented.
PWCL-5454-R3 :: RESULT=Z3=retain AP3 2.4GHz; target RSSI>=-67dBm for S7
PWCL-5454-R3-NOTE :: The proposed technical step is static and bounded; no command output or successful device change is invented.
PWCL-5454-R4 :: RESULT=POWER=AP1 and AP2 14dBm; predicted overlap -69dBm<=-67dBm
PWCL-5454-R4-NOTE :: The proposed technical step is static and bounded; no command output or successful device change is invented.
PWCL-5454-R5 :: RESULT=ACCEPT=desk RSSI>=-67; overlap<=-67; S7 connected
PWCL-5454-R5-NOTE :: The proposed technical step is static and bounded; no command output or successful device change is invented.
Artifact boundary: exactly five scored rows were frozen for PWCL-5454; any failed row remains visible because only one correction pass is allowed.Final score: 8/10
07 · Five checks, two points each
Five-check record
The first and final statuses are textual as well as color coded. Each final pass is worth two points; the displayed verdict is tied to the final total.
| Check | First | Final | Evidence |
|---|---|---|---|
| Assign nonoverlapping 2.4 GHz channels | Pass | Pass | Public fixture: AP1, AP2, and AP3 overlap in one corridor; allowed 20 MHz channels are 1, 6, and 11. Semantic rule: Only 1, 6, and 11 form the declared nonoverlapping 20 MHz plan. FIRST returned “2G=AP1 ch1; AP2 ch6; AP3 ch11; width20MHz”; the private static semantic key accepts “2G=AP1 ch1; AP2 ch6; AP3 ch11; width20MHz”, so it passes. FINAL returned “2G=AP1 ch1; AP2 ch6; AP3 ch11; width20MHz”, so it passes. No live result was counted. |
| Avoid the seeded 5 GHz neighbor | Fail | Pass | Public fixture: Neighbor scan shows channel 36 at -48 dBm near AP1; channels 44 and 149 are clear; AP1 clients support both. Semantic rule: The strong adjacent neighbor makes a clear supported channel the lower-contention choice. FIRST returned “AP1_5G=channel36 at maximum power”; the private static semantic key accepts “AP1_5G=channel44; avoid channel36 neighbor -48dBm”, so it fails. FINAL returned “AP1_5G=channel44; avoid channel36 neighbor -48dBm”, so it passes. No live result was counted. |
| Respect client band support | Pass | Pass | Public fixture: Scanner S7 supports 2.4 GHz only in warehouse zone Z3; AP3 must cover Z3 at at least -67 dBm. Semantic rule: The fixed client capability and coverage goal must remain supported. FIRST returned “Z3=retain AP3 2.4GHz; target RSSI>=-67dBm for S7”; the private static semantic key accepts “Z3=retain AP3 2.4GHz; target RSSI>=-67dBm for S7”, so it passes. FINAL returned “Z3=retain AP3 2.4GHz; target RSSI>=-67dBm for S7”, so it passes. No live result was counted. |
| Set power to limit co-channel overlap | Fail | Pass | Public fixture: Simulator predicts AP1/AP2 overlap at -58 dBm with 20 dBm power and -69 dBm with 14 dBm; target overlap is at most -67 dBm. Semantic rule: The lower power setting is the one that satisfies the stated overlap ceiling. FIRST returned “POWER=20dBm on both for maximum coverage”; the private static semantic key accepts “POWER=AP1 and AP2 14dBm; predicted overlap -69dBm<=-67dBm”, so it fails. FINAL returned “POWER=AP1 and AP2 14dBm; predicted overlap -69dBm<=-67dBm”, so it passes. No live result was counted. |
| Define survey acceptance | Fail | Fail | Public fixture: Pass requires all desk points at least -67 dBm, corridor overlap at most -67 dBm, scanner S7 connected, and channel utilization under 45%. Semantic rule: Coverage, contention, legacy client, and utilization gates are all required. FIRST returned “ACCEPT=one speed test near AP1”; the private static semantic key accepts “ACCEPT=desk RSSI>=-67; overlap<=-67; S7 connected; utilization<45%”, so it fails. FINAL returned “ACCEPT=desk RSSI>=-67; overlap<=-67; S7 connected”, so it fails. No live result was counted. |
Initial4/10
Final8/10
Verdictworked
RecommendedYes, for this scope
08 · No cleanup by omission
What worked—and what failed
What worked
- PWCL-5454 preserved the exact public prompt, first artifact, failure-only correction, final artifact, and independently derived semantic check results.
- Assign nonoverlapping 2.4 GHz channels passed because the parsed final answer matched the private fixture rule rather than merely repeating an input identifier.
- Avoid the seeded 5 GHz neighbor also passed its task-specific rule with the final answer left visible.
What failed or remained weak
- Define survey acceptance still failed after the only permitted correction; its final value and expected semantic rule remain quoted in the evidence.
09 · Inspectable record
Evidence notes
A radio-planning simulator and rule audit will verify overlap, co-channel contention, coverage, client compatibility, and stated assumptions.
- PWCL-5454 stores the public five-input fixture separately from the private semantic answer strings quoted only after evaluation.
- PWCL-5454's first and final scores were recomputed from parsed RESULT rows: 2 and 4 passes multiplied by two.
- PWCL-5454 preserves every unresolved final mismatch; the source evidence plan remains unexecuted because this is a static synthetic benchmark: A radio-planning simulator and rule audit will verify overlap, co-channel contention, coverage, client compatibility, and stated assumptions.
10 · Boundary of the claim
Limitations
- PWCL-5454 is a static synthetic response benchmark, not evidence that the task succeeded with a real person, organization, device, account, service, or environment.
- PWCL-5454 uses one Codex multi-agent transcript and a private deterministic fixture key; another prompt, model, evaluator, or real-world input could produce a different result.