Completed field testSynthetic benchmark
Computers · Evidence record
Using AI to Move a Browser Profile Between Computers: All Five Semantic Checks Passed
This completed synthetic Profile Migration field test asked the session to migrate a browser profile between computers, preserved an actual five-row browser profile migration manifest, and derived 6/10 then 10/10 from task-specific semantic checks after one failure-only correction.
- Exact prompts and outputs
- One correction only
- Synthetic inputs disclosed
01 · The assignment
The task
migrate a browser profile between computers
02 · Scope before score
Test disclosures
Input disclosure
All inputs in MBP-4516 are fictional and appear verbatim in the exact prompt. Hidden scoring answers were not shown to the response generator. No personal, production, customer, learner, or device data was used. Per-case elapsed time was not instrumented, so durationMinutes is recorded as 0 rather than an estimate.
Run disclosure
A Codex multi-agent session generated one text-only first artifact for “migrate a browser profile between computers”. We froze it, evaluated its five parsed result rows against private task-specific rules, returned only the failed check names once, and parsed the revision against the same rules. This synthetic corpus intentionally contains varied response quality and is not a claim about a live tool run. No command was executed, no external or live system was accessed or changed, and nothing was sent, published, deployed, uploaded, submitted, purchased, booked, contacted, called, emailed, or messaged. No external, live, or production action occurred. Per-case elapsed time was not instrumented during the batch session.
- Evidence mode
- Synthetic benchmark
- Run environment
- Codex multi-agent session
- Model disclosure
- Exact underlying model identifier not disclosed by the Codex session
03 · Verbatim input
Exact first prompt
The recorded session received the following prompt without silent additions.
Complete a bounded synthetic field test for: migrate a browser profile between computers. Focus: Profile Migration.
Source scenario: The experiment will test a privacy-conscious plan for moving bookmarks, preferences, and selected local data to a clean device.
Use only these five public fictional inputs; the scoring answers are intentionally withheld:
MBP-4516-I1: Source has 84 bookmarks, 12 preferences, 6 search shortcuts, 19 history entries, 4 cookies, and 3 saved passwords; policy approves the first three only.
MBP-4516-I2: Canonical bookmark tree has 9 folders, maximum depth 3, and duplicate URL U17 in two intentional folders.
MBP-4516-I3: Preferences P1-P10 are portable; P11 is machine-specific download path and P12 is a device token.
MBP-4516-I4: Destination profile DST-NEW initially has 2 default bookmarks and no user history, cookies, or credentials.
MBP-4516-I5: Acceptance is bookmarks 84/84, folder paths 9/9, portable preferences 10/10, shortcuts 6/6, and excluded-class counts all zero.
Return a concrete browser profile migration manifest with exactly five result rows, assumptions visible, and no claim that a command, message, booking, transaction, teaching session, or live-system change occurred. Evidence target: An itemized source manifest and destination audit will verify completeness and the exclusion of sensitive data.04 · Baseline preserved
First result
The first response is retained before scoring or correction.
BROWSER PROFILE MIGRATION MANIFEST MBP-4516 — FIRST FROZEN ARTIFACT
Task: migrate a browser profile between computers. Evaluation focus: Profile Migration. This is a fictional, text-only artifact; it does not report a live action.
MBP-4516-R1 :: RESULT=SCOPE=bookmarks84; preferences12; shortcuts6; exclude history19,cookies4,passwords3
MBP-4516-R1-NOTE :: The proposed technical step is static and bounded; no command output or successful device change is invented.
MBP-4516-R2 :: RESULT=BOOKMARKS=84 entries; folders9; depth3; retain both contextual U17 placements
MBP-4516-R2-NOTE :: The proposed technical step is static and bounded; no command output or successful device change is invented.
MBP-4516-R3 :: RESULT=PREFERENCES=migrate P1-P10; exclude P11 download path and P12 device token
MBP-4516-R3-NOTE :: The proposed technical step is static and bounded; no command output or successful device change is invented.
MBP-4516-R4 :: RESULT=DESTINATION=overwrite defaults and import source cookies
MBP-4516-R4-NOTE :: The proposed technical step is static and bounded; no command output or successful device change is invented.
MBP-4516-R5 :: RESULT=ACCEPT=browser launches on destination
MBP-4516-R5-NOTE :: The proposed technical step is static and bounded; no command output or successful device change is invented.
Artifact boundary: exactly five scored rows were frozen for MBP-4516; any failed row remains visible because only one correction pass is allowed.Initial score: 6/10
05 · One pass only
Exact correction prompt
Only this single correction was allowed; there was no second repair pass.
Revise MBP-4516 once. Preserve every row that passed. Reconsider only the failed semantic checks below using the original fictional inputs; the private expected answer is not supplied:
- Keep the destination clean: input was “Destination profile DST-NEW initially has 2 default bookmarks and no user history, cookies, or credentials.”; first response was “DESTINATION=overwrite defaults and import source cookies”.
- Reconcile the migration: input was “Acceptance is bookmarks 84/84, folder paths 9/9, portable preferences 10/10, shortcuts 6/6, and excluded-class counts all zero.”; first response was “ACCEPT=browser launches on destination”.
Do not add a task, fixture, optimization goal, live-action claim, or second correction round.06 · Corrected output
Corrected final result
BROWSER PROFILE MIGRATION MANIFEST MBP-4516 — AFTER ONE FAILURE-ONLY CORRECTION
Task: migrate a browser profile between computers. Evaluation focus: Profile Migration. This is a fictional, text-only artifact; it does not report a live action.
MBP-4516-R1 :: RESULT=SCOPE=bookmarks84; preferences12; shortcuts6; exclude history19,cookies4,passwords3
MBP-4516-R1-NOTE :: The proposed technical step is static and bounded; no command output or successful device change is invented.
MBP-4516-R2 :: RESULT=BOOKMARKS=84 entries; folders9; depth3; retain both contextual U17 placements
MBP-4516-R2-NOTE :: The proposed technical step is static and bounded; no command output or successful device change is invented.
MBP-4516-R3 :: RESULT=PREFERENCES=migrate P1-P10; exclude P11 download path and P12 device token
MBP-4516-R3-NOTE :: The proposed technical step is static and bounded; no command output or successful device change is invented.
MBP-4516-R4 :: RESULT=DESTINATION=retain 2 defaults plus 84 migrated bookmarks; sensitive stores remain empty
MBP-4516-R4-NOTE :: The proposed technical step is static and bounded; no command output or successful device change is invented.
MBP-4516-R5 :: RESULT=ACCEPT=bookmarks84/84; folders9/9; preferences10/10; shortcuts6/6; excluded stores0
MBP-4516-R5-NOTE :: The proposed technical step is static and bounded; no command output or successful device change is invented.
Artifact boundary: exactly five scored rows were frozen for MBP-4516; any failed row remains visible because only one correction pass is allowed.Final score: 10/10
07 · Five checks, two points each
Five-check record
The first and final statuses are textual as well as color coded. Each final pass is worth two points; the displayed verdict is tied to the final total.
| Check | First | Final | Evidence |
|---|---|---|---|
| Include only approved data classes | Pass | Pass | Public fixture: Source has 84 bookmarks, 12 preferences, 6 search shortcuts, 19 history entries, 4 cookies, and 3 saved passwords; policy approves the first three only. Semantic rule: The privacy policy explicitly includes three classes and excludes three sensitive classes. FIRST returned “SCOPE=bookmarks84; preferences12; shortcuts6; exclude history19,cookies4,passwords3”; the private static semantic key accepts “SCOPE=bookmarks84; preferences12; shortcuts6; exclude history19,cookies4,passwords3”, so it passes. FINAL returned “SCOPE=bookmarks84; preferences12; shortcuts6; exclude history19,cookies4,passwords3”, so it passes. No live result was counted. |
| Preserve bookmark hierarchy | Pass | Pass | Public fixture: Canonical bookmark tree has 9 folders, maximum depth 3, and duplicate URL U17 in two intentional folders. Semantic rule: Hierarchy and intentional contextual duplicates are part of the approved data. FIRST returned “BOOKMARKS=84 entries; folders9; depth3; retain both contextual U17 placements”; the private static semantic key accepts “BOOKMARKS=84 entries; folders9; depth3; retain both contextual U17 placements”, so it passes. FINAL returned “BOOKMARKS=84 entries; folders9; depth3; retain both contextual U17 placements”, so it passes. No live result was counted. |
| Map portable preferences only | Pass | Pass | Public fixture: Preferences P1-P10 are portable; P11 is machine-specific download path and P12 is a device token. Semantic rule: Machine-bound path and token must not cross to the clean device. FIRST returned “PREFERENCES=migrate P1-P10; exclude P11 download path and P12 device token”; the private static semantic key accepts “PREFERENCES=migrate P1-P10; exclude P11 download path and P12 device token”, so it passes. FINAL returned “PREFERENCES=migrate P1-P10; exclude P11 download path and P12 device token”, so it passes. No live result was counted. |
| Keep the destination clean | Fail | Pass | Public fixture: Destination profile DST-NEW initially has 2 default bookmarks and no user history, cookies, or credentials. Semantic rule: The migration must preserve declared defaults while keeping excluded stores empty. FIRST returned “DESTINATION=overwrite defaults and import source cookies”; the private static semantic key accepts “DESTINATION=retain 2 defaults plus 84 migrated bookmarks; sensitive stores remain empty”, so it fails. FINAL returned “DESTINATION=retain 2 defaults plus 84 migrated bookmarks; sensitive stores remain empty”, so it passes. No live result was counted. |
| Reconcile the migration | Fail | Pass | Public fixture: Acceptance is bookmarks 84/84, folder paths 9/9, portable preferences 10/10, shortcuts 6/6, and excluded-class counts all zero. Semantic rule: Completeness and privacy exclusions must be verified together. FIRST returned “ACCEPT=browser launches on destination”; the private static semantic key accepts “ACCEPT=bookmarks84/84; folders9/9; preferences10/10; shortcuts6/6; excluded stores0”, so it fails. FINAL returned “ACCEPT=bookmarks84/84; folders9/9; preferences10/10; shortcuts6/6; excluded stores0”, so it passes. No live result was counted. |
Initial6/10
Final10/10
Verdictworked
RecommendedYes, for this scope
08 · No cleanup by omission
What worked—and what failed
What worked
- MBP-4516 preserved the exact public prompt, first artifact, failure-only correction, final artifact, and independently derived semantic check results.
- Include only approved data classes passed because the parsed final answer matched the private fixture rule rather than merely repeating an input identifier.
- Preserve bookmark hierarchy also passed its task-specific rule with the final answer left visible.
What failed or remained weak
- The first artifact failed Keep the destination clean; the one permitted correction resolved it, but the initial defect remains published.
09 · Inspectable record
Evidence notes
An itemized source manifest and destination audit will verify completeness and the exclusion of sensitive data.
- MBP-4516 stores the public five-input fixture separately from the private semantic answer strings quoted only after evaluation.
- MBP-4516's first and final scores were recomputed from parsed RESULT rows: 3 and 5 passes multiplied by two.
- MBP-4516 preserves every unresolved final mismatch; the source evidence plan remains unexecuted because this is a static synthetic benchmark: An itemized source manifest and destination audit will verify completeness and the exclusion of sensitive data.
10 · Boundary of the claim
Limitations
- MBP-4516 is a static synthetic response benchmark, not evidence that the task succeeded with a real person, organization, device, account, service, or environment.
- MBP-4516 uses one Codex multi-agent transcript and a private deterministic fixture key; another prompt, model, evaluator, or real-world input could produce a different result.