Authorized prospective half-budget control screens¶
Omar approved the recommended staged design on 13 October local time
(12 October UTC): screen unstarted CER and gamma comparisons at half their
training budget, retaining the Coins replacements and verification budgets.
All submitted scientific jobs continue. Admissions were briefly frozen to
record a stable split, with the original ledgers, commands, environment context
and deployment files preserved under each root's
half-budget-transition-20261013/.
Comparison groups and retained work¶
An entire comparison remains at full budget if any of its profiles had already been submitted. Gamma groups are task/learner pairs and include both discounts and all five seeds. CER groups are task/learner pairs and include all modes and all five seeds. This avoids mixing budgets within a comparison or choosing individual seeds by their outcomes.
| Campaign | Retained full-budget profiles | Half-budget profiles |
|---|---|---|
| Original gamma | 80 | 100 |
| Separate PR2 gamma | 60 | 100 |
| CER/baseline study | 50 | 105 |
The retained gamma groups include Harvest and Classic 2, plus the already submitted IPPO families in Capture 2; their original worker commands and source pins remain unchanged. Both targeted CER cases were underway, so their complete fifty-profile ablation stays at full budget. The broader seven IPPO task comparisons, including matched no-CER, CER and RM-shaping arms, receive the half-budget screen. The complete frozen manifests, rather than this prose, are authoritative for each retained comparison.
The initial workload decreases from roughly 510 million requested training steps to 326 million, before rollout rounding. This saves about 36 percent of training across these controls, rather than 50 percent, because started comparisons are retained. Evaluation costs are unchanged. A later full-budget confirmation is additional work and can reduce or eliminate this saving.
Adapter and provenance¶
scripts/staged_control_study.py runs the frozen worker code through an
isolated adapter. The base sources remain gamma c84a075, PR2 c2dbf27
and CER 612145f; the adapter has its own pinned revision and file hash.
No frozen worker source, trainer, archived checkpoint or shared remote
environment is edited. Each manifest records the base and adapter revisions,
all worker commands, source directories, retained groups, original rounded
budgets, cutoff budgets and full schedule horizons.
Half runs use the ceiling of half the original number of complete rollout
updates. Their learning-rate and exploration schedules retain the original
SCHEDULE_TOTAL_UPDATES. They are halfway observations of the planned
schedule, rather than shorter runs with a compressed schedule. Batch shape,
learner architecture, discount, CER mode/caps/diagnostics, RM potential,
thresholds, epsilon and native response-search settings are preserved.
Half-budget artifacts live under half-budget-screen/ within their campaign;
every worker writes a budget-stage.json alongside the frozen worker's
original metadata, result and checkpoint. Development probes are explicitly
marked smoke and cannot count as scientific results or unlock a pilot gate.
The controller retains the existing maxima (12/10/10) and global expanded-job ceilings (177/177/185), including held tasks. It shares the existing parent admission lock, preserves each original campaign's controller lock and all submitted job IDs, and uses the existing shared interpreter explicitly. New case/mode seed-zero or seed-100 gates check finite execution only; halfway performance does not remove planned seeds. A short disappearance grace avoids immediately treating delayed result visibility as job failure.
Reporting, promotion and timing¶
Complete matched five-seed screens are reviewed as comparisons. Promising or inconclusive comparisons may be promoted with their matched baseline and all included seeds under the user's authorization. Weaker halfway outcomes can justify deferring full training and investigating diagnostics; they do not establish full-budget failure or an implementation defect. Report the budget actually observed and retain all outcomes. Do not select only the best seeds or combine half/full rows without explicit budget labels.
Current checkpoints retain trained model/optimizer states, but do not retain all environment, random-generator and IQL replay-buffer state needed for an exact uninterrupted continuation. A fresh full-budget confirmation is therefore the conservative current option, with its cost disclosed; a faithful resumption implementation must separately preserve and verify those states. Fresh halfway training followed by fresh full training costs 150 percent of the original training for a promoted profile. No automatic extrapolation from halfway probability estimates is an equilibrium certificate.
Retain the original independent evaluation budgets. Certificates stored by the frozen workers are provisional for their declared family; recompute simultaneous coverage across all examined stages and archived candidates before making paper claims. Gamma screening additionally reserves twice the original per-campaign family size for its provisional payoff-ceiling bounds.
The planning estimate is 24--36 hours for first-stage screening results, roughly 24--48 hours for the core replacements/controls, and 2--4 days for the initial campaign set once workers are placed. Full-budget promotions are outside that first-stage estimate. Commons and strong response searches retain their budgets and may still determine overall finish time; allow about another day for complete auditing and paper integration. These are provisional ranges, not a promised deadline.
Validation¶
The required changed-path selection passed 613 routine tests; the nine focused
staging tests also passed after the final controller metadata changes. Ruff
and the strict documentation build passed. Three real local development
workers exercised frozen c84a075 IQL-CER, c2dbf27 PR2-IPPO-CER and
612145f Territory critic-only CER, each with five rollout batches and two
independent evaluation episodes. All saved finite models and the original
ten-update development schedule, with only five updates executed. Both gamma
probes checked the actual saved checkpoint configuration, as well as the
worker's protocol metadata. Probe outputs are under
/tmp/pltlf-half-budget-probes-schedules/ and
/tmp/pltlf-half-budget-probes/; these are engineering evidence only.
Live deployment and additional headroom¶
The detached adapter checkout is
/vol/gpudata/oja24-pltlf/worktrees/control-screen-2c22b5a, pinned to
2c22b5a45f3c9420a9249bccbd1324250a03d6f1. All 16/11/31 previously submitted
Gamma/PR2/CER scientific job IDs survived the initial transition. First half
PR2 jobs 61960--61962 were running at 00:11 UTC, with live trainer metadata
TOTAL_TIMESTEPS=500224, SCHEDULE_TOTAL_UPDATES=3907 and the intended
paired gamma values. Job 61963 was queued; these startup observations are
not performance evidence.
A subsequent read-only check found background allocations down to 124 CPUs after an unrelated 48-CPU job ended. The user-requested headroom policy now allows Gamma 16, PR2 Gamma 12, CER 14, Commons 14 and archived responses 15; Coins four and Pursuit four remain unchanged. This is 79 physical-core workers, normally 158 Slurm CPUs. Reserving four CPUs for the additional background job observed pending gives a maximum snapshot allocation of 286, below 288. Global submission ceilings remain 177/181/185. No external job, hold, gate or source was altered. These admission-only changes leave the staged scientific split and all submitted workers intact.
| Controller | PID | Maximum workers | Global job ceiling |
|---|---|---|---|
| Original Gamma | 3700030 | 16 | 177 |
| Separate PR2 Gamma | 3700058 | 12 | 177 |
| CER/baselines | 3700072 | 14 | 185 |
| Commons budget controls | 3700122 | 14 | 181 |
| Archived strong responses | 3700144 | 15 | 181 |
The CER observer now honors each staged worker's output_root; its prior
source/state/PID are preserved, with replacement launcher 2461653 and
Python PID 2461656. The Gamma observer's notices now explicitly refer to
staged full/half budgets; its replacement launcher is 2465409. A new
read-only comparison watcher, launcher 2464685, records completed matched
groups in the responsible agent's shared mailbox and copies artifacts before
notices. Existing event deduplication is retained and no chat prompts are
injected. Mailboxes still require agents to read them during active work.
Read staged-plan.json to locate results and distinguish budgets; original
static full-budget summarizers do not know the new half-output paths. Full
confirmation remains a separately labeled, authorized follow-up after
matched screening review. The first-stage planning ranges above exclude
that additional work; stronger response workers still lack complete
end-to-end timings.
Final paper data policy and first full-confirmation wave¶
On 13 October Omar authorized retaining gamma one where it helps and gamma 0.99 where it performs better as final paper data. Full-map Coins is the paper default; Capture 2 retains its original infeasible threshold; mixed CER benefits are reported with corrected data and the implementation limitations.
For the task/learner pairs with matched discount controls, select one discount
across all five seeds using the primary batch's best-agent five-seed mean,
max_i mean_seed(p_hat_i), matching the paper's individual-satisfaction
metric. Ties retain gamma one. Final estimates use the disjoint confirmatory
batch and bounds recomputed across all examined seed profiles, discounts,
archives and budget stages. A gain for one role is not a joint improvement.
Invalid profiles remain failures; they do not receive arbitrary payoffs or
silently disappear from a five-seed mean. Halfway rankings are exploratory.
No discount comparison uses local-view Coins as a control for full-view Coins.
The first full-confirmation wave is admitted at
/vol/gpudata/oja24-pltlf/exports/optimisations/gamma-full-confirmation-20261013.
Its immutable manifest has sixty fresh full-budget profiles: Capture 2 IQL
with/without CER and Classic 3 IPPO/IQL with/without CER, both discounts and
all five seeds. All six input screens were complete, finite, source-pinned
and schedule-checked before admission. The review is archived in
results/gamma-full-confirmation-wave1-review-2026-10-13.json, including
input checkpoint hashes and separate primary scores for each role/discount.
Full rankings, rather than these input rankings, determine final selections.
Workers call the original frozen gamma source c84a075 directly at its full
notebook budget. The controller reuses adapter 2c22b5a; no scientific worker
source, native CER option, architecture, evaluation budget or threshold was
changed. Original controllers and submitted workers remain intact. Frozen
worker certificates are provisional for their declared family; the larger
final paper selection family is recomputed after collection.
The new controller is PID 3858330, max four, cap 177. Original Gamma remains max sixteen. With the other recorded campaign maxima, this permits 83 physical-core paper workers, normally 166 Slurm CPUs. At admission the other user jobs used 104 CPUs; four additional CPUs were reserved conservatively for the pending background task, totaling 274 below the unchanged 288 CPU limit. The global 177/181/185 expanded-job caps and shared admission lock remain unchanged. No other jobs, holds, sources or caps were modified. Jobs 62234--62237 were observed running; startup is execution evidence only.
The comparison observer now includes the confirmation root. Its old source and deduplication state were preserved before restart, with replacement launcher 2863472. Its first four-root snapshot was healthy, errors zero. Completion events are file-mailbox records and artifact copies, never chat prompt injection. Capture 3 remains under complete-screen review for a later wave within the same four-worker confirmation allowance; it is not included in this sixty-profile admitted manifest.
Audited discount-selection collector¶
scripts/summarize_discount_selection.py collects any explicitly listed
original and confirmation campaigns from their staged manifests. For example,
after copying remote artifacts into the corresponding local export folders:
uv run --no-sync python scripts/summarize_discount_selection.py \
--campaign exports/optimisations/gamma-one-20261012 \
--campaign exports/optimisations/pr2-gamma-one-20261012 \
--campaign exports/optimisations/gamma-full-confirmation-20261013 \
--output .cache/discount-selection-current.json
The collector checks scientific identities, frozen source revisions, full or half training budgets, preserved half schedules, raw satisfaction counts, disjoint 1000-episode evaluation blocks and checkpoint checksums. Matching full-budget pairs must also share the source-file hashes, trainer options apart from gamma/seed, thresholds and agent sets. Duplicate full-budget seed outcomes require explicit cohort review rather than automatic selection. No checkpoint unpickling is needed for this metadata and checksum audit.
Selection requires both discounts and every seed 0--4 to be complete and
finite at the full budget. Integer primary success counts select one discount
for the whole five-seed task/learner group; exact ties retain gamma one. The
output exposes the selected primary_selection_score separately from its
confirmatory role means, so later exports need not choose settings using the
confirmatory estimates. Partial, failed and half-budget profiles remain in
the inventory and cannot fill a final matched comparison. The output includes
the collector checksum and generation time.
Listed-campaign family sizes count all listed profiles, including budget stages and failed attempts. They are not the complete paper-wide selection family: archived candidates and other experiments must also be inventoried before recomputing final bounds. Frozen-worker certificates and approximate response-search values do not become equilibrium certificates through this collector. Twelve focused tests cover seed completeness, selection and exact ties, independent reporting, source/settings consistency, duplicate cohorts, invalid counts, local artifact mapping and checkpoint integrity. The required broader changed checks passed with 625 tests; strict documentation checks also apply to this note.
The read-only comparison observer now invokes a private copy pinned to code
revision 3422091 after discount artifact copies and at startup. Collector
failures are recorded for review; they do not produce a new selection or
prevent scientific completion/failure notices. The prior observer source and
event state are preserved, with replacement launcher 2932018. Its first
snapshot at 12:02 UTC was healthy and recorded all 34 discount task/learner
groups as awaiting complete full-budget pairs. No scientific worker source,
job, submission ceiling or concurrency allowance changed.
Selective response retirement and confirmation headroom¶
At the user's instruction to run stronger response searches only when useful, W1 retired ten obsolete local-view Coins workers and preserved their 193 candidate checkpoints, protocols and logs. Its original fifteen-profile plan remains archived with explicit truncated records, not invented failures or certificates. Five Territory response workers remain under a read-only no-admission tracker; their allowance is five, with cap 181 unchanged.
W1 transferred the ten freed physical-worker slots to full gamma confirmation.
After confirming the retired jobs absent, checking the own controller identity
and acquiring the shared parent lock, we replaced launcher 3858330 with
3949667. Confirmation is now max fourteen, cap 177. The original scientific
staged-plan.json bytes remain unchanged; separate admission-plan-max14.json
has identical trials and changes the admission maximum from four to fourteen.
Prior ledger/deployment/manifest bytes are preserved under
allowance-transfer-20261013T155952Z/, and all ten previously submitted
scientific job IDs survive. Worker source c84a075 and adapter 2c22b5a
remain frozen. The first post-transfer snapshot had six complete profiles and
fourteen running, which is execution evidence rather than a matched result.
The coordinated maximum remains 83 physical workers, normally 166 Slurm CPUs: original Gamma sixteen, confirmation fourteen, Coins four, PR2 twelve, CER fourteen, Commons fourteen, archived responses five and Pursuit four. Global 177/181/185 ceilings are unchanged. No diagnostic allowance or scientific settings changed. From measured Capture IQL and Classic 3 IPPO full runtimes, the remaining confirmation planning range falls from roughly 30--40 hours to 10--16 hours, conditional on admission and runtime variation. PR2 repair and the larger Commons controls still affect the overall completion date.