Skip to content

Tracking: path from methods freeze to first real audit #17

Description

@esaran1

Ordered work for collaborators. Do not skip ahead to paper numbers.

PR #1 (Enhance/aaai) already used GitHub number 1, so this tracker starts at #2.

  1. Freeze and push the analysis codebase before any HPC or paper work #2 Freeze/push the analysis codebase
  2. Preregister the paper estimand and seed-dependence assumptions #3 Preregister estimand and seed pairing
  3. Define the actual recipes and what compute=1,2,4,8,16 means #4 Define recipes and compute accounting
  4. Connect a real train/eval script to ASLA_REAL_TRAIN_EVAL #5 Connect the real trainer
  5. Configure SLURM resources and cluster environment #6 Configure SLURM
  6. Run the 45-job grid and record only measured BPB #7 Run 45 jobs; record measured BPB only
  7. Run the first real audit: projection vs single-scale #8 First real audit vs single-scale
  8. Parallel / later:

Current blocker: no real measured BPB in the repo. All 45 manifest rows are pending.

Metadata

Metadata

Assignees

No one assigned

    Labels

    documentationImprovements or additions to documentation

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions