Skip to content

Latest commit

 

History

396 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Prometheus

Nobody has ever released a full training script for a frontier model. Labs publish weights. This is the training code, against an open spec. JAX for the model, Rust for the systems, a modified SGLang for rollouts and serving. First modules are in; most of the stack isn't.

The model thinks in latent space instead of writing out a long chain of thought. Each thought is the whole hidden state fed back in, not one token sampled from it, so more latent steps give better answers. Coconut and Reverie show it at small scale. Never done at frontier scale. Starts as a normal CoT reasoner and only learns to compress steps it already takes; if that fails it's about 5% of the compute and you keep the CoT model.

No cluster. An agent swarm writes most of the ~1M lines. Anything that doesn't need 220k GPUs is tested on 32 shared H200s first, including the latent scaling curve. Code and H200 tests by end of 2026.

What's here so far

  • model/, the FP32 JAX reference model (A1)
  • data/extract, HTML, PDF and LaTeX text extraction (B1, Rust)
  • data/loader, shuffling, packing and a resumable loader (B5, Rust)
  • evals/, the eval harness and decontamination (F3)
  • contracts/ and crates/contracts, the versioned contracts shared by Python and Rust (F1)
  • harness/slurm and harness/ledger, the Slurm backend and experiment ledger (H7, H9)

Nothing has run on an H200 yet. PROGRESS.md has the state of every module and the known bugs. To run the CPU tests:

uv run pytest tests -m 'not gpu'
cargo test --workspace

Reading the spec

MONOLITH.md is the whole thing in one file. spec/ has the same text split by section. Good places to start:

Edit the files in spec/, then rebuild the monolith:

awk 'FNR==1 && NR>1 {print ""; print "---"; print ""} {print}' spec/*.md > MONOLITH.md

About

Full script for training a frontier model on 220k GB200s. "Prometheus stole fire from the gods and gave it to man."

Resources

Stars

87 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages