Skip to content

Watch them imagine.

Every model here was trained from scratch on one 4 GB laptop GPU, then recorded: the real world on the left, the model’s imagination on the right.

Play it nowWatch it playSee the galleryBrowse the gallery

Play Breakout inside a dream. Every frame is drawn by DIAMOND’s world model.

dream · diamond · breakoutRecording
Press Start dreaming to watch the agent play
Who plays
No game is running
Every frame comes from DIAMOND’s diffusion model, conditioned on the agent’s last moves.
A recording, for now
Live play in your browser arrives with DIAMOND’s web export. Until then, this is the same model, recorded.
Starts from real frames
A few real opening frames start the dream; after that it is all imagined.
Honest about the gap
After 21 epochs it draws the walls, bricks and paddle, but not yet the ball.

Reproduce any demo. Two commands per model, one to train and one to record.

Train a model from scratch
python demos/dreamer_demo.py train
Record what it learned
python demos/dreamer_demo.py record
Run every demo, one after another
python demos/run_all.py
Sized forRTX 3050 Laptop GPU
Graphics memory
4 GB
System memory
16 GB
Time per demo
1 to 2 hours

IRIS is the exception: its full schedule runs for several days on 4 GB.

Train your first world model today.

Open source, MIT licensed, and runs on a laptop GPU.

pip install simulusion
Get startedStar on GitHub