disco-diffusion

A modern refactor of disco-diffusion (ongoing).

Specific support for RTX Graphics Cards, tests under 24Gb.

Reproduce

# Install uv (Linux/macOS)
curl -LsSf https://astral.sh/uv/install.sh | sh

# Sync environment from lockfile and run
uv sync
uv run disco.py
# equivalent:
uv run python -m discodiff.main

Text-to-image

# 1) Baseline — square 512×512, prompt via stdin JSON
uv run disco.py --width 512 --height 512 --text-prompts-json /dev/stdin <<'EOF'
{"0": ["cinematic coastal lighthouse, dusk fog"]}
EOF

# 2) Same resolution and prompt, fixed seed for reproducibility
uv run disco.py --width 1024 --height 576 --set-seed 42 --steps 250 \
  --text-prompts-json /dev/stdin <<'EOF'
{"0": ["cinematic coastal lighthouse, dusk fog"]}
EOF

Text-to-video (2D)

# Example A — single resolution, two prompts (holds last prompt after frame 30)
uv run disco.py --generation-mode 2D --width 512 --height 512 --set-seed 42 --steps 100 \
  --text-prompts-json /dev/stdin <<'EOF'
{"0": ["establishing shot of a coastal lighthouse at dawn, atmospheric"], "30": ["same scene, golden hour, warm light on the cliffs"]}
EOF

# Example B — higher spatial resolution, explicit multi-step schedule (adjust `max_frames` in main when producing longer sequences)
uv run disco.py --generation-mode 2D --width 1024 --height 576 --set-seed 42 --steps 250 \
  --text-prompts-json /dev/stdin <<'EOF'
{"0": ["wide landscape, mountains and a field, misty morning"], "15": ["camera slowly dollying forward, same environment, sharper detail"]}
EOF

Text-to-video (3D)

# Example A — short 3D smoke run (few steps; good for wiring/paths validation)
uv run disco.py --generation-mode 3D --width 512 --height 512 --set-seed 42 --steps 50 \
  --text-prompts-json /dev/stdin <<'EOF'
{"0": ["cinematic coastal lighthouse, dusk fog, volumetric light, wide angle"]}
EOF

# Example B — longer 3D run (more steps; keep the prompt stable while camera motion comes from keyframes in main.py)
uv run disco.py --generation-mode 3D --width 1024 --height 576 --set-seed 42 --steps 250 \
  --text-prompts-json /dev/stdin <<'EOF'
{"0": ["cinematic coastal lighthouse, dusk fog, volumetric light, wide angle"]}
EOF

Platform

Linux tested. This repo is maintained and expected to run on glibc-based Linux with a working NVIDIA stack (proprietary driver so nvidia-smi reports your GPU). Other OSes are currently out of scope; if you run elsewhere, you may see a stderr warning - set DISCO_ALLOW_NON_LINUX=1 to suppress it (still unsupported).

RTX and OS Device Layer

Device selection is centralized in src/discodiff/platform/device.py.

OS / accelerator	Status	Notes
Linux + NVIDIA CUDA (RTX preferred)	Supported	auto prefers RTX-named CUDA devices, then falls back to first CUDA GPU.
Windows + NVIDIA CUDA	Best effort	Works through the same device layer; Linux remains the tested target.
macOS + MPS	Best effort	No RTX path on macOS; auto can select mps when available.
CPU fallback	Supported	Used when no requested accelerator is available.

Known caveats:

• RTX detection is name-based (RTX in GPU name) and may treat non-RTX CUDA devices as generic CUDA.
• Driver/toolkit mismatches can still fail at runtime even when device selection succeeds.
• Non-Linux runs are intentionally warned unless DISCO_ALLOW_NON_LINUX=1 is set.

Device Selection

You can let the runtime auto-select or force a device explicitly.

# Auto-select (prefers RTX CUDA when available)
uv run disco.py --device auto

# Explicit device requests
uv run disco.py --device rtx
uv run disco.py --device cuda:0
uv run disco.py --device cpu

Optional runtime profile examples:

# Enables RTX-oriented backend defaults when compatible
uv run disco.py --device auto --profile rtx

Env equivalents:

• DISCO_DEVICE (auto, rtx, cpu, cuda, cuda:N, mps)
• DISCO_PROFILE (default, rtx, rtx-safe, rtx-fast)

RunConfig

Top-level runtime settings are now centralized in RunConfig at src/discodiff/config/settings.py.

Setting	Env var	Default	Notes
output_dir	DISCO_OUTPUT_DIR	<repo>/output	Output root for generated assets.
device	DISCO_DEVICE	auto	Selects runtime device (auto, rtx, cpu, cuda, cuda:N, mps).
seed	DISCO_SEED	None	Optional integer; runtime still supports random seed behavior.
generation_mode	DISCO_GENERATION_MODE	None	One of None, 2D, 3D, Video Input.
profile	DISCO_PROFILE	default	Backend defaults profile (default, rtx, rtx-safe, rtx-fast).