Riffusion

Generates music by diffusing spectrogram images — the original open project, now also a polished web app.

Strengths

• Novel spectrogram-image approach to audio synthesis
• Original code and model are open (MIT)
• The web app adds vocals and full songs

Limitations

• The open model is experimental and lower-fidelity
• The web product is closed and separate from the open repo

Best for

Experimenting with spectrogram-based generation, or quick song sketches on the web.

Minimal example

# The open model runs Stable Diffusion on spectrogram images; see the repo:
# https://github.com/riffusion/riffusion-hobby

Alternatives to Riffusion

See all Riffusion alternatives & how they compare →

← Back to all tools