Instrument · In development · October 2026

Seoul

A music visualizer in the MilkDrop tradition, written in Rust. It listens to whatever the computer is playing, finds the beat and the tempo, and paints with feedback: every frame is a warped, fading copy of the last. Thirty-two live-editable presets, from the Han River at night to fractals you fall into forever, and a Soba patch can play every one.

rustwgpuwgslaudiodspvisualizershadersgpu-particles

Clips

The Han River at night

The towers rise with the spectrum, bass on the left and treble on the right, and their windows flicker with the treble. Each beat opens the Moonlight Rainbow Fountain on Banpo Bridge. Nothing is drawn below the horizon. A custom warp mirrors the sky into the river and runs two ripple trains through it, so every light trembles, the moon included.

Ink in water

This preset replaces the usual zoom and rotate with a curl-noise current, so last frame is carried along like ink in still water. A pale drop swells with the bass, each beat releases a cloud of particles, and a cinnabar thread, the red of a painter's seal, traces the waveform around it.

Dancheong

The painted bands on the eaves of Korean palaces, in their four pigments: green, vermilion, cobalt and ochre. The rings step outward once per beat, locked to the detected tempo rather than to raw onsets, and the display folds the frame into eight mirrored wedges.

LED wall

A mirrored spectrum poured into a dot-matrix display. The last pass resamples the finished frame once per LED and draws each one as a round emitter with a soft halo. Unlit LEDs stay faintly visible, like the panel in the photograph that started the look.

Screenshots

About

Seoul is a music visualizer in the MilkDrop tradition, written from scratch in Rust. It listens to whatever the computer is playing, pulls the music apart into bands, beats, tempo, a spectrum and a waveform, and paints with feedback. Each frame starts as the last one, zoomed, turned and faded a little, and the preset draws on top. The trails, tunnels and smoke all come from that loop rather than from any geometry.

The film above is one take with the built-in test track. A circle opens from Ink onto Dancheong, a clock hand sweeps in Vortex, Vortex zooms away into the Han River, and the ink dissolves back in over the bridge. Transitions blend the motion of the two presets as well as their pictures, so for a moment the river reflects the outgoing whirlpool, and the ink’s current bends the skyline as it arrives.

Listening

  • Bands with their own gain. Bass, mids and treble are each measured against their own recent peaks, so the treble gets its full range even under a loud kick. A floor keeps silence dark instead of amplifying the noise.
  • Beats and tempo. Beats come from spectral flux with an adaptive threshold. The tempo comes from the intervals between beats, and a beat clock locked to it lets presets like Dancheong move in time instead of just reacting.
  • Silence and swaps. Windows sends no audio at all while the computer is quiet, so the analyzer feeds itself silence and everything fades out instead of freezing. Switching to headphones reconnects on its own.

Painting

  • A warp per pixel. Zoom, rotation, stretch and ripple are computed for every pixel in aspect-correct space. Presets are written per frame at 60 Hz and rescaled to the real frame time, so they look the same at 60 and 144 Hz.
  • Light that can exceed white. The image is kept in HDR, bloomed, and tonemapped with a curve that leaves a preset’s colors alone until they approach the highlights. Grain and dither go on last, in display space, so the long dark gradients don’t band.
  • Effects beyond the warp. A preset can bring its own warp shader, up to 131,072 GPU particles, a MilkDrop-style video echo, kaleidoscope symmetry, or the LED display.
  • Transitions for free. Before each preset draws, a mask pass writes that preset’s weight into the image’s spare alpha channel, and its drawing is multiplied by it. Every preset gets dissolves, radial and clock wipes, and zooms without knowing they exist.

Writing Presets

A preset is a TOML file and one or two WGSL functions. The TOML maps the music onto the motion with small expressions, like zoom = "1.0 + bass * 0.02". The shader draws whatever should be added this frame. Save either file and the change appears while the music keeps playing. A mistake shows up on screen with the file and line, and the last working version keeps running.

The first screenshot shows the panel behind F1, which shows what the presets see: frame time, the tempo and how sure the analyzer is of it, the three bands with their one-second averages, and the spectrum.

Every video on this page came from Seoul’s offline recorder. It renders at a fixed step of 1/60 of a second and generates the test track in lockstep, so the footage is smooth and the beats land where they should. The stills were taken live, from the same test track.

More of the City

The second half of the stills are newer presets:

  • Scenes. Hongsalmun walks you through an endless row of red arrow gates, and each kick sends light running ahead down the path. The sun climbs out of the East Sea at Jeongdongjin, lanterns drift down the Cheonggyecheon, and Sonamu walks through red pines under the moon, each tree grown by folding one branch into many.
  • Infinite zooms. Misiurewicz, Sunflower and Window Within fall forever, into a Mandelbrot branch point, a sunflower’s seed head and a lamplit changsal window that holds itself, and they fall faster while the groove holds.
  • Fractals. Starfield of Kali flies through a fractal nebula, and in Feedback Julia a Julia set condenses out of the last frame’s light.

Played by Soba

Seoul can also be played. A Soba patch sends control lanes, gates and its clock over OSC, and every preset answers the same way: gates 1 to 3 play the kick, the snare and the hats, and three lanes turn up the energy, shift the color and speed up the motion. While the patch plays, its clock replaces tempo detection, so everything that follows the beat locks to the patch. With nothing connected, the presets just listen.

Gayageum and Obangsaek were written for the link. A patch plays Gayageum’s twelve strings, bending them with its lanes and plucking them with its gates, and Obangsaek’s pinwheel, in the five cardinal colors, turns once per bar of the patch’s clock.

Technical Details

  • Language: Rust (wgpu 30, cpal 0.18, winit 0.30, glyphon)
  • Audio: WASAPI loopback on Windows, a CoreAudio process tap on macOS 14.6+, 2048-point FFT on a 5.8 ms hop, per-band AGC, spectral-flux onsets, tempo from inter-onset intervals
  • Rendering: per-pixel feedback warp, compute-shader particles, mip-chain bloom, Khronos PBR Neutral tonemapping, all in WGSL
  • Presets: TOML expressions plus WGSL, hot-reloaded, with compile errors shown on screen
  • Link: OSC over UDP from Soba or any sender, with a latency offset so the patch’s hits line up with the audio you hear
  • Testing: 81 unit tests, including synthetic kick tracks at 100, 120 and 140 BPM