𓇣

Lecture 07: MTVJ — Real-Time Audio-Reactive Visual Performance

Properties2
descriptionBuilding real-time VJ performance systems, FFT frequency spectrum analysis, and video synthesis.
tagsdda256, lecture, audio-reactive, vj, fft, real-time-video

Description

Designing live performance software tools (MTVJ). Focus on real-time sound analysis using Fast Fourier Transform (FFT), beat detection, parameter modulation, and live generative video feedback.

Key Concepts

  • Fast Fourier Transform (FFT): Splitting audio waveforms into frequency bands (bass, mids, highs) and mapping amplitudes to visual parameters.
  • Audio-Visual Feedback Loops: Buffer feedback, frame delay effects, and glitch synthesis.
  • Live User Control: Binding keyboard shortcuts, MIDI controllers, and OSC signals to real-time generative parameters.

Core Coding Concepts

  • p5.AudioIn, p5.FFT, and fft.analyze()
  • Beat detection and peak energy tracking
  • Real-time video feedback shaders and blending modes

Graph View

Backlinks