Turning my Entire World into a 3D Spectrogram for System Sound using Burst-Compiled Parallel Jobs

I’ve been looking for a visually appealing way of showcasing the terrain manipulation capabilities of my work in progress game, Minor Deity. While normal terrain editing definitely looks smooth and almost therapeutic, I wanted something with an extra spark. And then it hit me: Soundwaves! I decided I would try to let the system sound impact my terrain in real-time. In order to achieve that, the first step is actually capturing the system sound. I found a useful example project on GitHub – thanks to the author for sharing! Using this, I was quickly able to capture the system sound per frame and extract the Discrete Fourier Transform from it. This is the story of implementing what I've learned into a gridless, interactive, world-building sandbox game called Minor Deity. Minor Deity on Steam: https://store.steampowered.com/app/3876240/Minor_Deity/ Minor Deity Discord Server: https://discord.gg/2NEb4HxwhF 00:00 Introduction 00:23 Capturing System Sound and Fourier Transform 01:14 Using a Burst-Compiled Job to go 3D 02:52 Sample Results 04:47 Symphony No. 5 (Beethoven) 11:42 Eine Kleine Nachtmusik (Mozart) 17:33 Tavern Brawl (Alexander Nakarada) 22:02 Prelude in C Major (Bach)