it's generative - been going for more than a week now. Someone at watmm pasted this bit of explanatory chat from Sean:
Broadcaster4utechre: all the synths are just playing whatevers in the frame at that pointBroadcaster4utechre: it scans the frame line by line top to bottom
Broadcaster4utechre: r g b are 3 diff channels so i use all 3 but i put red stuff lower, green around the mid and blue for the cooler feeling higher stuff, idk i did it by taste
Broadcaster4utechre: and then combine the 3 and the output is the oscilattor out
Broadcaster4utechre: the frame is actually 3 diff matrices overlaid if you like, r g and b
Broadcaster4utechre: so i can use all 3 so i used a crossover to split them across the spectrum
Broadcaster4utechre: 2 crossovers
Broadcaster4utechre: so i put red stuff lower freq, green stuff is sort of melodic midrange, and blue is anything above that
Broadcaster4utechre: i did it to how the sort of warm/cool axis works around sounds in my head idk
Broadcaster4utechre: yeah
_: So, can you dial in colours, or are they chosen randomly
Broadcaster4utechre: its an algorithm
Broadcaster4utechre: colour is p interesting it turns out
Broadcaster4utechre: i like colour best of all the things i got into doing this
Broadcaster4utechre: the visuals are being controlled by certain events but its minimal interaction
Broadcaster4utechre: mostly its about the image changing the sound
_: I guess I’m curious how the visuals are informing the audio if the algorithm is taking the music into account. Is it a feedback loop?
Broadcaster4utechre: its luminance across all 3 clour planes
_: So i dont think s ean programmed key changes
Broadcaster4utechre: yeah the key i just set
Broadcaster4utechre: i can make it keep changing but u might feel sick after a bit
...
Broadcaster4utechre: all the oscillators in all the synths (incl drums) are reading the same wavetable are their respective frequencies
Broadcaster4utechre: it reads what's on the screen the same way a tv shows an image
Broadcaster4utechre: line by line, across and down
Broadcaster4utechre: each full frame is one cycle
Broadcaster4utechre: but as the oscillators are going at different rates sometimes the data in the wavetable changes before a cycle is complete
Broadcaster4utechre: it interpolates pretty well though
_: So the linear vector of RGB values is the wavetable? What triggers the envelopes?
Broadcaster4utechre: am just using stock objects to do this
Broadcaster4utechre: all the sequencing etc is just existing stuff, as were the synths before i swapped in these oscillators
Broadcaster4utechre: i mean the music is new but the patches used to sequence are existing
_: ahhh yeh so there's still a sequence of on off in each synth yeh?
Broadcaster4utechre: yeah the synths and drums etc are all doing what they would do anyway, just the wavetable in all the oscillators is changing
― an incoherent crustacean (MatthewK), Tuesday, 12 May 2020 06:20 (four years ago) link