TX Image Synth App

[TXMod]

Hi all,

I’ve made a SuperCollider app for generating sounds based on images used as sonograms:

You can find it here: GitHub - txmod/TXImageSynthApp: SuperCollider App for generating sounds based on images used as sonograms. · GitHub

Images can be created by analysing a sound file, by importing an existing image file, or by drawing coloured lines or shapes using the image tools provided.
Image files can be saved or imported.
The sonogram image can be synthesised using filtered noise, sine waves, phase modulation synthesis or wavetable synthesis.
EQ, frequency warping, time stretching, pitch shifting, delay and reverb can be added.
Recordings can be saved as Sound files.
Project files, containing images and settings, can be saved.

This app was developed from code originally shared by PyoungRyang Ko in this thread:

A sketch to make an image filter similar to the image filter in AudioSculpt

Dear users, The following is a simple sketch to mimic the image filter in AudioSculpt: ( s.waitForBoot { var length = 5; // seconds var image = Image.new( SCDoc.helpSourceDir +/+ "images" +/+ // "icon.supercollider.png" // "vline.png" "node.png" // "lastnode.png" // "flowers2.jpg" // "duck_alpha.png" // "vduck2.jpg" // "Swamp.png" ); var lastFreqIndex = image.height - 1; var lastTimeDomainIndex = image.width - 1; var numSpectrumsInTimeDomain = (0..las…

Big thanks to all who share their code.

More examples:

Have fun!
Best,
Paul

p.s. This is part of a new release of TX Modular I’m currently working on. More later…

[jamshark70]

Coincidentally enough, literally just a few days ago, a video popped up in my feed about software used by Aphex Twin, leading off with Metasynth (and also mentioning SuperCollider, even with an old photo of James McCartney hanging with RDJ back in the day). Bringing those two worlds together with a slick looking GUI is very cool – thanks to you both.

hjh

[prko]

Thank you for the app, and for mentioning my initial code. I wanted to look into it further, but I did not have the time. In any case, I do not think I could have done a better job than you. Thank you for this wonderful app!

Note:
Recent SC 3.15.0-dev builds include plugin API changes, so they are not compatible with SC3-plugins. SC 3.14.1 and older SC 3.15.0-dev builds should be compatible with this app.

[dscheiba]

Wow, this is really cool - thanks for sharing. File-export didn’t work for me though, but I also have not installed all necessary quarks/plugins, so I only can share a recording/screenshot

I noticed that drawing in the canvas while playing works, but it does not update the scheduled sounds.

@jamshark70

(and also mentioning SuperCollider, even with an old photo of James McCartney hanging with RDJ back in the day).

For those who are unaware^^

which is shown in the viedo https://www.youtube.com/watch?v=5wIOBBodoic which is really interesting.

[TXMod]

Many thanks for feedback.

@prko

Recent SC 3.15.0-dev builds include plugin API changes, so they are not compatible with SC3-plugins

Oh. Is that a permanent thing, or do they all need updating or do they just need to be re-compiled? IMHO it would be a big shame to lose all those great plugins.

@dscheiba

I noticed that drawing in the canvas while playing works, but it does not update the scheduled sounds.

Yes. You have to press play again after changing the image.

Best,
Paul

[prko]

@TXMod

Oh. Is that a permanent thing, or do they all need updating or do they just need to be re-compiled? IMHO it would be a big shame to lose all those great plugins.

SC3-Plugins are maintained by the SC3 developers, so I expect a version compatible with SC3.15.x to be released together with SC3.15.0 or soon after. However, other libraries or packages, such as Quarks and third-party extensions, may not be compatible unless their authors, or interested users, update them.

[jordan]

@Spacechild1 don’t the plugins just need to be recompiled?

[Spacechild1]

Yes, they just have to be recompiled.

[TXMod]

That’s good to know! Thanks.