I am having difficulty finding information online about SC reacting to visuals on screen. The opposite of what I’m looking for (visuals created from audio input) by the likes of processing.org is easy enough to find/understand.
However, I am looking to use SC and whatever other programs in order to compose music from a short piece of film. For example, there are apps/softwares that can use a camera in order to track movement which is translated into midi data (essentially a theremin) but mine would be inputting a film and outputting sounds based on that.
Admittedly this might be far too ambitious but even if it could read something from the video (such as colour or movement) and then react accordingly (changing timbre, frequency).
Any advice would be great! Apologies for such a long question, cheers!