Experimenting with hand gesture tracking in a live coding setting:
2 Likes
Wow, thats a really fun concept!
I really like the idea of getting other peoples Code and builiding on that, seems to me this opens up the possibilites of live and public thinking quite a bit.
How exactly do you do the hand tracking?
Hey thanks! I am using HandPose-OSC (GitHub - faaip/HandPose-OSC: Handtracking using MediaPipe HandPose. Runs as an Electron app and outputs OSC) to capture the keypoints of the hand and send them to SuperCollider through OSC. I calculate the distances of the fingertips to the palm or the thumb tip. Then, I use some custom functions to map these distances to parameters inside the Ndefs, which are modified SCTweets. So, in principle, I am live coding the mappings between the fingertips and the parameters of the SCTweets.
1 Like