Role: Software Lead
Location: Red Hook, Brooklyn, NY
Client: A_DA
Work: Technoechophenomena is an interactive audio and light experience, based on the music and work of Moses Sumney. It was created by Sumney in concert with A_DA, the interactive arm of Listen, with technical sponsorship from Microsoft.
I contributed to the project as the Kinect Developer and Software Systems Architect. Using 4 Kinect Azure cameras, I parsed data about user location and body position. This included writing a custom pose detector using the C# Kinect Azure API. User data from each camera was then combined and unified into a single data feed.
The user data feed was then used by a custom cue management system, written in node.js. The cue manager forwards cues in real time to both the audio and lighting systems, using OSC and sACN, respectively.
Technology: C#, Kinect Azure API, Node.js, OSC, sACN
Publication: Moses Sumney’s technoechophenomena As Therapy