AllofUs was asked to help create this exciting project which involved transforming a store window into an interactive display that engaged visitors in a unique sensory experience. A 15-foot video wall and HD camera setup captured the view from the window and augmented the scene with generative visuals and responsive sound effects, creating a large-scale interactive "mirror".
We used a 5x5 video wall driven by custom software developed using openFrameworks. A Mac Pro fitted with a Blackmagic Intensity Pro The capture card provided the software with a feed from a high-definition video camera. This camera feed was analyzed with an optical flow algorithm to detect motion and a Microsoft Kinect camera was used to provide information about visitors' proximity to the display.
I contributed to the visual effects programming, sound effect interaction, Kinect camera interaction, scene transitions, and helped to develop internal tools which allowed for a more efficient workflow. My role also required collaboration with various project stakeholders from internal and client teams, AV integrators, and a film crew to ensure all aspects of this project were delivered smoothly and to the highest of standards.