Wake Project-A Guided Mixed Reality Experience

This semester I collaborated with Anna Henson as a technical assistant on creating a mixed-reality piece called Wake. The project uses Intel RealSense Depth Camera and HTC Vive to bring video streaming of a dancer in the real world into virtual reality. I mainly worked on a shader that integrates the video cut-off of the dancer into the environment. I also worked on improving the line rendering in the existing project so that it follows the player more closely. I have also created debug assets for visualizing the planned path. Below is a video from our last play test.

 The project is currently still under development and I have been working on adding lighting passes to the customized depth camera shader. I also added a fake shadow pass so that the video feeds would generate shadows on the ground. The shadow has greatly helped creating a feeling of 3D for the streamed video of dancer in VR.