03.04.17

Faces become the screen for 1000 fps projection mapping show

A collaboration between Nobumichi Asai, a creative director of a Japanese visual studio called WOW, production company TOKYO, dance duo AyaBambi, and the Ishikawa Watanabe Laboratory at the University of Tokyo has resulted in an incredible video project showing 1000 fbs projection mapping on the dancer's faces.

The mapping system the team created made it possible to follow the facial and hand movements of dance duo AyaBambi.performances, which was impossible until now, thanks to the use of 1000 fps projector DynaFlash and ultra high speed sensing.

The projector was jointly developed by the Ishikawa Watanabe Laboratory at the University of Tokyo and Tokyo Electron Device.

The team oversaw the technology, which had to combine the 1,000 frames per second projector, with 3D mapping for depth measurement and 2D tracking that has less than ten milliseconds delay to match

To make sure the images matches the facial expressions to the millisecond, the WOW team, Professor Watanabe, and Tomoaki Teshima (EXVISION), were able to trim several milliseconds during a trial and error period that lasted approximately three months, enabling the completion of this system.

The projected image looks like it is integrated into part of the skin, and the expressions on a subject’s face, when it is distorted or transformed, are exponentially enhanced.