Magic Butterfly
Computer scientists from , the 性视界鈥檚 motion capture research centre worked with award-winning VR/AR content production agency, REWIND, on the project for Welsh National Opera (WNO).
Visitors enter a specially designed shipping container and don a Google Daydream View VR headset to be immersed into scenes from the operas Madam Butterfly and The Magic Flute.
Called the Magic Butterfly VR Experience, it combines high quality imagery and sounds and allows viewers to interact with the performance in 3D.
Simulating the movement of clothes
The project involved capturing body and face motion data from world renowned soprano, Karah Son, whilst she performed the much-loved aria, 鈥楿n Bel Di,鈥� from Puccini鈥檚 opera, Madam Butterfly.
The capture involved finding a solution to capturing the fluttering movement of the sleeves on the digital Madam Butterfly avatar鈥檚 kimono.
As cloth simulations can be problematic in real time, CAMERA Head of Studio, Martin Parsons, found a novel solution involving attaching netting with light-reflecting markers to Karah鈥檚 arms to simulate the movement of the fabric.
Parsons commented: 鈥淭he solution worked really well and provided an invaluable insight into how the fabric movement will look when fully rendered in the environment. The final WNO project is an immersive, stylised and very beautiful virtual reality experience of the aria performed by Karah Son.鈥�
Bringing a classic stage performance into the virtual world
David Massey Digital Producer at Welsh National Opera said: 鈥淚t was a pleasure working with CAMERA on our Magic Butterfly experience.
鈥淭he team at CAMERA have helped us deliver our vision by translating Karah's spellbinding performance into VR.
鈥淥ne of our aims was is to see if audiences could emotionally respond to Karah鈥檚 performance as she performs as an avatar 鈥� the initial response has been overwhelmingly positive and in part we have CAMERA to thank for helping us to realise this pioneering piece of theatre.鈥�
Greg Furber, VR Director at REWIND, said: 鈥淐AMERA was the perfect team to partner with on the creation of the Madam Butterfly VR experience.
鈥淭heir assistance in solving the performance's unique challenges was invaluable and helped us make a captivating VR experience that brings a classic performance from the stage into the virtual world, offering a unique performance of Madam Butterfly.鈥�
People can visit the free experience at Cardiff Bay until 14 October, which will then be viewed at Birmingham Hippodrome Square between 30 October 鈥� 5 November at the Albert Dock in Liverpool from 9-12 November, finishing the tour at the Victoria & Albert Museum from 19-21 January 2018.