<aside> 👁️‍🗨️ Artists: Kait Ramsden and erψn temp3st

Artist Social Media: @communikait__ and @siwwybwett

</aside>

https://youtu.be/RaAi6pK6edc?feature=shared

Technical implementation

For our live online performance set up we used OBS to do basic live video mixing using chromakey filters and occasional color correction tools. Using 2 webcams we sent our composite image to Zoom. Our live performance involved a blending of live and pre-recorded material. For sound we used a pre-recorded track played on a separate laptop hooked up to an audio interface. The interface used a software called focusrite and we sent the sound directly from focusrite to Zoom.

Our pre-recorded material and digital assets were created beforehand. 3D objects were made or downloaded and animated in Blender to be played with transparent backgrounds later in OBS. To make the avatars we used Polycam to scan the body and imported the 3D scans into Blender. I used a combination of Deep Motion and Rokoko to create motion capture data from our improvisational dancing and attached the data to the 3D scans using animation rigs. These animations were exported as videos and played through OBS. I also used motion tracking in Blender to create an AR scene, placing a 3D object into a video of a physical space. I edited various of these scenes in Davinci Resolve. I also used Unity to make a video game scene involving a 2D puppet created out of an image of one of the Avatars.

Our sound was a mix of recorded vocals and samples of “medieval music” and mechanical sounds. We used an MPC 1000 to sample and jam live, an RC 505 loop station to play with vocals, and we later reorganized our jams using Ableton. I further effected the sound using Waves and Fab Filter plug-ins.

Procreate was used to draw the titles, some of the backgrounds, and the castle shown in doublevision. The titles were then imported into Premiere Pro and animated using keyframing.

Software and hardware used

Blender, OBS, Zoom, Ableton, Rokoko, Deep Motion, Davinci Resolve, Unity, Polycam, Focusrite, Procreate, Premiere Pro

Untitled

How does it support the concept?

We were interested in blending physical and virtual objects and scenographies and found the technology supportive in this effort. Since the performance lived in the composite image broadcasted to an online audience we were able to explore layering effects using transparent videos, chroma-key, and AR video effects to create a performance environment containing both physical bodies and spaces juxtaposed with virtual objects that either populated the scenes or behaved like frames, backgrounds, and foregrounds.

We were interested in making copies of our props and our bodies and so we used technology to achieve this. Doublevision explores ideas of replication and duetting and the softwares and hardwares we used allowed us to create digital 3D versions of our bodies. SInce we wanted to dance alongside these avatars we used the tech to animate them using motion capture of our improvisational dancing. The technologies helped us to render digital versions both of our bodies and our movement, exposing limitations and opening spaces for further choreographic exploration.

Why were you interested in using this technology? Why was it important for this project? Could you do it without the technology?

We wanted to work with collage as an aesthetic and found that, by blending the results from many different softwares, we were able to achieve an interesting blend of effect and aesthetic, creating a disjointed and cobbled sensibility which supported our vision. We chose to use OBS as our broadcasting software for its ease when working with multiple cameras and its ability to blend edited and live materials.