MR Particle Live - 夏の魔法 ⁄ ∗Luna

A particle live world made with *Luna’s song “Natsu no Mahou.” The concept is Particle Live x Mixed Reality: making VRChat avatars appear in the real world.

It uses Virtual Desktop passthrough and green-screen keying to remove the green background and leave only the avatar. That avatar-only image is composited onto the HMD camera passthrough feed to create a pseudo-MR effect.

I wanted to express motion graphics inside VRChat, so I exported motion footage with transparency from After Effects and timed its appearance through the video player. Because alpha areas become black in the player, I exported the footage with a green background and keyed out only the green with the video player shader.

The dance motion was performed by someone from the same group. We first tried capturing with PERCEPTION NEURON 2.0, but it did not work well, so we used Pico Motion Trackers and recorded inside VRChat.

The world is packed with small references to the key visuals and music from *Luna’s MV, resulting in a very summer-feeling world. The gimmicks are a little particular, but if you have Virtual Desktop and an HMD with color passthrough, please try the MR mode. Desktop is also supported, and it can be viewed as a regular particle live experience.