Crypto Comedy Club

Contracted out by a small team with plans to launch a Comedy Club in the Metaverse tied to custom NFT metadata and the $LOL token.

Devices tested:

• Oculus Quest 1/2
• Pico 2/3

Technologies used:

• VRoid SDK (Avatars)
• ReadyPlayerMe SDK (Avatars)
• OculusVR SDK
• UnityXR SDK
• PicoVR SDK

Due to an NDA im not legally allowed to show the NFT portion of this project.

The BlockChain

Implementing the blockchain took some work, however at the time we got it working due to an SDK called Moralis that was coming out at the time. Token and NFT transactions were able to take place using the connected Web3 wallet.

One of the main features is being able to hop into a theatre and watch a comedian perform a live or recorded session with your friends.

Physics Based Hand-Tracked Posing

One of the main problems with HandTracking is the immersion break a user experiences when they reach out to grab a virtual object. Usually the virtual hands that mimic the real world hands end up clipping through the object the user is grabbing. This is my attempt to fix that.

During my time at CCC I prototyped procedural hand poses when grabbing things with pure hand tracking. Each fingers Inverse Kinematic system is programmed to bend until a collider is detected.

Working with ReadyPlayerMe Avatars

The final PlayerController looked something like this with a live RPM Avatar.

With both Hand and Controller tracked interaction!

The UI eventually worked well enough.

Good enough to test out Peer2Peer Networking for the first time!

However there were some bugs involving Physics that didn't go well over the network.

Audience Taming

Stress testing remote player count. Turns out even low quality avatars were such a big performance hit.

So I just used voxelized avatars for the audience which solved the performance hit from a full house.