This was a small project to test out my custom Stereo Head Mounted Camera ( HMC).
Facial motion capture was created with Unreal Engine Metahuman Animator. Facial data is pretty much raw from MHA. I tweaked the eyeblinks to make sure they closed and set a constraint for the eye lookAt. I could spend a lot more time on refining data but I want to optimise the configuration of the HMC first.
THe HMC was built with carbon fibre rods and a welding helmet frame. All other parts I 3d printed.
I use the video out of the Gopro attached to an Atomos Ninja to make sure the HMC camera is aligned properly before recording.
Video record at 2.7k 60fps
Total project time was ~ two weeks over 2023/24 break, including construction of headset (many prototypes) mocap, scene setup and rendering.
I intend to open source all of the stl files for the 3d printed parts and the code for the data transfer and processing once complete.