Make sure you set playback to 4k in options above

Custom stereo head mounted camera for facial motion capture and full body motion capture with Move.AI

This was a small project to test out my custom Stereo Head Mounted Camera ( HMC).

Facial motion capture was created with Unreal Engine Metahuman Animator. Facial data is pretty much raw from MHA. I tweaked the eyeblinks to make sure they closed and set a constraint for the eye lookAt.  I could spend a lot more time on refining data but I want to optimise the configuration of the HMC first.

THe HMC was built with carbon fibre rods and a welding helmet frame. All other parts I 3d printed. 

I use the video out of the Gopro attached to an Atomos Ninja to make sure the HMC camera is aligned properly before recording.

Video record at 2.7k 60fps

Total project time was ~ two weeks over 2023/24 break, including construction of headset (many prototypes) mocap, scene setup and rendering. 

I intend to open source all of the stl  files for the 3d printed parts and the code for the data transfer and processing once complete. 

HMC in frame. The frame protects the bottom of the headset when not in use and is very useful for carrying out calibrations
Detail of camera configuration. Top gopro is connected to Atmos Ninja for correct alignment once worn.
HMC out of frame. Battery and RODE WIreless transmitter for audio at rear. 
Output of two cameras

Full body Motion capture with Move.AI

Full body mocap was created with Move.AI .
 
Setup is six GoPros. recording at 1080p 60fps Linear FOV

Custom scripts download and process all files via wifi. 
Raw Output from Move.AI . No filtering
Click and drag to orbit camera. 

Right mouse to Pan Camera 

Scroll wheel or Pinch to Zoom in Out. 

This is Atomic

All the pages you see here are built with the sections & elements included with Atomic. Import any page or this entire site to your own Oxygen installation in one click.
GET OXYGEN
linkedin facebook pinterest youtube rss twitter instagram facebook-blank rss-blank linkedin-blank pinterest youtube twitter instagram