Improving free-viewpoint video content production using RGB-camera-based skeletal tracking

Drew MacQuarrie & Anthony Steed. 2020.

2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)

Free-Viewpoint Video (FVV) is a type of volumetric content in which an animated, video-textured 3D mesh of a character performance is constructed using data from an array of cameras. Previous work has demonstrated excellent results when creating motion graphs from FVV content, but these techniques are often prohibitively expensive in practice. We propose the use of skeletons to identify cut points between FVV clips, allowing a minimal set of frames to be processed into a 3D mesh. While our method performed with 2.8% poorer accuracy than the state-of-the-art for our synthetic dataset, cost and processing time requirements are dramatically reduced.

Read the full paper here ›

Citation

MacQuarrie, A., & Steed, A. (2020). Improving free-viewpoint video content production using rgb-camera-based skeletal tracking. 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW) (pp. 774–775).

BibTeX

@inproceedings{macquarrie2020improving, title={Improving free-viewpoint video content production using RGB-camera-based skeletal tracking}, author={MacQuarrie, Andrew and Steed, Anthony}, booktitle={2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)}, pages={774--775}, year={2020}, organization={IEEE} }