OpenPose Unity Plugin is a wrapper of the OpenPose library for Unity users. It provides formatted OpenPose output and some examples. OpenPose is a real-time multi-person system able to jointly detect human body, hand, facial, and foot keypoints (in total 135 keypoints) on single images.
The OpenPose Unity Plugin project is authored by Tianyi Zhao, Gines Hidalgo, and Yaser Sheikh. Currently, it is being maintained by Tianyi Zhao and Gines Hidalgo.
Demo/tutorial video of the working system.
Tianyi Zhao (left) and Gines Hidalgo (right) testing the OpenPose Unity Plugin
This is an alpha release, everything is subject to change. The plugin will finally be available in Unity Assets store in the future.
Testing the OpenPose Unity Plugin for body and foot detection
Testing the OpenPose Unity Plugin for body, foot, face, and hand detection
Follow the steps in the installation documentation in doc/installation.md.
Please cite these papers in your publications if it helps your research (the face keypoint detector was trained using the procedure described in [Simon et al. 2017] for hands):
@inproceedings{cao2018openpose,
author = {Zhe Cao and Gines Hidalgo and Tomas Simon and Shih-En Wei and Yaser Sheikh},
booktitle = {arXiv preprint arXiv:1812.08008},
title = {Open{P}ose: realtime multi-person 2{D} pose estimation using {P}art {A}ffinity {F}ields},
year = {2018}
}
@inproceedings{cao2017realtime,
author = {Zhe Cao and Tomas Simon and Shih-En Wei and Yaser Sheikh},
booktitle = {CVPR},
title = {Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields},
year = {2017}
}
@inproceedings{simon2017hand,
author = {Tomas Simon and Hanbyul Joo and Iain Matthews and Yaser Sheikh},
booktitle = {CVPR},
title = {Hand Keypoint Detection in Single Images using Multiview Bootstrapping},
year = {2017}
}
@inproceedings{wei2016cpm,
author = {Shih-En Wei and Varun Ramakrishna and Takeo Kanade and Yaser Sheikh},
booktitle = {CVPR},
title = {Convolutional pose machines},
year = {2016}
}
Links to the papers:
- OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields
- Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields
- Hand Keypoint Detection in Single Images using Multiview Bootstrapping
- Convolutional Pose Machines
OpenPose Unity Plugin is freely available for free non-commercial use, and may be redistributed under these conditions. Please, see the license for further details. Interested in a commercial license? Check this FlintBox link. For commercial queries, use the Directly Contact Organization section from the FlintBox link and also send a copy of that message to Yaser Sheikh.