A Novel to Identify Multiple faces by tracking 2D Face Images over 3D Plane

Dayanand G Savakar - Rani Channamma University, Karnataka, India
Ravi Hosur - BLDEA’s V. P. Dr. P. G. Halakatti College of Engineering & Technology, Karnataka, India

Citation Format:

DOI: http://dx.doi.org/10.30630/joiv.3.2.237


Nowadays, face recognition is very much effective way of counter security threats in various aspects of human life. Though, other means of defending security attacks exists but they have their own drawbacks and overheads. Human face can be recognized from 2D face images or from 3D geometry of human faces. Although very popular, 2D face recognition algorithms are constrained by various factors like change in illumination, varying facial expressions, make-up on the face and orientation of the head. On the other hand face recognition based on 3D geometry of the faces has been shown to have more correctness than 2D face recognition. The only technological drawback however is that the 3D cameras are much less common than 2D based cameras. Therefore the work propose a novel facial expression recognition in real-time by tracking 2D face over a 3D plane. We use multiple 2D planes projected on each-other such that a 2D facial feature point is projected over all the planes, selecting the closest points over the plane and finally creating a contour enclosing the projected feature point over multiple planes, thereby creating a 3D tracking plane with 2D feature point. We use Cambridge landmark markers [4, 5] for facial tracking with multiple Homomorphic projection [5] for creating the 3D feature points. This technique has been proven better in terms of accuracy improvement.


Landmark; projection; geometry; 2D face; plane; tracking.

Full Text:



Laszlo Jeni, Jeff Cohn, and Takeo Kanade, “Dense 3D face alignment from 2D videos in real-timeâ€, IEEE International Conference on Automatic Face and Gesture Recognition (FG), 2015

Joseph Rath et al. “Adaptive 3D Face Reconstruction from Unconstrained Photo Collectionsâ€, The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016, pp. 4197-4206

Raghabendra et al. “3D Face Reconstruction and Multimodal Person Identification from Video Captured Using Smartphone Cameraâ€, IEEE International Conference on Technologies for Homeland Security (HST), 2013

Amin et al. “Large-pose Face Alignment via CNN-based Dense 3D Model Fittingâ€, The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016, pp. 4188-4196

Syed Zulqarnain, Gilani Faisal, Shafait Ajmal Mian, “Shape-based Automatic Detection of a Large Number of 3D Facial Landmarksâ€, CVPR 2015, PP. 4639-4648

Wang, N., Gao, X., Tao, D., & Li, X. (2014). Facial feature point detection: A comprehensive survey. arXiv preprint arXiv:1410.1037.

Cootes, T., Taylor, C., & Lanitis, A. (1994) Active shape models: Evaluation of a multi-resolution method for improving image search. In BMVC vol. 1, (pp. 327–336).

Matthews, I., & Baker, S. (2004). Active appearance models revisited. International Journal of Computer Vision, 60(2), 135–164.

Liu, X. (2009). Discriminative face alignment. IEEE Transactions on Pattern Analysis and Machine Intelligence, 31(11), 1941–1954

Liu, X. (2010). Video-based face model fitting using adaptive active appearance model. Journal of Image Vision Computing, 28(7), 1162–1172.

Valstar, M., Martinez, B., Binefa, X., & Pantic, M. (2010) Facial point detection using boosted regression and graph models. In CVPR pp. 2729–2736.

Cao, C., Weng, Y., Zhou, S., Tong, Y., & Zhou, K. (2014). Facewarehouse: A3Dfacial expression database for visual computing. IEEE Transactions on Visualization and Computer Graphics, 20(3), 413–425.

Zhang, J., Zhou, S.K., Comaniciu, D., & McMillan, L. (2008). Conditional density learning via regression with application to deformable shape segmentation. In CVPR (pp. 1–8).