ZAFAR ASOODEH, AMIR (2015) FACE AND FRAME CLASSIFICATION USING GEOMETRIC FEATURES FOR A DATA-DRIVEN EYEGLASS RECOMMENDATION SYSTEM. Masters thesis, Concordia University.
Preview |
Text (application/pdf)
125MBZafarAsoodeh_MSc-S2015.pdf - Accepted Version |
Abstract
Recommending glasses based on face and frame features is the main issue of this thesis. In this work we present an automatic shape extraction and classification method for face and eyeglass frame shapes. Our novel frame shape extraction algorithm can extract the polygonal shape of the frame accurately and reliably even for reflective sunglasses and thin metal frames. Additionally, we identify the key geometric features that can di↵erentiate reliably the shape classes and we integrate them into a supervised learning technique for face and frame shape classification. Finally, we incorporate the shape extraction and classification algorithms into a practical data-driven frame recommendation system that we validate empirically with a user study. Using a supervised learning technique, we identified the geometric discriminatory features that can be used to classify both the face type and the eyeglass type form a single photograph. Our classification method reaches near 90% accuracy. We ran this classification on over 200 photographs and we surveyed 100 people on the compatibility between face and eyeglasses. Using this data we created an eyeglass recommendation system that we have validated experimentally.
Divisions: | Concordia University > Gina Cody School of Engineering and Computer Science > Computer Science and Software Engineering |
---|---|
Item Type: | Thesis (Masters) |
Authors: | ZAFAR ASOODEH, AMIR |
Institution: | Concordia University |
Degree Name: | M. Comp. Sc. |
Program: | Computer Science |
Date: | 19 January 2015 |
Thesis Supervisor(s): | POPA, TIBERIU |
ID Code: | 979910 |
Deposited By: | AMIR ZAFAR ASOODEH |
Deposited On: | 13 Jul 2015 14:22 |
Last Modified: | 18 Jul 2019 15:11 |
References:
[1] What percentage of the population wears glasses? http://glassescrafter.com/ information/percentage-population-wears-glasses.html, 2013.[2] Roger L Terry and Carol S Brady. Effects of framed spectacles and contact lenses on self-ratings of facial attractiveness. Perceptual and motor skills, 42(3):789–790, 1976.
[3] URL http://www.framesdirect.com/landing/a/face-shape-guide.html.
[4] URL http://www.lenscrafters.com/lc-us/face-shape.
[5] URL http://iris.ca/choosing-the-right-frames-for-your-face-shape/.
[6] . URL http://www.youbeauty.com/face/sunglasses-for-square-face-shapes.
[7] Karl Grammer and Randy Thornhill. Human facial attractiveness and sexual se- lection: The role of symmetry and averageness. Journal of comparative psychology, 108(3):233, 1994.
[8] Joanna E Scheib, Steven W Gangestad, and Randy Thornhill. Facial attractiveness, symmetry and cues of good genes. Proceedings of the Royal Society of London. Series B: Biological Sciences, 266(1431):1913–1917, 1999.
[9] Randy Thornhill and Steven W Gangestad. Facial attractiveness. Trends in cogni- tive sciences, 3(12):452–460, 1999.
[10] Bernhard Fink and Ian Penton-Voak. Evolutionary psychology of facial attractive- ness. Current Directions in Psychological Science, 11(5):154–158, 2002.
[11] Ira D Papel. Computer imaging for facial plastic surgery. Facial plastic and recon- structive surgery (2nd edition), Thieme Medical Publishers, Inc, New York, pages 110–115, 2002.
[12] Find the best haircut for your face shape. http://www.allure.com/hair-ideas/ 2011/find-the-best-haircut-for-your-face-shape, 2014.
51
[13] How to find the best hairstyle for face shape. http://www.glamour.com/lipstick/ 2009/03/how-to-find-the-best-hairstyle-for-your-face-shape/1, 2014.
[14] URL http://www.lancome.ca/.
[15] . URL http://www.youbeauty.com/face/makeup-for-your-face-shape.
[16] Tommer Leyvand, Daniel Cohen-Or, Gideon Dror, and Dani Lischinski. Data-driven enhancement of facial attractiveness. ACM Transactions on Graphics (Proceedings of ACM SIGGRAPH 2008), 27(3), August 2008.
[17] Andrea Bottino and Aldo Laurentini. The analysis of facial beauty: an emerging area of research in pattern analysis. In Image Analysis and Recognition, pages 425–435. Springer, 2010.
[18] Fangmei Chen and David Zhang. A benchmark for geometric facial beauty study. In David Zhang and Milan Sonka, editors, Medical Biometrics, volume 6165 of Lecture Notes in Computer Science, pages 21–32. Springer Berlin Heidelberg, 2010. ISBN 978-3-642-13922-2. doi: 10.1007/978-3-642-13923-9 3. URL http://dx.doi.org/ 10.1007/978-3-642-13923-9_3.
[19] Ashok Samal and Prasana A Iyengar. Automatic recognition and analysis of human faces and facial expressions: A survey. Pattern recognition, 25(1):65–77, 1992.
[20] Jianguo Wang and Tieniu Tan. A new face detection method based on shape information. Pattern Recognition Letters, 21(6):463–471, 2000.
[21] Erik Hjelm ̊as and Boon Kee Low. Face detection: A survey. Computer vision and image understanding, 83(3):236–274, 2001.
[22] Jason M Saragih, Simon Lucey, and Jeffrey F Cohn. Face alignment through sub- space constrained mean-shifts. In Computer Vision, 2009 IEEE 12th International Conference on, pages 1034–1041. IEEE, 2009.
[23] Sandro Sch ̈onborn, Andreas Forster, Bernhard Egger, and Thomas Vetter. A monte carlo strategy to integrate detection and model-based face analysis. In Pattern Recognition, pages 101–110. Springer, 2013.
[24] Christopher K Riesbeck and Roger C Schank. Inside case-based reasoning. Psy- chology Press, 2013.
[25] Kang B Sun and Boaz J Super. Classification of contour shapes using class seg- ment sets. In Computer Vision and Pattern Recognition, 2005. CVPR 2005. IEEE Computer Society Conference on, volume 2, pages 727–733. IEEE, 2005.
52

53
[26] Lena Gorelick, Meirav Galun, Eitan Sharon, Ronen Basri, and Achi Brandt. Shape representation and classification using the poisson equation. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 28(12):1991–2005, 2006.
[27] Jamie Shotton, Andrew Blake, and Roberto Cipolla. Multiscale categorical object recognition using contour fragments. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 30(7):1270–1281, 2008.
[28] Xinggang Wang, Bin Feng, Xiang Bai, Wenyu Liu, and Longin Jan Latecki. Bag of contour fragments for robust shape classification. Pattern Recognition, 47(6): 2116–2125, 2014.
[29] Zhong Jing and Robert Mariani. Glasses detection and extraction by deformable contour. In Pattern Recognition, 2000. Proceedings. 15th International Conference on, volume 2, pages 933–936. IEEE, 2000.
[30] Haiyuan Wu, Genki Yoshikawa, Tadayoshi Shioyama, Shihong Lao, and Masato Kawade. Glasses frame detection with 3d hough transform. In Pattern Recognition, 2002. Proceedings. 16th International Conference on, volume 2, pages 346–349. IEEE, 2002.
[31] Michelle Lai, Ipek Oru ̧c, and Jason JS Barton. The role of skin texture and facial shape in representations of age and identity. Cortex, 49(1):252–265, 2013.
[32] Jeong-Seon Park, You Hwa Oh, Sang Chul Ahn, and Seong-Whan Lee. Glasses removal from facial image using recursive pca reconstruction. In Audio-and Video- Based Biometric Person Authentication, pages 369–376. Springer, 2003.
[33] Jeong-Seon Park, You Hwa Oh, Sang Chul Ahn, and Seong-Whan Lee. Glasses removal from facial image using recursive error compensation. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 27(5):805–811, 2005.
[34] Chenyu Wu, Ce Liu, Heung-Yueng Shum, Ying-Qing Xy, and Zhengyou Zhang. Automatic eyeglasses removal from face images. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 26(3):322–336, 2004.
[35] Xiaodong Jia and Jiangling Guo. Eyeglasses removal from facial image based on phase congruency. In Image and Signal Processing (CISP), 2010 3rd International Congress on, volume 4, pages 1859–1862. IEEE, 2010.
[36] Yi Xiao and Hong Yan. Extraction of glasses in human face images. In Biometric Authentication, pages 214–220. Springer, 2004.
54
[37] Diana Borza, Adrian Sergiu Darabant, and Radu Danescu. Eyeglasses lens contour extraction from facial images using an efficient shape description. Sensors, 13(10): 13638–13658, 2013.
[38] Agnar Aamodt and Enric Plaza. Case-based reasoning: Foundational issues, methodological variations, and system approaches. AI communications, 7(1):39– 59, 1994.
[39] Jack Sklansky. Finding the convex hull of a simple polygon. Pattern Recognition Letters, 1(2):79–83, 1982.
[40] John Canny. A computational approach to edge detection. Pattern Analysis and Machine Intelligence, IEEE Transactions on, (6):679–698, 1986.
[41] URL http://www.glassesusa.com.
Repository Staff Only: item control page