Kabir, Waziha, Ahmad, M. Omair 
ORCID: https://orcid.org/0000-0002-2924-6659 and Swamy, M. N. S. ORCID: https://orcid.org/0000-0002-3989-5476
(2019)
A Multi-Biometric System Based on Feature and Score Level Fusions.
IEEE Access, 7
.
pp. 59437-59450.
ISSN 2169-3536
Preview |
Text (application/pdf)
2MBKabir-IEEE Access-2019.pdf - Published Version Available under License Spectrum Terms of Access. |
Official URL: http://dx.doi.org/10.1109/ACCESS.2019.2914992
Abstract
In general, the information of multiple biometric modalities is fused at a single level, for example, score level or feature level. The recognition accuracy of a multimodal biometric system may not be improved by carrying fusion at a single level, since one matcher may provide a performance lower than that provided by other matchers. In view of this, we propose a new fusion scheme, referred to as the matcher performance-based (MPb) fusion scheme, in which the fusion is carried out at two levels, feature level, and score level, to improve the overall recognition accuracy. First, we consider the performance of the individual matchers in order to find out which of the modalities should be used for fusion at the feature level. Then, the selected modalities are fused at this level by utilizing their encoded features. Next, we fuse the score obtained from the feature-level fusion with that of the modality for which the performance is the highest. In order to carry out this fusion, a new normalization technique referred to as the overlap extrema-variation-based anchored min-max (OEVBAMM) normalization technique, is also proposed. By considering three modalities, namely, fingerprint, palmprint, and earprint, the performance of the proposed fusion scheme as well as that of the single level fusion scheme, both with various normalization and weighting techniques are evaluated in terms of a number of metrics. It is shown that the multi-biometric system based on the proposed fusion scheme provides the best performance when it employs the new normalization technique and the confidence-based weighting (CBW) method.
| Divisions: | Concordia University > Gina Cody School of Engineering and Computer Science > Electrical and Computer Engineering |
|---|---|
| Item Type: | Article |
| Refereed: | Yes |
| Authors: | Kabir, Waziha and Ahmad, M. Omair and Swamy, M. N. S. |
| Journal or Publication: | IEEE Access |
| Date: | 2019 |
| Funders: |
|
| Digital Object Identifier (DOI): | 10.1109/ACCESS.2019.2914992 |
| Keywords: | Biometrics, feature level fusion, multi-biometric system, normalization, score level fusion |
| ID Code: | 986013 |
| Deposited By: | Krista Alexander |
| Deposited On: | 04 Oct 2019 19:45 |
| Last Modified: | 04 Oct 2019 19:45 |
References:
1. A. A. Ross, K. Nandakumar, A. K. Jain, Handbook of Multibiometrics, New York, NY, USA:Springer, 2011.2. E. Fuster-Garcia, A. Bresó, J. Martínez-Miranda, J. Rosell-Ferrer, C. Matheson, J. M. García-Gómez, "Fusing actigraphy signals for outpatient monitoring", Inf. Fusion, vol. 23, pp. 69-80, May 2015.
3. C. Haynes, M. Todd, "Enhanced damage localization for complex structures through statistical modeling and sensor fusion", Mech. Syst. Signal Process., vol. 54, pp. 195-209, Mar. 2015.
4. M. M. Monwar, M. L. Gavrilova, "Multimodal biometric system using rank-level fusion approach", IEEE Trans. Syst. Man Cybern. B Cybern., vol. 39, pp. 867-878, Aug. 2009.
5. A. Kumar, S. Shekhar, "Personal identification using multibiometrics rank-level fusion", IEEE Trans. Syst. Man Cybern. C Appl. Rev., vol. 41, no. 5, pp. 743-752, Sep. 2011.
6. M. R. Alam, M. Bennamoun, R. Togneri, F. Sohel, "A confidence-based late fusion framework for audio-visual biometric identification", Pattern Recognit. Lett., vol. 52, pp. 65-71, Jan. 2015.
7. H. S. Bhatt, R. Singh, M. Vatsa, "On recognizing faces in videos using clustering-based re-ranking and fusion", IEEE Trans. Inf. Forensics Security, vol. 9, no. 7, pp. 1056-1068, Jul. 2014.
8. P. P. Paul, M. L. Gavrilova, R. Alhajj, "Decision fusion for multimodal biometrics using social network analysis", IEEE Trans. Syst. Man Cybern. Syst., vol. 44, no. 11, pp. 1522-1533, Nov. 2014.
9. R. Nishii, "A Markov random field-based approach to decision-level fusion for remote sensing image classification", IEEE Trans. Geosci. Remote Sens., vol. 41, no. 10, pp. 2316-2319, Oct. 2003.
10. Q. Tao, R. Veldhuis, "Threshold-optimized decision-level fusion and its application to biometrics", Pattern Recognit., vol. 42, no. 5, pp. 823-836, May 2009.
11. A. Nagar, K. Nandakumar, A. K. Jain, "Multibiometric cryptosystems based on feature-level fusion", IEEE Trans. Inf. Forensics Security, vol. 7, no. 1, pp. 255-268, Feb. 2012.
12. Y. Xin et al., "Multimodal feature-level fusion for biometrics identification system on iomt platform", IEEE Access, vol. 6, pp. 21418-21426, 2018.
13. X.-Y. Jing, Y.-F. Yao, D. Zhang, J.-Y. Yang, M. Li, "Face and palmprint pixel level fusion and kernel DCV-RBF classifier for small sample biometric recognition", Pattern Recognit., vol. 40, no. 3, pp. 3209-3224, Nov. 2007.
14. Y.-F. Yao, X.-Y. Jing, H.-S. Wong, "Face and palmprint feature level fusion for single sample biometrics recognition", Neurocomputing, vol. 70, no. 7, pp. 1582-1586, 2007.
15. R. Raghavendra, B. Dorizzi, A. Rao, G. H. Kumar, "Designing efficient fusion schemes for multimodal biometric systems using face and palmprint", Pattern Recognit., vol. 44, no. 5, pp. 1076-1088, May 2011.
16. W. Yang, X. Huang, F. Zhou, Q. Liao, "Comparative competitive coding for personal identification by using finger vein and finger dorsal texture fusion", Inf. Sci., vol. 268, no. 6, pp. 20-32, 2014.
17. M. Haghighat, M. Abdel-Mottaleb, W. Alhalabi, "Discriminant correlation analysis: Real-time feature level fusion for multimodal biometric recognition", IEEE Trans. Inf. Forensics Security, vol. 11, no. 9, pp. 1984-1996, Sep. 2016.
18. Y. Lei, M. Bennamoun, A. A. El-Sallam, "An efficient 3D face recognition approach based on the fusion of novel local low-level features", Pattern Recognit., vol. 46, pp. 24-37, Jan. 2013.
19. W. Li, D. Zhang, L. Zhang, G. Lu, J. Yan, "3-D palmprint recognition with joint line and orientation features", IEEE Trans. Syst. Man Cybern. C Appl. Rev., vol. 41, no. 2, pp. 274-279, Mar. 2011.
20. P. Perakis, T. Theoharis, I. A. Kakadiaris, "Feature fusion for facial landmark detection", Pattern Recognit., vol. 47, no. 9, pp. 2783-2793, Sep. 2014.
21. J. Zhou, S. Cadavid, M. Abdel-Mottaleb, "An efficient 3-D ear recognition system employing local and holistic features", IEEE Trans. Inf. Forensics Security, vol. 7, no. 3, pp. 978-991, Jun. 2012.
22. N. Werghi, C. Tortorici, S. Berretti, A. D. Bimbo, "Boosting 3D LBP-based face recognition by fusing shape and texture descriptors on the mesh", IEEE Trans. Inf. Forensics Security, vol. 11, no. 5, pp. 964-979, May 2016.
23. R. H. Jeng, W. S. Chen, "Two feature-level fusion methods with feature scaling and hashing for multimodal biometrics", IETE Tech. Rev., vol. 34, no. 1, pp. 91-101, 2017.
24. W. Kabir, M. O. Ahmad, M. N. S. Swamy, "A two-stage scheme for fusion of hash-encoded features in a multimodal biometric system", Proc. 16th IEEE Int. New Circuits Syst. Conf. (NEWCAS), pp. 340-343, Jun. 2018.
25. Y. Xin et al., "Multimodal feature-level fusion for biometrics identification system on IoMT platform", IEEE Access, vol. 6, pp. 21418-21426, Mar. 2018.
26. L. Mezai, F. Hachouf, "Score-level fusion of face and voice using particle swarm optimization and belief functions", IEEE Trans. Human-Mach. Syst., vol. 45, no. 6, pp. 761-772, Dec. 2015.
27. K. Nguyen, S. Denman, S. Sridharan, C. Fookes, "Score-level multibiometric fusion based on dempster–shafer theory incorporating uncertainty factors", IEEE Trans. Human-Mach. Syst., vol. 45, no. 1, pp. 132-140, Feb. 2015.
28. W. Kabir, M. O. Ahmad, M. N. S. Swamy, "Weighted hybrid fusion for multimodal biometric recognition system", Proc. IEEE Int. Symp. Circuits Syst. (ISCAS), pp. 1-4, May 2018.
29. K. Nandakumar, Y. Chen, S. C. Dass, A. K. Jain, "Likelihood ratio-based biometric score fusion", IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 2, pp. 342-347, Feb. 2008.
30. S. Srivastava, S. Bhardwaj, S. Bhargava, "Fusion of palm-phalanges print with palmprint and dorsal hand vein", Appl. Soft Comput., vol. 27, pp. 12-20, Oct. 2016.
31. S. A. Artabaz, L. Sliman, H. N. Dellys, K. Benatchba, M. Koudil, "Multibiometrics enhancement using quality measurement in score level fusion", Proc. Int. Conf. Intell. Syst. Design Appl., pp. 260-267, Feb. 2017.
32. M. Hanmandlu, J. Grover, A. Gureja, H. M. Gupta, "Score level fusion of multimodal biometrics using triangular norms", Pattern Recognit. Lett., vol. 32, no. 14, pp. 1843-1850, Oct. 2011.
33. W. Kabir, M. O. Ahmad, M. N. S. Swamy, "Normalization and weighting techniques based on genuine-impostor score fusion in multi-biometric systems", IEEE Trans. Inf. Forensics Security, vol. 13, no. 8, pp. 1989-2000, Aug. 2018.
34. R. Snelick, U. Uludag, A. Mink, M. Indovina, A. K. Jain, "Large-scale evaluation of multimodal biometric authentication using state-of-the-art systems", IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 3, pp. 450-455, Mar. 2005.
35. K. Tiwari, A. Nigam, P. Gupta, "TARC: A novel score fusion scheme for multimodal biometric systems", Proc. IEEE Symp. Comput. Intell. Biometrics Identity Manage. (CIBIM), pp. 53-59, Dec. 2014.
36. N. Damer, A. Opel, A. Nouak, "Performance anchored score normalization for multi-biometric fusion" in Advances in Visual Computing, Berlin, Germany:Springer-Verlag, vol. 8034, 2013.
37. M. He et al., "Performance evaluation of score level fusion in multimodal biometric systems", Pattern Recognit., vol. 43, no. 5, pp. 1789-1800, May 2010.
38. A. Jain, K. Nandakumar, A. Ross, "Score normalization in multimodal biometric systems", Pattern Recognit., vol. 38, no. 12, pp. 2270-2285, Dec. 2005.
39. Y. N. Singh, P. Gupta, "Quantitative evaluation of normalization techniques of matching scores in multimodal biometric systems", Proc. Int. Conf. Biometrics (ICB), pp. 574-583, Aug. 2007.
40. W. Kabir, M. O. Ahmad, M. N. S. Swamy, "A novel normalization technique for multimodal biometric systems", Proc. IEEE 58th Int. Midwest Symp. Circuits Syst. (MWSCAS), pp. 145-148, Aug. 2015.
41. W. Kabir, M. O. Ahmad, M. N. S. Swamy, "A new anchored normalization technique for score-level fusion in multimodal biometrie systems", Proc. IEEE Int. Symp. Circuits Syst. (ISCAS), pp. 93-96, May 2016.
42. H. Alshehri, M. Hussain, H. A. Aboalsamh, M. A. Al Zuair, "Cross-sensor fingerprint matching method based on orientation gradient and Gabor-Hog descriptors with score level fusion", IEEE Access, vol. 6, pp. 28951-28968, May 2018.
43. W. Scheirer, A. Rocha, R. Micheals, T. Boult, "Robust fusion: Extreme value theory for recognition score normalization", Proc. Eur. Conf. Comput. Vis. (ECCV), pp. 481-495, Sep. 2010.
44. Z. Khan, A. Mian, Y. Hu, "Contour code: Robust and efficient multispectral palmprint encoding for human recognition", Proc. ICCV, pp. 1935-1942, 2011.
45. FVC2002 the 2nd Fingerprint Verication Competition, May. 2018, [online] Available: http://bias.csr.unibo.it/fvc2002/.
46. College of Engineering Pune-411005 An Autonomous Institute of Government of Maharashtra. COEP Palm Print Database, May. 2018, [online] Available: http://www.coep.org.in/.
47. AMI Ear Database, May. 2018, [online] Available: http://www.ctim.es/research_works/ami_ear_database/.
48. J. Abraham, P. Kwan, J. Gao, "Fingerprint Matching using a hybrid shape and orientation descriptor" in State Art Biometrics, Rijeka, Croatia:InTech, pp. 25-56, 2011.
49. A. Jain, P. Flynn, A. Ross, Handbook of Biometrics, New York, NY, USA:Springer-Verlag, 2007.
50. A. C. Lorena, A. C. P. L. F. de Carvalho, "Building binary-tree-based multiclass classifiers using separability measures", Neurocomputing, vol. 73, no. 16, pp. 2837-2845, Oct. 2010.
51. W. Kabir, M. O. Ahmad, M. N. S. Swamy, "Score reliability based weighting technique for score-level fusion in multi-biometric systems", Proc. IEEE Winter Conf. Comput. Vis. (WACV), pp. 1-7, Mar. 2016.
All items in Spectrum are protected by copyright, with all rights reserved. The use of items is governed by Spectrum's terms of access.
Repository Staff Only: item control page
Download Statistics
Download Statistics