Pollack Periodica
Volume/Issue:
Volume 18: Issue 3
Multimodal biometric recognition using fused handcrafted features
Authors:
Haider Mehraj Department of Electronics and Communication Engineering, School of Engineering and Technology, Baba Ghulam Shah Badshah University, Rajouri, Jammu and Kashmir, India

Search for other papers by Haider Mehraj in
Current site
Google Scholar
PubMed Close
https://orcid.org/0000-0002-2215-8373
,
Ajaz Hussain Mir Department of Electronics and Communication Engineering, National Institute of Technology Srinagar, Jammu and Kashmir, India

Search for other papers by Ajaz Hussain Mir in
Current site
Google Scholar
PubMed Close
, and
Farkhanda Ana Department of Electronics and Communication Engineering, School of Engineering and Technology, Baba Ghulam Shah Badshah University, Rajouri, Jammu and Kashmir, India

Search for other papers by Farkhanda Ana in
Current site
Google Scholar
PubMed Close
Pages:
132–139
Online Publication Date:
04 Jul 2023
Publication Date:
25 Sep 2023
Article Category:
Research Article
DOI:
https://doi.org/10.1556/606.2023.00786
Keywords:
biometrics; histogram of oriented gradients; speed up robust features; handcrafted features; artificial neural networks
Restricted access

Abstract

Multimodal biometric systems have been widely implemented in a variety of real-world scenarios due to their ability to overcome limitations associated with unimodal biometric systems. This paper is focused on the combination of the face, ear and gait in a unified multimodal biometric identification system using handcrafted features. These approaches provide robust and discriminative features to solve the biometric problem. In this research, speed up robust features and histogram of oriented gradients approaches have been used to extract features from face, ear and gait. The extracted features are optimized using genetic algorithm and classified using Levenberg-Marquardt backpropagation neural network. The system performance is evaluated on constrained and unconstrained dataset conditions.

  • [1]

    M. Chowdhury, J. Gao, and R. Islam, “Human surveillance system for security application,” in 11th International Conference on Security and Privacy in Communication Systems, Dallas, TX, USA, October 26–29, 2015, B. Thuraisingham, X. Wang, and V. Yegneswaran Eds, vol. 164, Cham: Springer, 2015, pp. 711–724.

    • Search Google Scholar
    • Export Citation
  • [2]

    A. K. Jain and A. Kumar, “Biometric recognition: An overview,” in Second Generation Biometrics: The Ethical, Legal and Social Context, E. Mordini and D. Tzovaras, Eds, vol. 11, Dordrecht: Springer Netherlands, 2012, pp. 49–79.

    • Search Google Scholar
    • Export Citation
  • [3]

    M. Chowdhury, J. Gao, and R. Islam, “Robust human detection and localization in security applications,” Concurrency Comput. Pract. Exp., vol. 29, no. 23, 2017, Paper no. e3977.

    • Search Google Scholar
    • Export Citation
  • [4]

    A. F. Abate, M. Nappi, D. Riccio, and G. Sabatino, “2D and 3D face recognition: A survey,” Pattern Recognition Lett., vol. 28, no. 14, pp. 1885–1906, 2007.

    • Search Google Scholar
    • Export Citation
  • [5]

    N. Charfi, H. Trichili, A. M. Alimi, and B. Solaiman, “Bimodal biometric system for hand shape and palmprint recognition based on SIFT sparse representation,” Multimedia Tools Appl., vol. 76, pp. 20457–20482, 2017.

    • Search Google Scholar
    • Export Citation
  • [6]

    K. Roy, J. Shelton, B. O'Connor, and M. S. Kamel, “Multibiometric system using fuzzy level set, and genetic and evolutionary feature extraction,” IET Biometrics, vol. 4, no. 3, pp. 151–161, 2015.

    • Search Google Scholar
    • Export Citation
  • [7]

    H. Mehraj and A. H. Mir, “Robust multimodal biometric system based on feature level fusion of optimiseddeepnet features,” Wireless Personal. Commun., vol. 127, pp. 2461–2482, 2022.

    • Search Google Scholar
    • Export Citation
  • [8]

    L. Árvai, “Convolutional neural network-based activity monitoring for indoor localization,” Pollack Period., vol. 16, no. 3, pp. 7–12, 2021.

    • Search Google Scholar
    • Export Citation
  • [9]

    Z. Li, D. Gong, X. Li, and D. Tao, “Learning compact feature descriptor and adaptive matching framework for face recognition,” IEEE Trans. Image Process., vol. 24, no. 9, pp. 2736–2745, 2015.

    • Search Google Scholar
    • Export Citation
  • [10]

    T. Ahonen, A. Hadid, and M. Pietikäinen, “Face recognition with local binary patterns,” in 8th European Conference on Computer Vision, Prague, Czech Republic, May 11–14, 2004, T. Pajdla and J. Matas, Eds, Lecture Notes in Computer Science, vol. 3021, Berlin, Heidelberg: Springer, 2004, pp. 469–481.

    • Search Google Scholar
    • Export Citation
  • [11]

    N. Dalal and B. Triggs, “Histograms of oriented gradients for human detection,” in Proceedings of 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Diego, CA, USA, June 20-25, 2005, vol. 1, pp. 886–893.

    • Search Google Scholar
    • Export Citation
  • [12]

    V. Ojansivu and J. Heikkilä, “Blur insensitive texture classification using local phase quantization,” in 3rd International Conference on Image and Signal Processing, Cherbourg-Octeville, France, July 1–3, 2008, Lecture Notes in Computer Science, vol. 5099, A. Elmoataz, O. Lezoray, F. Nouboud, and D. Mammass Eds, Berlin, Heidelberg: Springer, 2008, pp. 236–243.

    • Search Google Scholar
    • Export Citation
  • [13]

    J. Kannala and E. Rahtu, “BSIF: Binarized statistical image features,” in Proceedings of the 21st International Conference on Pattern Recognition, Tsukuba, Japan, November 11–15, 2012, pp. 1363–1366.

    • Search Google Scholar
    • Export Citation
  • [14]

    Georgia Tech Face Database. [Online]. Available: http://www.face-rec.org/databases. Accessed: Mar. 30, 2023.

  • [15]

    E. Gonzalez, L. Alvarez, and L. Mazorra, AMI Ear Dataset. [Online]. Available: https://ctim.ulpgc.es/research_works/ami_ear_database/. Accessed: Mar. 30, 2023.

    • Search Google Scholar
    • Export Citation
  • [16]

    Y. LeCun; B. Boser; J. S. Denker; D. Henderson; R. E. Howard; W. Hubbard; and L. D. Jackel, “Backpropagation applied to handwritten zip code recognition,” Neural Comput., vol. 1, no. 4, pp. 541–551, 1989.

    • Search Google Scholar
    • Export Citation
  • [17]

    O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, M. Bernstein, A. C. Berg, and F. F. Li, “ImageNet large scale visual recognition challenge,” Int. J. Comput. Vis., vol. 115, pp. 211–252, 2015.

    • Search Google Scholar
    • Export Citation
  • [18]

    S. Zheng, J. Zhang, K. Huang, R. He, and T. Tan, “Robust view transformation model for gait recognition,” in Proceedings of 2011 18th IEEE International Conference on Image Processing, Brussels, Belgium, Sept. 11–14, 2011, pp. 2073–2076.

    • Search Google Scholar
    • Export Citation
  • [19]

    C. Sanderson and B. C. Lovell, “Multi-region probabilistic histograms for robust and scalable identity inference,” in Third International Conferences on Advances in Biometrics, Alghero, Italy, June 2–5, 2009, Lecture Notes in Computer Science, vol. 5558. M. Tistarelli and M. S. Nixon, Eds, Berlin, Heidelberg: Springer, 2009, pp. 199–208.

    • Search Google Scholar
    • Export Citation
  • [20]

    V. T. Hoang, “EarVN1.0: A new large-scale ear images dataset in the wild,” Data Brief, vol. 27, 2019, Paper no. 104630.

  • [21]

    H. Bay, T. Tuytelaars, and L. Van Gool, “SURF: Speeded Up Robust Features,” in 9th European Conference on Computer Vision, Graz, Austria, May 7–13, 2006, Lecture Notes in Computer Science, vol. 3951, A. Leonardis, H. Bischof, and A. Pinz, Eds, Berlin, Heidelberg: Springer, 2006, pp. 404–417.

    • Search Google Scholar
    • Export Citation
  • [22]

    H. Bay, A. Ess, T. Tuytelaars, and L. Van Gool, “Speeded-Up Robust Features (SURF),” Computer Vis. Image Understand., vol. 110, no. 3, pp. 346–359, 2008.

    • Search Google Scholar
    • Export Citation
  • [23]

    A. Yazdanpanah, K. Faez, and R. Amirfattahi, “Multimodal biometric system using face, ear and gait biometrics,” in Proceedings of 10th International Conference on Information Science, Signal Processing and their Applications, Kuala Lumpur, Malaysia, May 10–13, 2010, pp. 251–254.

    • Search Google Scholar
    • Export Citation
  • [24]

    A. Fred and J. J. Carol, “Feature level fusion using physical biometric traits,” Int. J. Biomed. Eng. Technol., vol. 26, no. 1, pp. 54-70, 2018.

    • Search Google Scholar
    • Export Citation
  • [25]

    T. Kumar, S. Bhushan, and S. Jangra, “Ann trained and WOA optimized feature-level fusion of iris and fingerprint,” Mater. Today Proc., vol. 51. Part 1, pages 1-11, 2022.

    • Search Google Scholar
    • Export Citation
  • [26]

    V. Gurunathan, T. Sathiyapriya, and R. Sudhakar, “Multimodal biometric recognition system using SURF algorithm,” in Proceedings of 10th International Conference on Intelligent Systems and Control, Coimbatore, India, Jan. 7–8, 2016, pp. 1–5.

    • Search Google Scholar
    • Export Citation
  • [27]

    X. Zhang, D. Cheng, and X. Xu, “Weighted multimodal biometric recognition algorithm based on histogram of contourlet oriented gradient feature description,” in Proceedings of Federated Conference on Computer Science and Information Systems, Leipzig, Germany, Sept. 1–4, 2019, pp. 381–384.

    • Search Google Scholar
    • Export Citation
  • [28]

    M. Ahmad, H. Ahmed, and N. Omer, “An accurate multi-biometric personal identification model using histogram of oriented gradients (HOG),” Int. J. Adv. Comput. Sci. Appl., vol. 9, no. 5, pp. 313–319, 2018.

    • Search Google Scholar
    • Export Citation
  • [29]

    R. Srivastava, V. P. Bhardwaj, M. T. B Othman, M. Pushkarna, Anushree, A. Mangla, M. Bajaj, A. U Rehman, M. Shafiq, and H. Hamam, “Match-level fusion of finger-knuckle print and iris for human identity validation using neuro-fuzzy classifier,” Sensors, vol. 22, no. 10, 2022, Paper no. 3620.

    • Search Google Scholar
    • Export Citation
  • [30]

    A. M. Kumar, A. Chandralekha, Y. Himaja, and S. M. Sai, “Local binary pattern based multimodal biometric recognition using ear and FKP with feature level fusion,” in IEEE International Conference on Intelligent Techniques in Control, Optimization and Signal Processing, Tamilnadu, India, April 11-13, 2019, pp. 1–5.

    • Search Google Scholar
    • Export Citation
  • [31]

    H. Mehraj and A. H. Mir, “Feature vector extraction and optimization for multimodal biometrics employing face, ear and gait utilizing artificial neural networks,” Int. J. Cloud Comput., vol. 9, nos 2-3, pp. 131–149, 2020.

    • Search Google Scholar
    • Export Citation
  • [32]

    L. Tiong, S. T. Kim, and Y. Ro, “Multimodal face biometrics by using convolutional neural networks,” J. Korea Multimedia Soc., vol. 20, no. 2, pp. 170–178, 2017.

    • Search Google Scholar
    • Export Citation
  • [33]

    E. M. Cherrat, R. Alaoui, and H. Bouzahir, “Score fusion of finger vein and face for human recognition based on convolutional neural network model,” Int. J. Comput., vol. 19, no. 1, pp. 11–19, 2020.

    • Search Google Scholar
    • Export Citation
  • [34]

    N. Alay and H. H. Al-Baity, “Deep learning approach for multimodal biometric recognition system based on fusion of iris, face, and finger vein traits,” Sensors, vol. 20, no. 19, 2020, Paper no. 5523.

    • Search Google Scholar
    • Export Citation
  • [35]

    G. S. Badrinath, A. Nigam, and P. Gupta, “An efficient finger-knuckle-print based recognition system fusing SIFT and SURF matching scores,” in 13th International Conference on Information and Communications Security, Beijing, China, November 23–26, 2011, Lecture Notes in Computer Science, vol. 7043, S. Qing, W. Susilo, G. Wang, and D. Liu, Eds, Berlin, Heidelberg: Springer, 2011, pp. 374–387.

    • Search Google Scholar
    • Export Citation
  • [36]

    H. K. Jalghaf, A. H. Askar, H. Albedran, E. Kovács, and K. Jármai, “Comparative study of different meta-heuristics on optimal design of a heat exchanger,” Pollack Period., vol. 18, no. 2, pp. 119–124, 2023.

    • Search Google Scholar
    • Export Citation
  • [37]

    K. Sastry, D. Goldberg, and G. Kendall, “Genetic Algorithms,” in Search Methodologies, E. K. Burke and G. Kendall, Eds, Boston, MA US: Springer, Ch. 4, 2005, pp. 97–125.

    • Search Google Scholar
    • Export Citation
  • [38]

    M. T. Hagan and M. B. Menhaj, “Training feedforward networks with the Marquardt algorithm,” IEEE Trans. Neural Networks, vol. 5, no. 6, pp. 989–993, 1994.

    • Search Google Scholar
    • Export Citation
  • [39]

    Z. Cömert and A. Kocamaz, “A study of artificial neural network training algorithms for classification of cardiotocography signals,” J. Sci. Technol., vol. 7, no. 2, pp. 93–103, 2017.

    • Search Google Scholar
    • Export Citation
  • [40]

    R. Zayani, R. Bouallegue, and D. Roviras, “Levenberg-Marquardt learning neural network for adaptive predistortion for time-varying HPA with memory in OFDM systems,” in 16th European Signal Processing Conference, Lausanne, Switzerland, August 25-29, 2008, pages 1–6.

    • Search Google Scholar
    • Export Citation
  • [41]

    I. S. M Diego, A. R. Redondo, R. R. Fernández, J. Navarro, and J. M. Moguerza, “General performance score for classification problems,” Appl. Intelligence, vol. 52, pp. 12049–12063, 2022.

    • Search Google Scholar
    • Export Citation
  • Collapse
  • Expand
Cover Pollack Periodica
Pollack Periodica
Print ISSN:
1788-1994
Online ISSN:
1788-3911

Senior editors

Editor(s)-in-Chief: Iványi, Amália

Editor(s)-in-Chief: Iványi, Péter

 

Scientific Secretary

Miklós M. Iványi

Editorial Board

  • Bálint Bachmann (Institute of Architecture, Faculty of Engineering and Information Technology, University of Pécs, Hungary)
  • Jeno Balogh (Department of Civil Engineering Technology, Metropolitan State University of Denver, Denver, Colorado, USA)
  • Radu Bancila (Department of Geotechnical Engineering and Terrestrial Communications Ways, Faculty of Civil Engineering and Architecture, “Politehnica” University Timisoara, Romania)
  • Charalambos C. Baniotopolous (Department of Civil Engineering, Chair of Sustainable Energy Systems, Director of Resilience Centre, School of Engineering, University of Birmingham, U.K.)
  • Oszkar Biro (Graz University of Technology, Institute of Fundamentals and Theory in Electrical Engineering, Austria)
  • Ágnes Borsos (Institute of Architecture, Department of Interior, Applied and Creative Design, Faculty of Engineering and Information Technology, University of Pécs, Hungary)
  • Matteo Bruggi (Dipartimento di Ingegneria Civile e Ambientale, Politecnico di Milano, Italy)
  • Petra Bujňáková (Department of Structures and Bridges, Faculty of Civil Engineering, University of Žilina, Slovakia)
  • Anikó Borbála Csébfalvi (Department of Civil Engineering, Institute of Smart Technology and Engineering, Faculty of Engineering and Information Technology, University of Pécs, Hungary)
  • Mirjana S. Devetaković (Faculty of Architecture, University of Belgrade, Serbia)
  • Szabolcs Fischer (Department of Transport Infrastructure and Water Resources Engineering, Faculty of Architerture, Civil Engineering and Transport Sciences Széchenyi István University, Győr, Hungary)
  • Radomir Folic (Department of Civil Engineering, Faculty of Technical Sciences, University of Novi Sad Serbia)
  • Jana Frankovská (Department of Geotechnics, Faculty of Civil Engineering, Slovak University of Technology in Bratislava, Slovakia)
  • János Gyergyák (Department of Architecture and Urban Planning, Institute of Architecture, Faculty of Engineering and Information Technology, University of Pécs, Hungary)
  • Kay Hameyer (Chair in Electromagnetic Energy Conversion, Institute of Electrical Machines, Faculty of Electrical Engineering and Information Technology, RWTH Aachen University, Germany)
  • Elena Helerea (Dept. of Electrical Engineering and Applied Physics, Faculty of Electrical Engineering and Computer Science, Transilvania University of Brasov, Romania)
  • Ákos Hutter (Department of Architecture and Urban Planning, Institute of Architecture, Faculty of Engineering and Information Technolgy, University of Pécs, Hungary)
  • Károly Jármai (Institute of Energy and Chemical Machinery, Faculty of Mechanical Engineering and Informatics, University of Miskolc, Hungary)
  • Teuta Jashari-Kajtazi (Department of Architecture, Faculty of Civil Engineering and Architecture, University of Prishtina, Kosovo)
  • Róbert Kersner (Department of Technical Informatics, Institute of Information and Electrical Technology, Faculty of Engineering and Information Technology, University of Pécs, Hungary)
  • Rita Kiss  (Biomechanical Cooperation Center, Faculty of Mechanical Engineering, Budapest University of Technology and Economics, Budapest, Hungary)
  • István Kistelegdi  (Department of Building Structures and Energy Design, Institute of Architecture, Faculty of Engineering and Information Technology, University of Pécs, Hungary)
  • Stanislav Kmeť (President of University Science Park TECHNICOM, Technical University of Kosice, Slovakia)
  • Imre Kocsis  (Department of Basic Engineering Research, Faculty of Engineering, University of Debrecen, Hungary)
  • László T. Kóczy (Department of Information Sciences, Faculty of Mechanical Engineering, Informatics and Electrical Engineering, University of Győr, Hungary)
  • Dražan Kozak (Faculty of Mechanical Engineering, Josip Juraj Strossmayer University of Osijek, Croatia)
  • György L. Kovács (Department of Technical Informatics, Institute of Information and Electrical Technology, Faculty of Engineering and Information Technology, University of Pécs, Hungary)
  • Balázs Géza Kövesdi (Department of Structural Engineering, Faculty of Civil Engineering, Budapest University of Engineering and Economics, Budapest, Hungary)
  • Tomáš Krejčí (Department of Mechanics, Faculty of Civil Engineering, Czech Technical University in Prague, Czech Republic)
  • Jaroslav Kruis (Department of Mechanics, Faculty of Civil Engineering, Czech Technical University in Prague, Czech Republic)
  • Miklós Kuczmann (Department of Automations, Faculty of Mechanical Engineering, Informatics and Electrical Engineering, Széchenyi István University, Győr, Hungary)
  • Tibor Kukai (Department of Engineering Studies, Institute of Smart Technology and Engineering, Faculty of Engineering and Information Technology, University of Pécs, Hungary)
  • Maria Jesus Lamela-Rey (Departamento de Construcción e Ingeniería de Fabricación, University of Oviedo, Spain)
  • János Lógó  (Department of Structural Mechanics, Faculty of Civil Engineering, Budapest University of Technology and Economics, Hungary)
  • Carmen Mihaela Lungoci (Faculty of Electrical Engineering and Computer Science, Universitatea Transilvania Brasov, Romania)
  • Frédéric Magoulés (Department of Mathematics and Informatics for Complex Systems, Centrale Supélec, Université Paris Saclay, France)
  • Gabriella Medvegy (Department of Interior, Applied and Creative Design, Institute of Architecture, Faculty of Engineering and Information Technology, University of Pécs, Hungary)
  • Tamás Molnár (Department of Visual Studies, Institute of Architecture, Faculty of Engineering and Information Technology, University of Pécs, Hungary)
  • Ferenc Orbán (Department of Mechanical Engineering, Institute of Smart Technology and Engineering, Faculty of Engineering and Information Technology, University of Pécs, Hungary)
  • Zoltán Orbán (Department of Civil Engineering, Institute of Smart Technology and Engineering, Faculty of Engineering and Information Technology, University of Pécs, Hungary)
  • Dmitrii Rachinskii (Department of Mathematical Sciences, The University of Texas at Dallas, Texas, USA)
  • Chro Radha (Chro Ali Hamaradha) (Sulaimani Polytechnic University, Technical College of Engineering, Department of City Planning, Kurdistan Region, Iraq)
  • Maurizio Repetto (Department of Energy “Galileo Ferraris”, Politecnico di Torino, Italy)
  • Zoltán Sári (Department of Technical Informatics, Institute of Information and Electrical Technology, Faculty of Engineering and Information Technology, University of Pécs, Hungary)
  • Grzegorz Sierpiński (Department of Transport Systems and Traffic Engineering, Faculty of Transport, Silesian University of Technology, Katowice, Poland)
  • Zoltán Siménfalvi (Institute of Energy and Chemical Machinery, Faculty of Mechanical Engineering and Informatics, University of Miskolc, Hungary)
  • Andrej Šoltész (Department of Hydrology, Faculty of Civil Engineering, Slovak University of Technology in Bratislava, Slovakia)
  • Zsolt Szabó (Faculty of Information Technology and Bionics, Pázmány Péter Catholic University, Hungary)
  • Mykola Sysyn (Chair of Planning and Design of Railway Infrastructure, Institute of Railway Systems and Public Transport, Technical University of Dresden, Germany)
  • András Timár (Faculty of Engineering and Information Technology, University of Pécs, Hungary)
  • Barry H. V. Topping (Heriot-Watt University, UK, Faculty of Engineering and Information Technology, University of Pécs, Hungary)

POLLACK PERIODICA
Pollack Mihály Faculty of Engineering
Institute: University of Pécs
Address: Boszorkány utca 2. H–7624 Pécs, Hungary
Phone/Fax: (36 72) 503 650

E-mail: peter.ivanyi@mik.pte.hu 

or amalia.ivanyi@mik.pte.hu

Indexing and Abstracting Services:

  • SCOPUS
  • CABELLS Journalytics

 

2023  
Scopus  
CiteScore 1.5
CiteScore rank Q3 (Civil and Structural Engineering)
SNIP 0.849
Scimago  
SJR index 0.288
SJR Q rank Q3

Pollack Periodica
Publication Model Hybrid
Submission Fee none
Article Processing Charge 900 EUR/article
Printed Color Illustrations 40 EUR (or 10 000 HUF) + VAT / piece
Regional discounts on country of the funding agency World Bank Lower-middle-income economies: 50%
World Bank Low-income economies: 100%
Further Discounts Editorial Board / Advisory Board members: 50%
Corresponding authors, affiliated to an EISZ member institution subscribing to the journal package of Akadémiai Kiadó: 100%
Subscription fee 2025 Online subsscription: 381 EUR / 420 USD
Print + online subscription: 456 EUR / 520 USD
Subscription Information Online subscribers are entitled access to all back issues published by Akadémiai Kiadó for each title for the duration of the subscription, as well as Online First content for the subscribed content.
Purchase per Title Individual articles are sold on the displayed price.

 

2023  
Scopus  
CiteScore 1.5
CiteScore rank Q3 (Civil and Structural Engineering)
SNIP 0.849
Scimago  
SJR index 0.288
SJR Q rank Q3

Monthly Content Usage

Abstract Views Full Text Views PDF Downloads
Oct 2024 276 1 1
Nov 2024 124 0 0
Dec 2024 70 0 0
Jan 2025 140 0 0
Feb 2025 135 0 0
Mar 2025 97 0 0
Apr 2025 0 0 0