The Open Cybernetics & Systemics Journal




(Discontinued)

ISSN: 1874-110X ― Volume 12, 2018
RESEARCH ARTICLE

Palmprint Identification Using Image Reconstruction Based Double DBNs



Xin Pan1, *, Dandan Zhao2, Tong Chen1, Jiangping Liu1, Zhihong Yu3, Heru Xue1
1 College of Computer and Information Engineering, Inner Mongolia Agricultural University, Huhhot, Inner Mongolia 010018, China
2 Zhengzhou Tourism College, Zhengzhou, Henan 450009, China
3 College of Mechanical and Electrical Engineering, Inner Mongolia Agricultural University, Huhhot, Inner Mongolia 010018, China

Abstract

A novel approach of palmprint recognition using image reconstruction based on double DBNs (IR-DDBN) was proposed in this study, as principal component analysis (PCA) ignores the higher order statistics in feature extraction. Three main steps were involved in the algorithm. Firstly, whitening PCA was utilized to extract the prominent characteristics of the original palmprint image. The second step included reconstructing the original image and calculating the residual image for the residual features between the original and reconstructed images. Finally, the double DBNs were used for classification. The experimental results demonstrated better performance of the proposed algorithm by comparing with the traditional algorithms (PCA, LBP, HOG and DBN) with higher recognition rates, especially for relatively small training samples.

Key words: Deep learning, Image reconstruction, Double DBNs, Deep belief nets, Whitening PCA.


Article Information


Identifiers and Pagination:

Year: 2017
Volume: 11
First Page: 58
Last Page: 66
Publisher Id: TOCSJ-11-58
DOI: 10.2174/1874110X01711010058

Article History:

Received Date: 20/10/2016
Revision Received Date: 27/01/2017
Acceptance Date: 31/01/2017
Electronic publication date: 29/03/2017
Collection year: 2017

© 2017 Pan et al.

open-access license: This is an open access article distributed under the terms of the Creative Commons Attribution 4.0 International Public License (CC-BY 4.0), a copy of which is available at: (https://creativecommons.org/licenses/by/4.0/legalcode). This license permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.


* Address correspondence to this author at the College of Computer and Information Engineering, Inner Mongolia Agricultural University, 306 Road Zhaowuda, Saihan District, Huhhot , Inner Mongolia, China; Tel: 86-15847129078; E-mails: pxffyfx@126.com, xinpan@yahoo.com





1. INTRODUCTION

Palmprint identification is one of the key technologies in biometrics to identify a person based on palmprint images, containing creases, wrinkles and ridges, with advantages of low intrusion and easy use, etc [1D. D. Zhang, Palmprint Authentication, Kluwer Academic Publisher: New York, 2004.]. A typical recognition system is composed of five parts, including palmprint scanners, preprocessing, feature extraction, matcher and database [2A. Kong, D. Zhang, and M. Kamel, "A survey of palmprint recognition", Pattern Recognit., vol. 42, pp. 1408-1418, 2009.
[http://dx.doi.org/10.1016/j.patcog.2009.01.018]
]. As the most important stage, feature extraction has an impact on the identification result directly. The numerous feature extraction techniques of palmprint recognition can be broadly classified into line-based approaches, subspace-based approaches, statistical approaches [2A. Kong, D. Zhang, and M. Kamel, "A survey of palmprint recognition", Pattern Recognit., vol. 42, pp. 1408-1418, 2009.
[http://dx.doi.org/10.1016/j.patcog.2009.01.018]
]. Some researches supplemented appearance-based, texture based and hybrid approaches [3R. Raghavendra, and C. Busch, "Texture based features for robust palmprint recognition: a comparative study", EURASIP J. Inf. Secur., vol. 2015, pp. 1-9, 2015.
[http://dx.doi.org/10.1186/s13635-015-0022-z]
]. Principle Component Analysis (PCA) [4G. Lu, D. Zhang, and K. Wang, "Palmprint recognition using eigenpalms features", Pattern Recognit. Lett., vol. 24, pp. 1463-1467, 2003.
[http://dx.doi.org/10.1016/S0167-8655(02)00386-0]
] and Independent Components Analysis (ICA) [5L. Shang, D.S. Huang, J.X. Du, and C.H. Zheng, "Palmprint recognition using FastICA algorithm and radial basis probabilistic neural network", Neurocomputing, vol. 69, pp. 1782-1786, 2006.
[http://dx.doi.org/10.1016/j.neucom.2005.11.004]
] are the classical tools in subspace-based methods. Recently, deep learning was applied in palmprint recognition. Deep scattering convolutional network whose architecture and filters were predefined wavelet transform provided promising result [6S. Minaee, and Y. Wang, "Palmprint Recognition Using Deep Scattering Convolutional Network", arXiv preprint arXiv:1603.09027, 2016.]. In our previous work, we also found that the appropriate DBN model can enhance the performance of palmprint recognition in accuracy [7D. Zhao, X. Pan, X. Luo, and X. Gao, "Palmprint recognition based on deep learning", In: International Conference on Wireless, Mobile and Multi-Media, 2015, pp. 214-217.
[http://dx.doi.org/10.1049/cp.2015.0942]
].

PCA, one of the most popular appearance-based techniques, was applied in palmprint identification for Eigenpalm extraction by Lu et al. [4G. Lu, D. Zhang, and K. Wang, "Palmprint recognition using eigenpalms features", Pattern Recognit. Lett., vol. 24, pp. 1463-1467, 2003.
[http://dx.doi.org/10.1016/S0167-8655(02)00386-0]
]. Following this, the two-dimensional PCA, and the integration of PCA and other approaches have been proposed to improve the recognition performance [8T. Connie, D. Ngo, A. Teoh, and M. Goh, "Palmprint recognition with PCA and ICA", In: Image and Vision Computing New Zealand 2003, Palmerston North, New Zealand, 2003, pp. 232-227.-10J. Tao, W. Jiang, Z. Gao, S. Chen, and C. Wang, "Palmprint recognition based on 2-dimension PCA", In: International Conference on Innovative Computing, Information and Control, 2006, pp. 326-330.]. The above PCA approaches decomposed the feature space orthogonally into principle components and residual components, in which the former parts were chosen as the projection matrix. However, the discarded data of residual space still kept the information for classification in the study of joint space theory [11X.U. Bin, and M.A. Jin-Wen, "Theoretical Normalization and Generalization of PCA Joint Subspace Model", J. Signal Process., vol. 29, pp. 1638-1643, 2013.], and were successfully applied in the reconstruction-based face recognition [12C. Zhou, L. Wang, Q. Zhang, and X. Wei, "Face recognition based on PCA image reconstruction and LDA", Optik - Int. J. Light Electron Optics, vol. 124, pp. 5599-5603, 2013., 13S. Chen, and H. Yin, "Novel feature compensation method for face recognition based on whitening PCA image reconstruction(in Chinese)", Appl. Res. Comput., vol. 32, pp. 2853-2856, 2015.]. Although manifold-based reconstruction [14Y. Deng, Q. Dai, and Z. Zhang, "Graph Laplace for occluded face completion and recognition", In: IEEE Transactions on Image Processing, vol. 20. 2011, pp. 2329-2338.] and sparse reconstruction [15Y. Deng, Q. Dai, R. Liu, Z. Zhang, and S. Hu, "Low-rank structure learning via nonconvex heuristic recovery", IEEE Trans. Neural Netw. Learn. Syst., vol. 24, no. 3, pp. 383-396, 2013.
[http://dx.doi.org/10.1109/TNNLS.2012.2235082] [PMID: 24808312]
] both presented better performance to capture the reconstruction residual/errors in the images, the calculation procedure is more complicated and time-consuming than the subspace approach. Moreover, the palmprint images in our study do not involve the works of image occlusion and completion. So PCA reconstruction is efficient and feasible for our research.

Nevertheless, both the PCA principal space and the residual space cannot well solve the problem of training samples in an efficient way. With the decrease of training samples, PCA can not get efficient features for discrimination. Deep learning is a subfield of machine learning which attempts to learn high-level abstractions in data by utilizing hierarchical architectures [16Y. Guo, Y. Liu, A. Oerlemans, S. Lao, S. Wu, and M.S. Lew, "Deep learning for visual understanding: A review", Neurocomputing, vol. 187, pp. 27-48, 2015.
[http://dx.doi.org/10.1016/j.neucom.2015.09.116]
]. It allows computational models that are composed of multiple processing layers to learn representations of data with multiple levels of abstraction [17Y. LeCun, Y. Bengio, and G. Hinton, "Deep learning", Nature, vol. 521, no. 7553, pp. 436-444, 2015.
[http://dx.doi.org/10.1038/nature14539] [PMID: 26017442]
], which has made achievements in image recognition [18P. Luo, "Hierarchical face parsing via deep learning", In: IEEE Conference on Computer Vision and Pattern Recognition, 2012, pp. 2480-2487.-20Q.V. Le, "Building high-level features using large scale unsupervised learning", In: IEEE International Conference on Acoustics, Speech and Signal Processing, 2011, pp. 8595-8598.], voice recognition [21M. Osadchy, Y.L. Cun, and M.L. Miller, "Synergistic face detection and pose estimation with energy-based models", J. Machine Learn. Res., vol. 8, pp. 1197-1215, 2007.
[http://dx.doi.org/10.1007/11957959_10]
-23F. Seide, G. Li, and D. Yu, "Conversational speech transcription using context-dependent deep neural networks", In: Conference of the International Speech Communication Association (INTERSPEECH), 2011, pp. 437-440.], natural language processing, etc. Various deep learning models were extensively investigated to enhance the learning performance. Deep learning concept was incorporated into robust information theoretic framework to reduce the uncertainties in general discriminative data representation tasks [24Y. Deng, B. Feng, X. Deng, and R. Wang, "Deep and structured robust information theoretic learning for image analysis", IEEE Trans. Image Process., vol. 25, pp. 4209-4221, 2016.]. A deep transfer metric learning method was as well proposed to learn a set of hierarchical nonlinear transformations for cross-domain visual recognition by transferring discriminative knowledge from the labeled source domain to the unlabeled target domain [25J. Hu, J. Lu, and Y.P. Tan, "Deep transfer metric learning", In: IEEE Conference on Computer Vision and Pattern Recognition, 2015, pp. 325-333.]. It was reported that the concepts of fuzzy learning into deep learning can overcome the shortcomings of fixed representation [26Y. Deng, Z. Ren, Y. Kong, and F. Bao, "A hierarchical fused fuzzy deep neural network for data classification", IEEE Trans. Fuzzy Syst., 2016.
[http://dx.doi.org/10.1109/TFUZZ.2016.2574915]
]. Furthermore, Multimodal deep learning was used to train deep networks for a shared representation between modalities and evaluate it on a unique task [27J. Ngiam, A. Khosla, M. Kim, J. Nam, H. Lee, and A.Y. Ng, "Multimodal deep learning", In: International Conference on Machine Learning (ICML), 2011, pp. 689-696.]. A hybrid convolutional network-Restricted Boltzmann Machine (ConvNet- RBM) model was proposed for face verification to learn high-level relational visual features with rich identity similarity information [28Y. Sun, X. Wang, and X. Tang, "Hybrid deep learning for face verification", In: IEEE International Conference on Computer Vision, 2013, pp. 1489-1496.].

An unsupervised layered training algorithm based on Deep Belief Network (DBN) was proposed by Hinton in 2006 [29G.E. Hinton, S. Osindero, and Y.W. Teh, "A fast learning algorithm for deep belief nets", Neural Comput., vol. 18, no. 7, pp. 1527-1554, 2006.
[http://dx.doi.org/10.1162/neco.2006.18.7.1527] [PMID: 16764513]
], called as “the third generation of network” [30G. Hinton, L. Deng, D. Yu, G.E. Dahl, A. Mohamed, and N. Jaitly, "Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups", IEEE Signal Process. Mag., vol. 29, pp. 82-97, 2012.
[http://dx.doi.org/10.1109/MSP.2012.2205597]
]. DBN can well simulate layered visual processing system by learning the abstract features of different layers from up-to-down unsupervised learning and bottom-to-top supervised learning without manual selection during in the whole training procedure [29G.E. Hinton, S. Osindero, and Y.W. Teh, "A fast learning algorithm for deep belief nets", Neural Comput., vol. 18, no. 7, pp. 1527-1554, 2006.
[http://dx.doi.org/10.1162/neco.2006.18.7.1527] [PMID: 16764513]
, 31G.E. Hinton, "A practical guide to training restricted boltzmann machines", Momentum, vol. 9, pp. 599-619, 2010.]. Double DBNs in which two individual DBNs were combined in the last layer to eliminate the ambiguity was proposed in an object recognition and pose estimation system [32D. Liang, K. Weng, C. Wang, and G. Liang, "A 3D object recognition and pose estimation system using deep learning method", In: IEEE International Conference on Information Science and Technology, 2014, pp. 401-404.
[http://dx.doi.org/10.1109/ICIST.2014.6920502]
].

Taking together both procedures, we developed a new algorithm for palmprint recognition using image reconstruction based double DBNs (IR-DDBN), in which the features of the prominent component space and residual space, extracted by the former PCA image reconstruction, were trained by two separated DBNs with unsupervised learning and combined at the last layer for supervised learning and classification. Three main steps were involved in the algorithm. Firstly, whitening PCA method was utilized to extract the principal components characteristics of ROI palmprint image. Secondly, reconstructing the original image and calculating the residual image for the residual features between the original and reconstructed images. Finally, the double DBNs were used for classification.

The rest of this paper is organized as follows: Sections 2 and 3 introduce image reconstruction based on PCA and double DBNs, respectively. Section 4 presents the proposed algorithm based on image reconstruction and double DBNs. Experimental results are given in Section 5.

2. IMAGE RECONSTRUCTION BASED ON WHITENING PCA

Different from the traditional PCA, in which the discarded higher-order statistical components still contributes to image classification, image construction based on whitening PCA can utilize both principal features and higher-order features [13S. Chen, and H. Yin, "Novel feature compensation method for face recognition based on whitening PCA image reconstruction(in Chinese)", Appl. Res. Comput., vol. 32, pp. 2853-2856, 2015.]. Generally, image reconstruction based on whitening PCA can be divided into two stages, whitening PCA and image reconstruction.

2.1. Whitening PCA

PCA is one of the most commonly used unsupervising learning methods for dimension reduction. Given n images of m classes i1,i2,……,in(arranged to column vector), the average palm is

(1)

The corresponding covariance matrix is

(2)

Let Z=[i1-u,i2-u,……,in-u] Rn×n, then the covariance matrix C is

(3)

The eigenvalues of C can be sorted in a descending order, and the eigenvectors corresponding to the former eigenvalues [λ1, λ2, ........, λr] are chosen when the dimension of transformed data is required to reduced to r-dimension. Generally, Wn× r composed of the projection vectors W1,W2,……, and Wr is referred to as projecting matrix. Although PCA can reduce the dimension of the data effectively; the relevance of the neighborhood cannot be changed. Regulation the extracted feature by whitening can not only keep the same covariance of all the features, but also reduce the relevance of the data [13S. Chen, and H. Yin, "Novel feature compensation method for face recognition based on whitening PCA image reconstruction(in Chinese)", Appl. Res. Comput., vol. 32, pp. 2853-2856, 2015.].

Suppose R=diag[λ1, λ2, ........, λr], the corresponding transform matrix W=[W1,W2,……,Wr], whitening matrix Ww=W·R-1/2,then the whitening process can be represented as follows [13S. Chen, and H. Yin, "Novel feature compensation method for face recognition based on whitening PCA image reconstruction(in Chinese)", Appl. Res. Comput., vol. 32, pp. 2853-2856, 2015.]

(4)

Where x and y correspond to a given image and the whitened image, respectively.

2.2. Image Reconstruction

The reconstruction of x can be obtained according to Eq.4 in Section 2.1 as follows [13S. Chen, and H. Yin, "Novel feature compensation method for face recognition based on whitening PCA image reconstruction(in Chinese)", Appl. Res. Comput., vol. 32, pp. 2853-2856, 2015.]:

(5)

The residue error is the difference of the original image and reconstruction image:

(6)

Figs. (1a, b and c) correspond to a palmprint ROI image, the reconstruction image, and the residue error image (PCA dimension 100), respectively.

Fig. (1)
Original palmprint image Fig. (1a), reconstruction palmprint image Fig. (1b) and residue error palmprint image Fig. (1c).


3. DOUBLE DBNs

In 2006, Hinton from the University of Toronto proposed an unsupervised training algorithm based on Deep Belief Network (DBN), a probabilistic generative model superimposed by multi-layer Restricted Boltzmann Machine (RBM), for more abstract higher-level representation by arranging the lower-layer features [29G.E. Hinton, S. Osindero, and Y.W. Teh, "A fast learning algorithm for deep belief nets", Neural Comput., vol. 18, no. 7, pp. 1527-1554, 2006.
[http://dx.doi.org/10.1162/neco.2006.18.7.1527] [PMID: 16764513]
-31G.E. Hinton, "A practical guide to training restricted boltzmann machines", Momentum, vol. 9, pp. 599-619, 2010.]. The architecture of double DBNs is shown in Fig. (2), where two individual single DBNs can be combined in the last layer for supervised classification, so as to obtain more information of an object [32D. Liang, K. Weng, C. Wang, and G. Liang, "A 3D object recognition and pose estimation system using deep learning method", In: IEEE International Conference on Information Science and Technology, 2014, pp. 401-404.
[http://dx.doi.org/10.1109/ICIST.2014.6920502]
]. Different kinds of images or features can be trained as the input of visible-layer of DBN1 and DBN2, respectively. In that followed, the output of hidden previous-layer RBM became the input of the next-layer RBM. Finally, the output of the whole DBN was the output of the last-layer RBM, in which a logistic regression layer was superimposed for classification.

Fig. (2)
The architecture of double DBNs.


4. PALMPRINT RECOGNITION BASED ON IMAGE RECONSTRUCTION AND DOUBLE DBNs

In order to make full use of residue error of whitening PCA and explore more robust features in deep learning, we proposed a palmprint recognition method using image reconstruction and double DBNs in this paper. Having decomposed the palmprint images onto PCA principal space and residue error space, two individual DBNs were used to train the features, respectively. Then the integration in the last layer for supervised learning to obtain the labels of the input data were obtained by the classification of BP network regression and Softmax regression [31G.E. Hinton, "A practical guide to training restricted boltzmann machines", Momentum, vol. 9, pp. 599-619, 2010.]. Hence, more intrinsic features were trained effectively for palmprint recognition. The flowchart of the algorithm is illustrated as Fig. (3), and accordingly the concrete procedure of the algorithms can be described as follows.

Firstly, whitening PCA method was utilized to extract the principal components characteristics of ROI palmprint image. Palmprint ROI images preprocessed by alignment and normalized to a size of 128x128 were divided into training set and test set. Each training sample was stored in row to constitute the training space. Projection matrix W1 can be obtained by Whitening PCA (see Section 2.1). We set the dimension feature 100, each training sample and test sample can be projected onto the projection matrix to yield feature vector F1 and Test1, respectively.

Secondly, reconstruct the original image to get the residual features. The residual error can be obtained by calculating the difference between original image and reconstructed image. Then transform the residue error space composed of training samples with whitening PCA to get the projection matrix W2. Project the residue error image of training samples and test samples onto W2 to obtain feature vector F2 and Test2, respectively.

Finally, the double DBNs are applied for classification. Input the two groups of features, Principal Feature1 [F1, Test1] and Residue Feature2 [F2, Test2] to DBN1, DBN2 for independent training, respectively, and combine them in the upper-layer for supervised regressive training, and eventually get the recognition results.

5. EXPERIMENTAL RESULTS

In order to testify the effectiveness of the algorithm, we conducted 2 groups of experiments. One group was used to test the performance of single DBN and double DBNs with principal components and residue components, the other group was used to compare the performance of the proposed algorithm with other classical approaches. The Beijing Jiaotong University (BJJTU) Palmprint Database contains 3460 palmprint images of 292×413 pixels of 72 dpi from 346 palms by a small-scale image scanner, each has 10 samples. The central part of 128×128 pixels cropped from original palms constitutes a ROI palmprint database (see Fig. (4)). Another Palmprint Database of Hong Kong Polytechnic University (PolyU), available from http://www.comp.polyu.edu.hk/~biometrics, was used to test the robustness of the algorithm. PolyU Palmprint Database contained 8000 palmprint images from 800 palms, and the ROI image size is 128×128. All the experiments were executed on a computer system of Intel(R)Core(TM) 3.20GHz and 4GB RAM with Matlab R2011a.

Fig. (3)
Flowchart of the proposed algorithm.


Fig. (4)
Original image and its ROI in BJJTU palmprint database.


5.1. Comparison of Recognition Performance of Traditional DBN and Double DBNs

In this group, we compared the running time and recognition accuracy of single DBN with principal components (DBN(P)) and residue components (DBN(R)) and image reconstruction based double DBNs (IR-DDBN) taking advantages of both components of whitening PCA. Both DBN and double DBNs consisted of two layers of RBM, and the numbers of DBN and double DBNs were not set too high for an efficient calculation. The numbers of 4 hidden layer units of DBN were 100,500,100,and 100, respectively. The numbers of 4 hidden layer units of double DBNs were 100,500,200,and 100 (Fig. (2)), respectively. We set batchsize 100 in the experiments because at least one image of each class was required in every batch processing [31G.E. Hinton, "A practical guide to training restricted boltzmann machines", Momentum, vol. 9, pp. 599-619, 2010.].The iteration times and learning rate were set 40 and 0.0003, respectively, according to our previous study [7D. Zhao, X. Pan, X. Luo, and X. Gao, "Palmprint recognition based on deep learning", In: International Conference on Wireless, Mobile and Multi-Media, 2015, pp. 214-217.
[http://dx.doi.org/10.1049/cp.2015.0942]
].

In order to reduce the total running time, 1000 palm images of 100 classes were chosen randomly from BJJTU Palmprint Database in the experiments. The training samples and test samples were both 500, i.e., each class has 5 training samples and 5 test samples, respectively. Owing to the recognition accuracies trained by DBN model varied each time, the average of 10 outputs was used to represent the experimental results. (Table 1) listed the recognition accuracy (%) and running time(ms) of traditional DBN and double DBNs based on image reconstruction in PCA space and residue error space, where DBN(P) and DBN(R) represent the recognition rate of PCA and residue error space, respectively. T1,T2 and t were the training time, test time and total time, respectively.

Table 1
Comparisons of the recognition accuracy (%) and running time (ms) between single DBN and double DBNs (5 training samples per class, other 5 images per class as test samples,100 classes BJJTU Palmprint Database).


As can be seen from Table 1, the recognition accuracy of DBN(P) was 92.88%, 44.36% higher than that of DBN(R) (48.52%), suggesting that whitening PCA prominent space extracts most information of the image, on the contrast, residue error space only kept partial discriminant information. The recognition accuracy of double DBNs reached 95.56%, 2.37% higher than that of DBN(P). The improvement was originated from the integration of PCA space and residue error space, which can not only extract the PCA space feature but also keep the residue error for discrimination. The total time consumption of IR-DDBN (22.6550ms) and DBN(R) (20.1298ms) was greater than DBN(P) (13.0549ms) because the image reconstruction and second whitening PCA training based on the residue space. Compared with DBN(R), the total time of IR-DBN based on image reconstruction was slightly longer for more features were trained in the model.

5.2. Performance Comparisons with Other Classical Approaches

We compared the proposed IR-DDBN with some methods, such as PCA, histogram of gradient (HOG) [33N. Dalal, and B. Triggs, "Histograms of Oriented Gradients for Human Detection", In: IEEE Computer Society Conference on Computer Vision & Pattern Recognition, 2005, pp. 886-893.
[http://dx.doi.org/10.1109/CVPR.2005.177]
, 34D. Hong, W. Liu, J. Su, Z. Pan, and G. Wang, "A novel hierarchical approach for multispectral palmprint recognition", Neurocomputing, vol. 151, pp. 511-521, 2015.
[http://dx.doi.org/10.1016/j.neucom.2014.09.013]
], and local binary (LBP) and convolutional neural networks(CNN) [35A. Krizhevsky, I. Sutskever, and G.E. Hinton, "ImageNet classification with deep convolutional neural networks", In: International Conference on Neural Information Processing Systems, 2012, pp. 1097-1105.] using different number of training samples and classes. HOG was proposed for human detection [33N. Dalal, and B. Triggs, "Histograms of Oriented Gradients for Human Detection", In: IEEE Computer Society Conference on Computer Vision & Pattern Recognition, 2005, pp. 886-893.
[http://dx.doi.org/10.1109/CVPR.2005.177]
], and was applied block based HOG for multispectral palmprint recognition [34D. Hong, W. Liu, J. Su, Z. Pan, and G. Wang, "A novel hierarchical approach for multispectral palmprint recognition", Neurocomputing, vol. 151, pp. 511-521, 2015.
[http://dx.doi.org/10.1016/j.neucom.2014.09.013]
]. The feature dimension of PCA was 100, and Euclidean distance and nearest classifier were used for classification. The block size of HOG was 3x3. The block size of LBP was 2x2, the histogram of LBP was used for identification. In CNN model (codes available from https://github.com/ rasmusbergpalm/DeepLearnToolbox), the learning rate, batchsize and epoch iteration times were set 2, 50, and 300, respectively. In the 6 feature maps (size 28×28), each neural cell is connected with the input of 5×5 neighborhood. The architectures and parameter settings of traditional DBN and IR-DDBNs were the same as those of above experiments in Section 5.1.

(Table 2) listed the identification performance on BJJTU Palmprint Database. The experiments were executed on different classes of 100, 150, and 200 with different numbers of training samples 3,5,7 per class for training, and the rest images per class were used for validation. 100 classes were taken for example, the training set contained 300, 500 and 700 images, respectively, then the corresponding test set contained 700, 500 and 300 images, respectively. The corresponding ratios of training/validation were7/3, 5/5 and 3/7, respectively. As observed from the table, the recognition accuracies of all the approaches increased with the number of training samples. The enhancement was mainly due to more discriminant information learned from more training samples. IR-DDBN outperformed other classical methods and traditional DBN based on prominent components DBN(P) and residue components DBN(R), especially when the training samples are 3 and 5. The experimental results suggested that the proposed approach can extract more sufficient information of whitening PCA and residue components when the number of training samples is not abundant. Another factor contributed to the improvement comes from the learning ability of DBN as compared with other shallow learning methods.

Table 2
Comparisons of the recognition accuracy (%) of different algorithms with different numbers of training sample per class (BJJTU).


With the number of the classes increase from 100 to 150 and 200, the overall recognition accuracies of all approaches decreased. The identification accuracies of IR-DDBN were 89.27%, 87.15%, and 84.38% when the test classes were 100, 150 and 200, using 3 training samples per class. However, the recognition performance of the proposed algorithms was still superior to PCA, HOG, LBP and traditional DBN approaches. LBP, HOG and PCA showed relatively lower recognition rates than the proposed approach, especially when the training samples are 3 and 5, suggesting that DBN can extract the substantive feature from a relatively small number of training samples. Other DBN approaches can not exceed the proposed method for they did not use the whitening PCA principal components and residue components in the same time. The inferior identification performance of CNN as compared with IR-DDBN may come from the complicated optimizing of parameter setting for CNN requires excessive training to explore. To sum up, the identification performance of the proposed IR-DDBN outweighed the other approaches in the table when the numbers of training samples and test classes varied.

(Table 3) listed the identification performance of IR-DDBN, CNN, PCA, HOG and LBP executed on PolyU Palmprint Database. Higher identification accuracies than those on BJJTU Palmprint Database may come from the image quality acquired in different circumstances. The identification accuracies of IR-DDBN were 99.44%, 99.25%, and 98.75% when the number of classes were 100, 150 and 200, using 3 training samples per class. When the training samples were 5 and 7 per class, the identification accuracies of IR-DDBN exceeded 99%. The outperformance of IR-DDBN as compared with other algorithms on different databases witnessed its robustness in palmprint identification.

Table 3
Comparisons of the recognition accuracy (%) of different algorithms with different numbers of training sample per class (PolyU).


CONCLUSION

In this paper, we proposed an algorithm based on image reconstruction and double DBNs for palmprint recognition. The features extracted by whitening PCA based on original image and residue space were trained by two separated DBNs and integrated in the last layer for classification. The experimental results witnessed the effectiveness of the algorithm, which proved that the double DBNs based on image reconstruction can not only extract the effective features from a relatively small number of training samples, but is also benefited from the relatively complete information from whitening PCA space and residue error space.

CONFLICT OF INTEREST

The author confirms that this article content has no conflict of interest.

ACKNOWLEDGEMENTS

This work was supported partly by the National Natural Science Foundation of China under Grant No.61562067,No. 61461041, and No.51365035, the Postdoctoral Science Foundation of China No. 20100480370 and No. 201104179.

REFERENCES

[1] D. D. Zhang, Palmprint Authentication, Kluwer Academic Publisher: New York, 2004.
[2] A. Kong, D. Zhang, and M. Kamel, "A survey of palmprint recognition", Pattern Recognit., vol. 42, pp. 1408-1418, 2009.
[http://dx.doi.org/10.1016/j.patcog.2009.01.018]
[3] R. Raghavendra, and C. Busch, "Texture based features for robust palmprint recognition: a comparative study", EURASIP J. Inf. Secur., vol. 2015, pp. 1-9, 2015.
[http://dx.doi.org/10.1186/s13635-015-0022-z]
[4] G. Lu, D. Zhang, and K. Wang, "Palmprint recognition using eigenpalms features", Pattern Recognit. Lett., vol. 24, pp. 1463-1467, 2003.
[http://dx.doi.org/10.1016/S0167-8655(02)00386-0]
[5] L. Shang, D.S. Huang, J.X. Du, and C.H. Zheng, "Palmprint recognition using FastICA algorithm and radial basis probabilistic neural network", Neurocomputing, vol. 69, pp. 1782-1786, 2006.
[http://dx.doi.org/10.1016/j.neucom.2005.11.004]
[6] S. Minaee, and Y. Wang, "Palmprint Recognition Using Deep Scattering Convolutional Network", arXiv preprint arXiv:1603.09027, 2016.
[7] D. Zhao, X. Pan, X. Luo, and X. Gao, "Palmprint recognition based on deep learning", In: International Conference on Wireless, Mobile and Multi-Media, 2015, pp. 214-217.
[http://dx.doi.org/10.1049/cp.2015.0942]
[8] T. Connie, D. Ngo, A. Teoh, and M. Goh, "Palmprint recognition with PCA and ICA", In: Image and Vision Computing New Zealand 2003, Palmerston North, New Zealand, 2003, pp. 232-227.
[9] L. Lin, "Palmprint Identification Using PCA Algorithm and Hierarchical Neural Network", In: Life System Modeling and Intelligent Computing, Springer Berlin Heidelberg, 2010, pp. 618-625.
[http://dx.doi.org/10.1007/978-3-642-15615-1_73]
[10] J. Tao, W. Jiang, Z. Gao, S. Chen, and C. Wang, "Palmprint recognition based on 2-dimension PCA", In: International Conference on Innovative Computing, Information and Control, 2006, pp. 326-330.
[11] X.U. Bin, and M.A. Jin-Wen, "Theoretical Normalization and Generalization of PCA Joint Subspace Model", J. Signal Process., vol. 29, pp. 1638-1643, 2013.
[12] C. Zhou, L. Wang, Q. Zhang, and X. Wei, "Face recognition based on PCA image reconstruction and LDA", Optik - Int. J. Light Electron Optics, vol. 124, pp. 5599-5603, 2013.
[13] S. Chen, and H. Yin, "Novel feature compensation method for face recognition based on whitening PCA image reconstruction(in Chinese)", Appl. Res. Comput., vol. 32, pp. 2853-2856, 2015.
[14] Y. Deng, Q. Dai, and Z. Zhang, "Graph Laplace for occluded face completion and recognition", In: IEEE Transactions on Image Processing, vol. 20. 2011, pp. 2329-2338.
[15] Y. Deng, Q. Dai, R. Liu, Z. Zhang, and S. Hu, "Low-rank structure learning via nonconvex heuristic recovery", IEEE Trans. Neural Netw. Learn. Syst., vol. 24, no. 3, pp. 383-396, 2013.
[http://dx.doi.org/10.1109/TNNLS.2012.2235082] [PMID: 24808312]
[16] Y. Guo, Y. Liu, A. Oerlemans, S. Lao, S. Wu, and M.S. Lew, "Deep learning for visual understanding: A review", Neurocomputing, vol. 187, pp. 27-48, 2015.
[http://dx.doi.org/10.1016/j.neucom.2015.09.116]
[17] Y. LeCun, Y. Bengio, and G. Hinton, "Deep learning", Nature, vol. 521, no. 7553, pp. 436-444, 2015.
[http://dx.doi.org/10.1038/nature14539] [PMID: 26017442]
[18] P. Luo, "Hierarchical face parsing via deep learning", In: IEEE Conference on Computer Vision and Pattern Recognition, 2012, pp. 2480-2487.
[19] H. Lee, C. Ekanadham, and A.Y. Ng, "Sparse deep belief net model for visual area V2", In: Advances in Neural Information Processing Systems, vol. 20. 2008, pp. 873-880.
[20] Q.V. Le, "Building high-level features using large scale unsupervised learning", In: IEEE International Conference on Acoustics, Speech and Signal Processing, 2011, pp. 8595-8598.
[21] M. Osadchy, Y.L. Cun, and M.L. Miller, "Synergistic face detection and pose estimation with energy-based models", J. Machine Learn. Res., vol. 8, pp. 1197-1215, 2007.
[http://dx.doi.org/10.1007/11957959_10]
[22] E.J. Humphrey, J.P. Bello, and Y. Lecun, "Moving beyond feature design: Deep architectures and automatic feature learning in music informatics", In: 13th International Society for Music Information Retrieval Conference (ISMIR), 2012, pp. 403-408.
[23] F. Seide, G. Li, and D. Yu, "Conversational speech transcription using context-dependent deep neural networks", In: Conference of the International Speech Communication Association (INTERSPEECH), 2011, pp. 437-440.
[24] Y. Deng, B. Feng, X. Deng, and R. Wang, "Deep and structured robust information theoretic learning for image analysis", IEEE Trans. Image Process., vol. 25, pp. 4209-4221, 2016.
[25] J. Hu, J. Lu, and Y.P. Tan, "Deep transfer metric learning", In: IEEE Conference on Computer Vision and Pattern Recognition, 2015, pp. 325-333.
[26] Y. Deng, Z. Ren, Y. Kong, and F. Bao, "A hierarchical fused fuzzy deep neural network for data classification", IEEE Trans. Fuzzy Syst., 2016.
[http://dx.doi.org/10.1109/TFUZZ.2016.2574915]
[27] J. Ngiam, A. Khosla, M. Kim, J. Nam, H. Lee, and A.Y. Ng, "Multimodal deep learning", In: International Conference on Machine Learning (ICML), 2011, pp. 689-696.
[28] Y. Sun, X. Wang, and X. Tang, "Hybrid deep learning for face verification", In: IEEE International Conference on Computer Vision, 2013, pp. 1489-1496.
[29] G.E. Hinton, S. Osindero, and Y.W. Teh, "A fast learning algorithm for deep belief nets", Neural Comput., vol. 18, no. 7, pp. 1527-1554, 2006.
[http://dx.doi.org/10.1162/neco.2006.18.7.1527] [PMID: 16764513]
[30] G. Hinton, L. Deng, D. Yu, G.E. Dahl, A. Mohamed, and N. Jaitly, "Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups", IEEE Signal Process. Mag., vol. 29, pp. 82-97, 2012.
[http://dx.doi.org/10.1109/MSP.2012.2205597]
[31] G.E. Hinton, "A practical guide to training restricted boltzmann machines", Momentum, vol. 9, pp. 599-619, 2010.
[32] D. Liang, K. Weng, C. Wang, and G. Liang, "A 3D object recognition and pose estimation system using deep learning method", In: IEEE International Conference on Information Science and Technology, 2014, pp. 401-404.
[http://dx.doi.org/10.1109/ICIST.2014.6920502]
[33] N. Dalal, and B. Triggs, "Histograms of Oriented Gradients for Human Detection", In: IEEE Computer Society Conference on Computer Vision & Pattern Recognition, 2005, pp. 886-893.
[http://dx.doi.org/10.1109/CVPR.2005.177]
[34] D. Hong, W. Liu, J. Su, Z. Pan, and G. Wang, "A novel hierarchical approach for multispectral palmprint recognition", Neurocomputing, vol. 151, pp. 511-521, 2015.
[http://dx.doi.org/10.1016/j.neucom.2014.09.013]
[35] A. Krizhevsky, I. Sutskever, and G.E. Hinton, "ImageNet classification with deep convolutional neural networks", In: International Conference on Neural Information Processing Systems, 2012, pp. 1097-1105.
Track Your Manuscript:


Endorsements



"Open access will revolutionize 21st century knowledge work and accelerate the diffusion of ideas and evidence that support just in time learning and the evolution of thinking in a number of disciplines."


Daniel Pesut
(Indiana University School of Nursing, USA)

"It is important that students and researchers from all over the world can have easy access to relevant, high-standard and timely scientific information. This is exactly what Open Access Journals provide and this is the reason why I support this endeavor."


Jacques Descotes
(Centre Antipoison-Centre de Pharmacovigilance, France)

"Publishing research articles is the key for future scientific progress. Open Access publishing is therefore of utmost importance for wider dissemination of information, and will help serving the best interest of the scientific community."


Patrice Talaga
(UCB S.A., Belgium)

"Open access journals are a novel concept in the medical literature. They offer accessible information to a wide variety of individuals, including physicians, medical students, clinical investigators, and the general public. They are an outstanding source of medical and scientific information."


Jeffrey M. Weinberg
(St. Luke's-Roosevelt Hospital Center, USA)

"Open access journals are extremely useful for graduate students, investigators and all other interested persons to read important scientific articles and subscribe scientific journals. Indeed, the research articles span a wide range of area and of high quality. This is specially a must for researchers belonging to institutions with limited library facility and funding to subscribe scientific journals."


Debomoy K. Lahiri
(Indiana University School of Medicine, USA)

"Open access journals represent a major break-through in publishing. They provide easy access to the latest research on a wide variety of issues. Relevant and timely articles are made available in a fraction of the time taken by more conventional publishers. Articles are of uniformly high quality and written by the world's leading authorities."


Robert Looney
(Naval Postgraduate School, USA)

"Open access journals have transformed the way scientific data is published and disseminated: particularly, whilst ensuring a high quality standard and transparency in the editorial process, they have increased the access to the scientific literature by those researchers that have limited library support or that are working on small budgets."


Richard Reithinger
(Westat, USA)

"Not only do open access journals greatly improve the access to high quality information for scientists in the developing world, it also provides extra exposure for our papers."


J. Ferwerda
(University of Oxford, UK)

"Open Access 'Chemistry' Journals allow the dissemination of knowledge at your finger tips without paying for the scientific content."


Sean L. Kitson
(Almac Sciences, Northern Ireland)

"In principle, all scientific journals should have open access, as should be science itself. Open access journals are very helpful for students, researchers and the general public including people from institutions which do not have library or cannot afford to subscribe scientific journals. The articles are high standard and cover a wide area."


Hubert Wolterbeek
(Delft University of Technology, The Netherlands)

"The widest possible diffusion of information is critical for the advancement of science. In this perspective, open access journals are instrumental in fostering researches and achievements."


Alessandro Laviano
(Sapienza - University of Rome, Italy)

"Open access journals are very useful for all scientists as they can have quick information in the different fields of science."


Philippe Hernigou
(Paris University, France)

"There are many scientists who can not afford the rather expensive subscriptions to scientific journals. Open access journals offer a good alternative for free access to good quality scientific information."


Fidel Toldrá
(Instituto de Agroquimica y Tecnologia de Alimentos, Spain)

"Open access journals have become a fundamental tool for students, researchers, patients and the general public. Many people from institutions which do not have library or cannot afford to subscribe scientific journals benefit of them on a daily basis. The articles are among the best and cover most scientific areas."


M. Bendandi
(University Clinic of Navarre, Spain)

"These journals provide researchers with a platform for rapid, open access scientific communication. The articles are of high quality and broad scope."


Peter Chiba
(University of Vienna, Austria)

"Open access journals are probably one of the most important contributions to promote and diffuse science worldwide."


Jaime Sampaio
(University of Trás-os-Montes e Alto Douro, Portugal)

"Open access journals make up a new and rather revolutionary way to scientific publication. This option opens several quite interesting possibilities to disseminate openly and freely new knowledge and even to facilitate interpersonal communication among scientists."


Eduardo A. Castro
(INIFTA, Argentina)

"Open access journals are freely available online throughout the world, for you to read, download, copy, distribute, and use. The articles published in the open access journals are high quality and cover a wide range of fields."


Kenji Hashimoto
(Chiba University, Japan)

"Open Access journals offer an innovative and efficient way of publication for academics and professionals in a wide range of disciplines. The papers published are of high quality after rigorous peer review and they are Indexed in: major international databases. I read Open Access journals to keep abreast of the recent development in my field of study."


Daniel Shek
(Chinese University of Hong Kong, Hong Kong)

"It is a modern trend for publishers to establish open access journals. Researchers, faculty members, and students will be greatly benefited by the new journals of Bentham Science Publishers Ltd. in this category."


Jih Ru Hwu
(National Central University, Taiwan)


Browse Contents




Webmaster Contact: info@benthamopen.net
Copyright © 2023 Bentham Open