Bouguila, Nizar ORCID: https://orcid.org/0000000172247940 and Epaillard, Elise ORCID: https://orcid.org/0000000187770478 (2018) Datafree metrics for Dirichlet and generalized Dirichlet mixturebased HMMs  A practical study. Pattern Recognition . ISSN 00313203 (In Press)
Preview 
Text (application/pdf)
831kBBouguila 2018.pdf  Accepted Version Available under License Spectrum Terms of Access. 
Official URL: http://dx.doi.org/10.1016/j.patcog.2018.08.013
Abstract
Approaches to design metrics between hidden Markov models (HMM) can be divided into two classes: databased and parameterbased. The latter has the clear advantage of being deterministic and faster but only a very few similarity measures that can be applied to mixturebased HMMs have been proposed so far. Most of these metrics apply to the discrete or Gaussian HMMs and no comparative study have been led to the best of our knowledge. With the recent development of HMMs based on the Dirichlet and generalized Dirichlet distributions for proportional data modeling, we propose to design three new parametric similarity measures between these HMMs. Extensive experiments on synthetic data show the reliability of these new measures where the existing ones fail at giving expected results when some parameters vary. Illustration on real data show the clustering capability of these measures and their potential applications.
Divisions:  Concordia University > Gina Cody School of Engineering and Computer Science > Concordia Institute for Information Systems Engineering 

Item Type:  Article 
Refereed:  Yes 
Authors:  Bouguila, Nizar and Epaillard, Elise 
Journal or Publication:  Pattern Recognition 
Date:  2018 
Funders: 

Digital Object Identifier (DOI):  10.1016/j.patcog.2018.08.013 
Keywords:  hidden Markov models; similarity measure; Dirichlet; generalized Dirichlet 
ID Code:  984282 
Deposited By:  ALINE SOREL 
Deposited On:  31 Aug 2018 19:31 
Last Modified:  27 Aug 2020 00:00 
References:
L.E. Baum, T. Petrie. Statistical inference for probabilistic functions of finite state Markov chains, The Ann. of Math. Stat., 37 (1966), pp. 15541563O. AbdelHamid, H. Jiang. Fast speaker adaptation of hybrid NN/HMM model for speech recognition based on discriminative learning of speaker code, Acoust., Speech and Signal Proc., IEEE Int. Conf. on, Vancouver, BC, Canada, IEEE (2013), pp. 79427946
K. Tokuda, Y. Nankaku, T. Toda, H. Zen, J. Yamagishi, Y. Oura. Speech synthesis based on hidden Markov models, Proc. of the IEEE, 101 (2013), pp. 12341252
F. Alvaro, J.A. Sanchez, J.M. Benedi. Recognition of online handwritten mathematical expressions using 2D stochastic contextfree grammars and hidden Markov models, Pattern Recognit. Lett., 35 (2014), pp. 5867
J. Baumgartner, A.G. Flesia, J. Gimenez, J. Pucheta. A new image segmentation framework based on twodimensional hidden Markov models, Integr. Comput.Aided Eng., 23 (2016), pp. 113
L. Rossi, J. Chakareski, P. Frossard, S. Colonnese. A Poisson hidden Markov model for multiview video traffic, IEEE/ACM Trans. on Netw., 23 (2015), pp. 547558
E. Epaillard, N. Bouguila. Proportional data modeling with hidden Markov models based on generalized Dirichlet and BetaLiouville mixtures applied to anomaly detection in public areas, Pattern Recognit., 55 (2016), pp. 125136
A. Soualhi, H. Razik, G. Clerc, D.D. Doan. Prognosis of bearing failures using hidden Markov models and the adaptive neurofuzzy inference system, IEEE Trans. on Ind. Electron., 61 (2014), pp. 28642874
Y. Cao, Y. Li, S. Coleman, A. Belatreche, T.M. McGinnity. Adaptive hidden Markov model with anomaly states for price manipulation detection, IEEE Trans. on Neural Netw. and Learn. Syst., 26 (2015), pp. 318330
L.R. Rabiner, B.H. Juang. An introduction to hidden Markov models, IEEE ASSP Mag., 3 (1) (1986), pp. 416
E.L. Andrade, S. Blunsden, R.B. Fisher. Hidden Markov models for optical flow analysis in crowds, Pattern Recognit., 18th Int. Conf. on, IEEE (2006), pp. 460463
M. Bicego, U. Castellani, V. Murino. A hidden Markov model approach for appearancebased 3d object recognition, Pattern Recognit. Lett., 26 (2005), pp. 25882599
F.B. Lung, M.H. Jaward, J. Parkkinen. Spatiotemporal descriptor for abnormal human activity detection, Mach. Vis. Appl., 14th IAPR Int. Conf. on, IEEE (2015), pp. 471474
S.P. Chatzis, D.I. Kosmopoulos, T.A. Varvarigou. Robust sequential data modeling using an outlier tolerant hidden Markov model, IEEE Trans. on Pattern Anal. and Mach. Intell., 31 (2009), pp. 16571669
S.P. Chatzis. Hidden Markov models with nonelliptically contoured state densities, IEEE Trans. on Pattern Anal. and Mach. Intell., 32 (2010), pp. 22972304
A. Punzo, A. Maruotti. Clustering multivariate longitudinal observations: The contaminated Gaussian hidden Markov model, J. of Comput. and Graph. Stat., 25 (2016), pp. 10971116
L. Chen, D. Barber, J.M. Odobez. Dynamical Dirichlet mixture model, IDIAPRR, IDIAP (2007)
E. Epaillard, N. Bouguila. Hybrid hidden Markov model for mixed continuous/continuous and discrete/continuous data modeling, Multimed. Signal Proc., 17th IEEE Int. Workshop on, IEEE (2015), pp. 16
F. Cuzzolin, M. Sapienza. Learning pullback HMM distances, IEEE Trans. on Pattern Anal. and Mach. Intell., 36 (7) (2014), pp. 14831489
M.N. Do. Fast approximation of KullbackLeibler distance for dependence trees and hidden Markov models, IEEE Signal Proc. Lett., 10 (4) (2003), pp. 115118
L. Chen, H. Man. st schemes for computing similarities between Gaussian HMMs and their applications in texture image classification, EURASIP J. on Appl. Signal Proc., 13 (2005), pp. 19841993
C.R. Wren, D.C. Minnen, S.G. Rao. Similaritybased analysis for large networks of ultra low resolution sensors, Pattern Recognition, 39 (10) (2006), pp. 19181931
D. GarciaGarcia, E. ParradoHernandez, F. Diazde Maria. Statespace dynamics distance for clustering sequential data, Pattern Recognition, 44 (5) (2011), pp. 10141022
S.M.E. Sahraeian, B.J. Yoon. A novel lowcomplexity HMM similarity measure, IEEE Signal Proc. Lett., 18 (2) (2011), pp. 8790
J. Zeng, J. Duan, C. Wu. A new distance measure for hidden Markov models, Expert Syst. with Appl., 37 (2010), pp. 15501555
B.H. Juang, L.R. Rabiner. A probabilistic distance measure for hidden Markov models, AT&T Tech. J., 64 (2) (1985), pp. 391408
E. Epaillard, N. Bouguila, D. Ziou. Classifying textures with only 10 visualwords using hidden Markov models with Dirichlet mixtures, Adapt. and Intell. Syst.  Proc. of the 3rd Int. Conf., Bournemouth, UK, Springer (2014), pp. 2028
E. Epaillard, N. Bouguila. Hidden Markov models based on generalized Dirichlet mixtures for proportional data modeling, Artif. Neural Netw. in Pattern Recognit.  Proc. of the 6th IAPR TC3 Int. Workshop, 2014, Montreal, QC, Canada, Springer (2014), pp. 7182
T. Jebara, R. Kondor. Bhattacharyya and expected likelihood kernels, B. Schölkopf, M.K. Warmuth (Eds.), 16th Annu. Conf. on Learn. Theory and 7th Kernel Workshop, Proc., Vol 2777 of Lecture Notes in Computer Science, Springer Berlin Heidelberg (2003), pp. 5771
N. Bouguila, D. Ziou. Highdimensional unsupervised selection and estimation of a finite generalized Dirichlet mixture model based on minimum message length, IEEE Trans. on Pattern Anal. and Mach. Intell., 29 (2007), pp. 17161731
T.T. Wong. Parameter estimation for generalized Dirichlet distributions from the sample estimates of the first and the second moments of random variables, Comput. Stat. and Data Anal., 54 (7) (2010), pp. 17561765
R. Jonker, A. Volgenant. A shortest augmenting path algorithm for dense and spare linear assignment problems, Comput., 38 (1987), pp. 325340
J.R. Hershey, P.A. Olsen. Approximating the Kullback Leibler divergence between Gaussian mixture models, Acoust., Speech and Signal Proc., IEEE Int. Conf. on, 4, IEEE (2007), pp. 317320
W. Masoudimansour, N. Bouguila. Generalized Dirichlet mixture matching projection for supervised linear dimensionality reduction of proportional data, Multimed. Signal Proc., IEEE 18th Int. Workshop on, IEEE (2016), pp. 16
S. Merugu, J. Ghosh. A privacysensitive approach to distributed clustering, Pattern Recognition Letters, 26 (4) (2005), pp. 399410
Y. Yang, J. Jiang. Biweighted ensemble via hmmbased approaches for temporal data clustering, Pattern Recognition, 76 (2018), pp. 391403
V. Mahadevan, W. Li, V. Bhalodia, N. Vasconcelos. Anomaly detection in crowded scenes, Computer Vision and Pattern Recognition (CVPR), 2010 IEEE Conference on (2010), pp. 19751981
A. Zaharescu, R. Wildes. Anomalous behaviour detection using spatiotemporal oriented energies, subset inclusion histogram comparison and eventdriven processing. K. Daniilidis, P. Maragos, N. Paragios (Eds.), ECCV (1), Lecture Notes in Computer Science, 6311, Springer (2010), pp. 563576
kmedoids implementation. URL http://www.mathworks.com/matlabcentral/fileexchange/28860kmedioids
Repository Staff Only: item control page