Login | Register

Bayesian Matrix Factorization and Applications


Bayesian Matrix Factorization and Applications

Dalhoumi, Oumayma (2022) Bayesian Matrix Factorization and Applications. Masters thesis, Concordia University.

[thumbnail of Dalhoumi__MASc_F2022.pdf]
Text (application/pdf)
Dalhoumi__MASc_F2022.pdf - Accepted Version


Nonnegative matrix factorization (NMF) reduces the observed nonnegative matrix into a product of two nonnegative matrices. Nonnegativity entails two major implications: non-negative components and purely additive combination. These characteristics made this method useful in a wide range of applications. In this thesis, we propose two novel Bayesian nonnegative matrix factorization techniques.

First, we propose a model dedicated to semi-bounded data where each entry of the observed matrix is supposed to follow an Inverted Beta distribution. Latent variables of the factorized parameter matrices follow a Gamma prior. Variational Bayesian inference and lower bound approximation for the objective function are used to find an analytically tractable solution for the model. An online extension of the algorithm is also proposed for more scalability. Both models are evaluated on five different applications.

Second, we propose a Bayesian NMF that can be specifically useful for non intrusive load monitoring (NILM). NILM can be formulated as a source separation problem where the aggregated signal is expressed as linear combination of basis vectors in a matrix factorization framework. The model achieves superior performance by imposing sparsity on the activation matrix using Dirichlet priors. To estimate the parameters of the model, variational Bayesian inference is used. A novel optimization approach is proposed to find an analytically tractable solution for the model. We evaluate the model with three data sets: REDD, AMPds and IRISE, and with multiple experimental setups. The proposed model provides interpretability, flexibility and high performance.

Divisions:Concordia University > Gina Cody School of Engineering and Computer Science > Concordia Institute for Information Systems Engineering
Item Type:Thesis (Masters)
Authors:Dalhoumi, Oumayma
Institution:Concordia University
Degree Name:M.A. Sc.
Program:Quality Systems Engineering
Date:22 May 2022
Thesis Supervisor(s):Bouguila, Nizar and Amayri, Manar
ID Code:990635
Deposited By: Oumayma Dalhoumi
Deposited On:27 Oct 2022 14:02
Last Modified:27 Oct 2022 14:02
All items in Spectrum are protected by copyright, with all rights reserved. The use of items is governed by Spectrum's terms of access.

Repository Staff Only: item control page

Downloads per month over past year

Research related to the current document (at the CORE website)
- Research related to the current document (at the CORE website)
Back to top Back to top