Login | Register

Synergizing Probabilistic Models with Deep Learning: A Novel Framework for Topic Modeling and Multimodal Analysis

Title:

Synergizing Probabilistic Models with Deep Learning: A Novel Framework for Topic Modeling and Multimodal Analysis

Ojo, Akinlolu Oluwabusayo ORCID: https://orcid.org/0009-0001-4450-8055 (2026) Synergizing Probabilistic Models with Deep Learning: A Novel Framework for Topic Modeling and Multimodal Analysis. PhD thesis, Concordia University.

[thumbnail of Ojo_PhD_S2026.pdf]
Preview
Text (application/pdf)
Ojo_PhD_S2026.pdf - Accepted Version
Available under License Spectrum Terms of Access.
5MB

Abstract

Traditional topic modeling techniques, such as Latent Dirichlet Allocation (LDA), often employ standard Dirichlet distributions to model topic-word and document-topic relationships. While effective in certain contexts, these methods face limitations in capturing the complex dependencies, uncertainty, and heterogeneity in real-world data. These limitations become particularly pronounced in multimodal and cross-domain settings, where textual, visual, and spectral signals interact nonlinearly and where distribution shifts across platforms, languages, and domains are pervasive. While deep learning methods have advanced multimodal understanding and classification, many lack principled probabilistic foundations, leading to deterministic latent representations, component collapse, and poor robustness under domain shift. This dissertation addresses these challenges by introducing a unified probabilistic deep learning framework built upon expressive distributional priors, including the generalized Dirichlet, smoothed Dirichlet, and Beta-Liouville distributions. The proposed framework enables continuous latent representations that capture rich covariance structures, uncertainty, and asymmetry beyond standard Dirichlet and Gaussian assumptions. Within this paradigm, we develop a series of models spanning topic modeling, multimodal fusion, and cross-domain adaptation. We first propose a Generalized Dirichlet Variational Autoencoder (GD-VAE) for neural topic modeling, followed by smoothed Dirichlet-based multimodal architectures for fake news detection, including SmoothDetector and SD-MoBERT, which integrate probabilistic topic modeling with long-context transformer representations. To address robustness under distribution shift, we further introduce EviDA, an uncertainty-weighted domain adversarial learning framework that leverages evidential deep learning to adaptively modulate instance-level domain alignment in cross-domain and cross-lingual fake news detection. Finally, we propose PerLiFuse, a per-frequency Beta-Liouville fusion network operating in the spectral domain, which learns dynamic, example-specific gating across frequency bands to reconcile conflicting multimodal cues and mitigate fusion collapse. Extensive empirical evaluations across multiple benchmark datasets demonstrate consistent improvements in topic coherence, diversity, classification accuracy, robustness to domain shift, and uncertainty calibration over state-of-the-art baselines. Collectively, this work establishes a principled and extensible paradigm for probabilistic deep learning, enabling interpretable, robust, and scalable models for multimodal understanding and misinformation detection in complex real-world environments.

Divisions:Concordia University > Gina Cody School of Engineering and Computer Science > Concordia Institute for Information Systems Engineering
Item Type:Thesis (PhD)
Authors:Ojo, Akinlolu Oluwabusayo
Institution:Concordia University
Degree Name:Ph. D.
Program:Information and Systems Engineering
Date:28 January 2026
Thesis Supervisor(s):Bouguila, Nizar
ID Code:997048
Deposited By: Akinlolu Oluwabusayo Ojo
Deposited On:29 Jun 2026 17:54
Last Modified:29 Jun 2026 17:54
All items in Spectrum are protected by copyright, with all rights reserved. The use of items is governed by Spectrum's terms of access.

Repository Staff Only: item control page

Downloads per month over past year

Research related to the current document (at the CORE website)
- Research related to the current document (at the CORE website)
Back to top Back to top