Login | Register

Information Geometry of Statistical Models


Information Geometry of Statistical Models

Yang, Xi (2018) Information Geometry of Statistical Models. Masters thesis, Concordia University.

[thumbnail of YANG_MA_F2018.pdf]
Text (application/pdf)
YANG_MA_F2018.pdf - Accepted Version
Available under License Spectrum Terms of Access.


Information Geometry is a relatively young branch of Mathematics, which roots back to studies of invariant geometrical structure involved in statistical inference. It de- fines a Riemannian metric together with dually coupled affine connections in a mani- fold of probability distributions. These structures provide tools not only for studying statistical inference but also for research in wider areas of information sciences, such as machine learning, signal processing, optimization, and even neuroscience, not to mention mathematics and physics. The aim of this thesis is to give a brief intro- duction to Information Geometry with focus on the exponential family. In Chapter 1, we first introduce the notion and basic properties of statistical models. We then define some common notions in information geometry such as Fisher information, Christoffel symbols, connections, Skewness tensor, geodesic and Jeffreys Prior. We also introduce the geometry of entropy, including entropy, Kullback-Leibler diver- gence (or relative entropy) and information energy on statistical models. Chapter 2 focuses on the geometry of the exponential family of probability distributions. Ex- amples and properties of exponential families are firstly discussed in this chapter. Fisher metric and geodesics are worked out explicitly for common exponential fam- ilies. Chapter 3 contains important examples of exponential families for which the entropy, Kullback-Leibler relative entropy and information energy are worked out explicitly. This chapter deals also with the problem of finding the density of maximum entropy subject to the first N moment constraints, with unique solutions for the cases N ≤ 2.

Divisions:Concordia University > Faculty of Arts and Science > Mathematics and Statistics
Item Type:Thesis (Masters)
Authors:Yang, Xi
Institution:Concordia University
Degree Name:M.A.
Date:26 June 2018
Thesis Supervisor(s):Stancu, Alina
ID Code:984178
Deposited By: XI YANG
Deposited On:16 Nov 2018 15:23
Last Modified:01 Sep 2020 00:00
All items in Spectrum are protected by copyright, with all rights reserved. The use of items is governed by Spectrum's terms of access.

Repository Staff Only: item control page

Downloads per month over past year

Research related to the current document (at the CORE website)
- Research related to the current document (at the CORE website)
Back to top Back to top