Back to search

University of Waterloo

On the Calculation of Mutual Information for Channels with Gauss-Markov Noise

Abstract

dc:description.abstract

In this thesis, we study channels with additive Gauss-Markov noise. Such noise models are natural in many contexts and the characterization of the mutual information is unknown. We specifically study the relationship between mutual information and the Minimum Mean Square Error (MMSE) associated with the signal estimation in such channels. The early work of Duncan on channels with additive Brownian motion noise showed that the mutual information over an interval [0,T] of a channel with a general (not necessarily Gaussian) signal in the presence of additive Brownian noise is equal to the integral of the causal MMSE error over the period, where by causal we mean the filtered estimate. Our objective in this thesis is to expand upon this result in the presence of Ornstein-Uhlenbeck noise in the channel. It is shown that the same relation between mutual information and MMSE error holds. Additionally, the result is extended to a more general case in which the stochastic signal is a general function of the past. We derive the results using the machinery of stochastic calculus, specifically the Girsanov theorem and this is of independent interest.

Degree

thesis:*
Grantor dc:publisher
University of Waterloo
Year dc:date.issued
2024

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Fallah, Kasra
Advisor dc:contributor.advisor
  • Mazumdar, Ravi

Rights

Language dc:language.iso
en

Identifiers

dc:identifier.*
Handle dc:identifier.uri
https://hdl.handle.net/10012/20776

Chain of custody

source
Harvested from
University of Waterloo
Base URL
dspacemainprd01.lib.uwaterloo.ca/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
related terms
citation

Fallah, Kasra. On the Calculation of Mutual Information for Channels with Gauss-Markov Noise. University of Waterloo, 2024. https://hdl.handle.net/10012/20776