Mathematical Foundations Of Information Theory | A. Ya. Khinchin
Mathematical Foundations Of Information Theory
User Rating: Be the first one!
Author: A. Ya. Khinchin
Added by: mirtitles
Added Date: 2021-12-05
Publication Date: 1957
Language: eng
Subjects: mathematics, information, noise, entropy, uniqueness theorem, markov chains, coding theory, shanon's inequality, feinstein inequality, ergodic theory, ergodic sources, concept of channel, feinstein fundamental lemma, shanon's theorems
Collections: mir-titles, additional collections
Pages Count: 300
PPI Count: 300
PDF Count: 1
Total Size: 53.66 MB
PDF Size: 2.56 MB
Extensions: epub, pdf, gz, html, zip, torrent
Downloads: 2.93K
Views: 52.93
Total Files: 16
Media Type: texts
Description
The book is a translation of two papers written by the Russian mathematician, A. I. Khinchin, for the expository journal Uspekhi. These papers present the mathematical foundations of information theory. While completely rigorous, the flavour of the engineering applications which led to the theory runs throughout and very much helps the intuition. Khinchin has here reformulated basic concepts and presents for the first time rigorous proofs of certain fundamental theorems in the subject.
The first paper discusses the concept of entropy and gives one major application to coding. The only stochastic processes used are Markov chains. This paper would serve as a valuable supplement to an introductory probability course.
The second and longer paper uses more advanced topics from probability theory, for example, stationary processes and martingales. However, the treatment is quite complete and the non specialist would not suffer thanks to Khinchin's amazing expository ability.
It is a tribute to Shannon's theory that a rigorous treatment only enhances
the elegance of the basic theorems.