Word-Valued Sources: An Ergodic Theorem, an AEP, and the Conservation of Entropy
Date
2010
Authors
Timo, Roy
Blackmore, Kim
Hanlen, Leif
Journal Title
Journal ISSN
Volume Title
Publisher
Institute of Electrical and Electronics Engineers (IEEE Inc)
Abstract
A word-valued source Y = Y1,Y2,̇ ̇ ̇ is discrete random process that is formed by sequentially encoding the symbols of a random process ${\bf X} = X1,X2 ̇ ̇ ̇ with codewords from a codebook. These processes appear frequently in information theory (i
Description
Keywords
Keywords: Average codeword length; Code-words; Codebooks; Entropy rates; Equipartition; Ergodic theorem; Prefix-free; Source-coding algorithm; Entropy; Random processes; Signal theory; Asymptotic analysis Asymptotic equipartition property (AEP); Asymptotically mean stationary (AMS); Ergodic theorem
Citation
Collections
Source
IEEE Transactions on Information Theory
Type
Journal article
Book Title
Entity type
Access Statement
License Rights
Restricted until
2037-12-31
Downloads
File
Description