Introduction to Information Theory and Data Compression: 2nd Edition (Paperback) book cover

Introduction to Information Theory and Data Compression

2nd Edition

By Jr. Johnson, Greg A. Harris, D.C. Hankerson

Chapman and Hall/CRC

384 pages

Purchasing Options:$ = USD
Paperback: 9780367395438
pub: 2019-09-25
SAVE ~$14.99
Hardback: 9781584883135
pub: 2003-02-26
SAVE ~$31.00
eBook (VitalSource) : 9780429144288
pub: 2003-02-26
from $37.48

FREE Standard Shipping!


An effective blend of carefully explained theory and practical applications, this text imparts the fundamentals of both information theory and data compression. Although the two topics are related, this unique text allows either topic to be presented independently, and it was specifically designed so that the data compression section requires no prior knowledge of information theory.

The treatment of information theory, while theoretical and abstract, is quite elementary, making this text less daunting than many others. After presenting the fundamental definitions and results of the theory, the authors then apply the theory to memoryless, discrete channels with zeroth-order, one-state sources.

The chapters on data compression acquaint students with a myriad of lossless compression methods and then introduce two lossy compression methods. Students emerge from this study competent in a wide range of techniques. The authors' presentation is highly practical but includes some important proofs, either in the text or in the exercises, so instructors can, if they choose, place more emphasis on the mathematics.

Introduction to Information Theory and Data Compression, Second Edition is ideally suited for an upper-level or graduate course for students in mathematics, engineering, and computer science.


  • Expanded discussion of the historical and theoretical basis of information theory that builds a firm, intuitive grasp of the subject

  • Reorganization of theoretical results along with new exercises, ranging from the routine to the more difficult, that reinforce students' ability to apply the definitions and results in specific situations.

  • Simplified treatment of the algorithm(s) of Gallager and Knuth

  • Discussion of the information rate of a code and the trade-off between error correction and information rate

  • Treatment of probabilistic finite state source automata, including basic resul

  • Table of Contents

    INFORMATION THEORY: Elementary Probability. Information and Entropy. Channels and Channel Capacity. Coding Theory. DATA COMPRESSION: Lossless Data Compression by Replacement Schemes. Arithmetic Coding. Higher-Order Modeling. Adaptive Methods. Dictionary Methods. Transform Methods and Image Compression. Appendices. Bibliography. Index.

    About the Authors

    Johnson, Jr.; Harris, Greg A.; Hankerson, D.C.

    About the Series

    Applied Mathematics

    Learn more…

    Subject Categories

    BISAC Subject Codes/Headings:
    COMPUTERS / Operating Systems / General
    COMPUTERS / Computer Engineering
    MATHEMATICS / General
    MATHEMATICS / Combinatorics