Skip to main content Accessibility help
Internet Explorer 11 is being discontinued by Microsoft in August 2021. If you have difficulties viewing the site on Internet Explorer 11 we recommend using a different browser such as Microsoft Edge, Google Chrome, Apple Safari or Mozilla Firefox.
Home
> Subjects
> Information Theory

Information Theory From Coding to Learning

Authors

Yury Polyanskiy
, Massachusetts Institute of Technology,
Yihong Wu
, Yale University, Connecticut
Published 2025

Description

This enthusiastic introduction to the fundamentals of information theory builds from classical Shannon theory through to modern applications in statistical learning, equipping students with a uniquely well-rounded and rigorous foundation for further study. Introduces core topics such as data compression, channel coding, and rate-distortion theory using a unique finite block-length approach. With over 210 end-of-part exercises and numerous examples, students are introduced to contemporary applications in statistics, machine learning and modern communication theory. This textbook presents information-theoretic methods with applications…

  • Get access
  • Add bookmark
  • Cite
  • Share
Resources available Unlock the full potential of this textbook with additional resources. There are Instructor restricted resources available for this textbook. Explore resources

Key features

  • Provides a systematic treatment of information-theoretic techniques in statistical learning and high-dimensional statistics
  • Develops information theory for both continuous and discrete variables providing examples relevant to statistical and machine learning applications
  • Focuses on finite block length (non-asymptotic) results, equipping students with information theory knowledge required for modern applications such as 6G and future network design
  • Advanced material suitable for skipping on first reading is clearly indicated, enabling a fast introduction to fundamental concepts which can be enhanced with additional material on re-reading

Keywords

About the book

Access options

Review the options below to login to check your access.

Purchase options

There are no purchase options available for this title.

Have an access code?

To redeem an access code, please log in with your personal login.

Log in

If you believe you should have access to this content, please contact your institutional librarian or consult our FAQ page for further information about accessing our content.

Also available to purchase from these educational ebook suppliers