CHAPTER 12

Information Theory and Coding

Chapter Outline

Learning Objectives

  • Definition of Information and Measure of Information Content
  • Average Information Transmitted or Entropy
  • Information Rate
  • Shannon-Fano Theorem of Coding
  • Channel Capacity
  • Encoding Techniques
  • Error Coding

12.1 Introduction

Communication means exchange of information. Information theory aims to estimate the information content of any signal. The importance of any information depends on its news value. In our day-to-day life an event that occurs ...

Get Analog and Digital Communications now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.