Information Theory and Coding Basics

Five Hamming (7, 4) codewords are lined up and sent in the order of bit 1 of each of the five codewords, then bit 2 of each, and so on (interleaving of depth 5). The receiver restores the original order and then corrects a 1-bit error in each codeword. Which of the following is the maximum length of a burst error, concentrated in consecutive bits, that can always be corrected?

  1. A5 bits
  2. B7 bits
  3. C35 bits
Show answer and explanation

Answer: A. 5 bits

In the transmitted bit stream, bits of the same codeword appear every 5 bits. As a result, a burst error of 5 consecutive bits or fewer is split, after restoring the order, into at most one bit in each of the five codewords, and every one of them can be corrected by the Hamming code. With 6 bits, some codeword receives a 2-bit error and can no longer be corrected. Without interleaving, even a 2-bit burst error would fall into a single codeword.

  • A. Correct. With a depth of 5, a burst error of up to 5 bits is split into one bit per codeword.
  • B. 7 bits is the codeword length. A 6-bit burst error already puts a 2-bit error into some codeword.
  • C. 35 bits is the total number of bits sent. Each codeword can correct only 1 bit, so a burst that long cannot be corrected.
Practice this topic Back to topic

Books on Information Theory and Coding Basics Ad

As an Amazon Associate I earn from qualifying purchases.

More Information Theory and Coding Basics questions

  1. Which of the following correctly describes ARQ (automatic repeat request) and FEC (forward error correction), methods for dealing with errors in communication?
  2. In a binary symmetric channel, 0s and 1s are sent and each bit flips independently with probability 0.1. With the binary entropy function H(p) = −p log₂ p − (1 − p) log₂(1 − p), H(0.1) ≈ 0.469. Which of the following is closest to the channel capacity of this channel per transmission?
  3. Which of the following correctly states Shannon's channel coding theorem?
  4. To convert a Gray code into an ordinary binary number, the most significant bit is used as it is, and each lower bit is found as the exclusive OR of the binary bit already found one position higher and the Gray code bit in the same position. Which of the following is the 4-bit Gray code 1101 converted into binary?
  5. Let the amount of information obtained on being told that an event of probability p has occurred be −log₂ p bits. Which of the following is the amount of information obtained on being told that an event of probability 1/8 has occurred?