Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

LDPC Codes
B. Delporte, M. El Ouardani, R. Keita, S. Poissy
ESIEE Engineering

Wednesday, January 18th

B. Delporte, M. El Ouardani, R. Keita, S. Poissy

LDPC Codes

Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

Introduction

New technologies need high-rate and error-free communications No transmission medium is perfect Error detection and correction create a delay

B. Delporte, M. El Ouardani, R. Keita, S. Poissy

LDPC Codes

Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

Introduction

New technologies need high-rate and error-free communications No transmission medium is perfect Error detection and correction create a delay Fast and ecient methods are needed We will study a particular method based on LDPC codes

B. Delporte, M. El Ouardani, R. Keita, S. Poissy

LDPC Codes

Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

Plan

Transmission Channel Basics And Error-Correcting Codes

Linear Codes

LDPC Codes

B. Delporte, M. El Ouardani, R. Keita, S. Poissy

LDPC Codes

Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

Plan

Transmission Channel Basics And Error-Correcting Codes

Linear Codes

LDPC Codes

B. Delporte, M. El Ouardani, R. Keita, S. Poissy

LDPC Codes

Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

Shannon Diagram

Signal Source

Coder

Transmitter

Propagation Channel

Receiving End

Decoder

Receiver

B. Delporte, M. El Ouardani, R. Keita, S. Poissy

LDPC Codes

Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

Channel Capacity And Shannon limit

Channel capacity Shannon limit

B. Delporte, M. El Ouardani, R. Keita, S. Poissy

LDPC Codes

Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

Dierent Types of Error-Correcting Codes

Convolutional codes
Viterbi

B. Delporte, M. El Ouardani, R. Keita, S. Poissy

LDPC Codes

Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

Dierent Types of Error-Correcting Codes

Convolutional codes
Viterbi

Block codes
CRC Block linear codes
Hamming Reed-Solomon Reed-Muller LDPC

B. Delporte, M. El Ouardani, R. Keita, S. Poissy

LDPC Codes

Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

Dierent Types of Error-Correcting Codes

Convolutional codes
Viterbi

Block codes
CRC Block linear codes
Hamming Reed-Solomon Reed-Muller LDPC

Turbo codes

B. Delporte, M. El Ouardani, R. Keita, S. Poissy

LDPC Codes

Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

Plan

Transmission Channel Basics And Error-Correcting Codes

Linear Codes

LDPC Codes

B. Delporte, M. El Ouardani, R. Keita, S. Poissy

LDPC Codes

Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

Denition of a Linear Block Code

What is a linear block code ? Data is encoded in blocks A linear block code uses:
Finite elds Vector spaces Injective mapping

B. Delporte, M. El Ouardani, R. Keita, S. Poissy

LDPC Codes

Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

Parameters
Fq is the nite eld with q elements In our case: q = 2 (binary code)

B. Delporte, M. El Ouardani, R. Keita, S. Poissy

LDPC Codes

Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

Parameters
Fq is the nite eld with q elements In our case: q = 2 (binary code) Length n Vector space Fn with dimension n q Linear subspace C with dimension k of the vector space Fn q

B. Delporte, M. El Ouardani, R. Keita, S. Poissy

LDPC Codes

Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

Parameters
Fq is the nite eld with q elements In our case: q = 2 (binary code) Length n Vector space Fn with dimension n q Linear subspace C with dimension k of the vector space Fn q Weight of a code: number of its elements that are nonzero Distance d of a code: minimum weight of any nonzero word of the code

B. Delporte, M. El Ouardani, R. Keita, S. Poissy

LDPC Codes

Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

Parameters
Fq is the nite eld with q elements In our case: q = 2 (binary code) Length n Vector space Fn with dimension n q Linear subspace C with dimension k of the vector space Fn q Weight of a code: number of its elements that are nonzero Distance d of a code: minimum weight of any nonzero word of the code [n, k, d] code Code rate: R =
k n

B. Delporte, M. El Ouardani, R. Keita, S. Poissy

LDPC Codes

Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

Generator Matrix

Used for encoding

B. Delporte, M. El Ouardani, R. Keita, S. Poissy

LDPC Codes

Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

Generator Matrix

Used for encoding Encoding function : Fk Fn q q

B. Delporte, M. El Ouardani, R. Keita, S. Poissy

LDPC Codes

Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

Generator Matrix

Used for encoding Encoding function : Fk Fn q q G generator matrix k n C Fn q x Fk , x.G = (x) C q C = Im {}

B. Delporte, M. El Ouardani, R. Keita, S. Poissy

LDPC Codes

Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

Parity-Check Matrix

Used for error detection

B. Delporte, M. El Ouardani, R. Keita, S. Poissy

LDPC Codes

Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

Parity-Check Matrix

Used for error detection

nk Control function h : Fn Fq q

B. Delporte, M. El Ouardani, R. Keita, S. Poissy

LDPC Codes

Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

Parity-Check Matrix

Used for error detection

nk Control function h : Fn Fq q

H parity-check matrix (n k) n y = (x) y .H T = 0 x C C = Ker {h}

B. Delporte, M. El Ouardani, R. Keita, S. Poissy

LDPC Codes

Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

Parity-Check Matrix

Used for error detection

nk Control function h : Fn Fq q

H parity-check matrix (n k) n y = (x) y .H T = 0 x C C = Ker {h} G and H must satisfy the equation G .H T = Id

B. Delporte, M. El Ouardani, R. Keita, S. Poissy

LDPC Codes

Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

Venn Diagrams
Fk q 1 0 h h Fnk q C C Fn q

B. Delporte, M. El Ouardani, R. Keita, S. Poissy

LDPC Codes

Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

Syndromes And Error Correction

Received word r

B. Delporte, M. El Ouardani, R. Keita, S. Poissy

LDPC Codes

Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

Syndromes And Error Correction

Received word r r .H T is the syndrome of r Coset of the code C : set of all received words with the same syndrome

B. Delporte, M. El Ouardani, R. Keita, S. Poissy

LDPC Codes

Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

Syndromes And Error Correction

Received word r r .H T is the syndrome of r Coset of the code C : set of all received words with the same syndrome The cosets are in a one-to-one correspondence with the syndromes A correspondence table is used

B. Delporte, M. El Ouardani, R. Keita, S. Poissy

LDPC Codes

Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

Syndromes And Error Correction

Received word r r .H T is the syndrome of r Coset of the code C : set of all received words with the same syndrome The cosets are in a one-to-one correspondence with the syndromes A correspondence table is used The correction can be deduced from the syndrome

B. Delporte, M. El Ouardani, R. Keita, S. Poissy

LDPC Codes

Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

Decoding

Once the word is corrected, it can be decoded

B. Delporte, M. El Ouardani, R. Keita, S. Poissy

LDPC Codes

Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

Decoding

Once the word is corrected, it can be decoded 1 : Fn Fk q q x = 1 (y )

B. Delporte, M. El Ouardani, R. Keita, S. Poissy

LDPC Codes

Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

Decoding

Once the word is corrected, it can be decoded 1 : Fn Fk q q x = 1 (y ) Capacity of detection t Expression of t ??????

B. Delporte, M. El Ouardani, R. Keita, S. Poissy

LDPC Codes

Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

Systematic Codes

Data is embedded in the encoded word G = [Id|P] H = P T |Id

B. Delporte, M. El Ouardani, R. Keita, S. Poissy

LDPC Codes

Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

Plan

Transmission Channel Basics And Error-Correcting Codes

Linear Codes

LDPC Codes

B. Delporte, M. El Ouardani, R. Keita, S. Poissy

LDPC Codes

Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

LDPC Codes

LDPC = Low Density Parity-Check Developed by Robert G. Gallager in his doctoral dissertation at MIT in 1960 2 representations:
Parity-check matrix H Tanner graph (bipartite graph)

B. Delporte, M. El Ouardani, R. Keita, S. Poissy

LDPC Codes

Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

LDPC Codes

LDPC = Low Density Parity-Check Developed by Robert G. Gallager in his doctoral dissertation at MIT in 1960 2 representations:
Parity-check matrix H Tanner graph (bipartite graph)

f0..3 : c-nodes (check nodes) c0..7 : v-nodes (value nodes)

B. Delporte, M. El Ouardani, R. Keita, S. Poissy

LDPC Codes

Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

Representations
0 1 H= 0 1
c0 c1 c2

1 1 0 0

0 1 1 0
c3

1 0 0 1

1 0 0 1
c4

0 1 1 0

0 0 1 1
c5

1 0 1 0
c6 c7

f0

f1

f2
LDPC Codes

f3

B. Delporte, M. El Ouardani, R. Keita, S. Poissy

Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

Decoding

Hard-decision decoding

B. Delporte, M. El Ouardani, R. Keita, S. Poissy

LDPC Codes

Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

Decoding

Hard-decision decoding Soft-decision decoding

Belief propagation algorithm Message passing algorithm Sum-product algorithm

B. Delporte, M. El Ouardani, R. Keita, S. Poissy

LDPC Codes

Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

Hard-Decision Decoding: an Example

Hypothesis: BSC channel (Binary Symmetric Channel)

1p p p 1p
B. Delporte, M. El Ouardani, R. Keita, S. Poissy LDPC Codes

Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

Hard-Decision Decoding: an Example (cont.)

1 c0 1 c1 0 c2 1 c3 0 c4 1 c5 0 c6 1 c7

f0

f1

f2
LDPC Codes

f3

B. Delporte, M. El Ouardani, R. Keita, S. Poissy

Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

Hard-Decision Decoding: an Example (cont.)

1 c0 1 c1 0 c2 1 c3 0 c4 1 c5 0 c6 1 c7

f0

f1 1

f2

f3 1

B. Delporte, M. El Ouardani, R. Keita, S. Poissy

LDPC Codes

Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

Hard-Decision Decoding: an Example (cont.)

1 c0 1 c1 0 c2 1 c3 0 c4 1 c5 0 c6 1 c7

f0

f1 11

f2

f3 1

B. Delporte, M. El Ouardani, R. Keita, S. Poissy

LDPC Codes

Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

Hard-Decision Decoding: an Example (cont.)

1 c0 1 c1 0 c2 1 c3 0 c4 1 c5 0 c6 1 c7

f0

f1 110

f2 0
LDPC Codes

f3 1

B. Delporte, M. El Ouardani, R. Keita, S. Poissy

Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

Hard-Decision Decoding: an Example (cont.)

1 c0 1 c1 0 c2 1 c3 0 c4 1 c5 0 c6 1 c7

f0 11

f1 110

f2 0
LDPC Codes

f3 11

B. Delporte, M. El Ouardani, R. Keita, S. Poissy

Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

Hard-Decision Decoding: an Example (cont.)

1 c0 1 c1 0 c2 1 c3 0 c4 1 c5 0 c6 1 c7

f0 110

f1 110

f2 0
LDPC Codes

f3 110

B. Delporte, M. El Ouardani, R. Keita, S. Poissy

Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

Hard-Decision Decoding: an Example (cont.)

1 c0 1 c1 0 c2 1 c3 0 c4 1 c5 0 c6 1 c7

f0 110

f1 1101

f2 01
LDPC Codes

f3 110

B. Delporte, M. El Ouardani, R. Keita, S. Poissy

Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

Hard-Decision Decoding: an Example (cont.)

1 c0 1 c1 0 c2 1 c3 0 c4 1 c5 0 c6 1 c7

f0 110

f1 1101

f2 010
LDPC Codes

f3 1100

B. Delporte, M. El Ouardani, R. Keita, S. Poissy

Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

Hard-Decision Decoding: an Example (cont.)

1 c0 1 c1 0 c2 1 c3 0 c4 1 c5 0 c6 1 c7

f0 1101

f1 1101

f2 0101
LDPC Codes

f3 1100

B. Delporte, M. El Ouardani, R. Keita, S. Poissy

Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

Hard-Decision Decoding: an Example (cont.)

1 c0 1 c1 0 c2 1 c3 0 c4 1 c5 0 c6 1 c7

f0 1101 1

f1 1101 1

f2 0101 0
LDPC Codes

f3 1100 0

B. Delporte, M. El Ouardani, R. Keita, S. Poissy

Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

Hard-Decision Decoding: an Example (cont.)

1 c0 1 c1 0 c2 1 c3 0 c4 1 c5 0 c6 1 c7

f0 1

f1 1

f2 0
LDPC Codes

f3 0

B. Delporte, M. El Ouardani, R. Keita, S. Poissy

Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

Hard-Decision Decoding: an Example (cont.)

1 c0 11 c1 0 c2 11 c3 01 c4 1 c5 0 c6 11 c7

f0 1

f1 1

f2 0
LDPC Codes

f3 0

B. Delporte, M. El Ouardani, R. Keita, S. Poissy

Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

Hard-Decision Decoding: an Example (cont.)

11 c0 111 c1 01 c2 11 c3 01 c4 11 c5 0 c6 11 c7

f0 1

f1 1

f2 0
LDPC Codes

f3 0

B. Delporte, M. El Ouardani, R. Keita, S. Poissy

Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

Hard-Decision Decoding: an Example (cont.)

11 c0 111 c1 010 c2 11 c3 01 c4 110 00 c5 c6 110 c7

f0 1

f1 1

f2 0
LDPC Codes

f3 0

B. Delporte, M. El Ouardani, R. Keita, S. Poissy

Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

Hard-Decision Decoding: an Example (cont.)

110 c0 111 c1 010 c2 110 c3 010 110 000 110 c4 c5 c6 c7

f0 1

f1 1

f2 0
LDPC Codes

f3 0

B. Delporte, M. El Ouardani, R. Keita, S. Poissy

Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

Hard-Decision Decoding: an Example (cont.)

1 110 c0 1 111 c1 0 010 c2 1 110 c3 0 0 1 1 010 110 000 110 c4 c5 c6 c7

f0

f1

f2
LDPC Codes

f3

B. Delporte, M. El Ouardani, R. Keita, S. Poissy

Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

Low Density

Sparse parity-check matrices are used The cost is reduced The performance is better

B. Delporte, M. El Ouardani, R. Keita, S. Poissy

LDPC Codes

Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

Short Cycles
There can be short cycles
c0 c1 c2 c3 c4 c5 c6 c7

f0

f1

f2

f3

They are bad for decoding performance

B. Delporte, M. El Ouardani, R. Keita, S. Poissy

LDPC Codes

Introduction Transmission Channel Basics And Error-Correcting Codes Linear Codes LDPC Codes Conclusion

Conclusion

LDPC codes are linear block codes The sparse matrix reduces the cost and increases the performance LDPC codes closely approach the channel capacity LDPC codes are competing with turbo codes, since they provide similar performance

B. Delporte, M. El Ouardani, R. Keita, S. Poissy

LDPC Codes