Topic 1
Topic 1
References:
Properties of DFT
Applications of DFT
Linear Convolution
Filtering of long data sequences
Frequency domain filtering
Spectral Analysis using DFT
V. Praksh Singh, PhD
Department of Electronics & Comunication Engineering National Institute of Technology Andhra Pradesh Tadepalligudem, Andhra Pradesh India
Digital Signal Processing
Discrete-Time Fourier Transform Discrete-Time Fourier Series Discrete Fourier Transform Circular Shifting and Circular Convolution Properties of DFT
Outline
5 Properties of DFT
6 Applications of DFT
Convergence Condition
Uniform Convergence
Mean-Square Convergence
Some sequences may not be absolutely summable but may be square
summable i.e. sequences with finite energy
∞
X
|x[n]|2 < ∞
n=−∞
However, for mean square convergence, the total energy of the error
E (ω) must approach zero as the N goes to ∞.
Z π
LimN→∞ |XN (e jω ) − X (e jω )|2 dω = 0
π
jω
However, X (e ) is no longer guaranteed to be bounded for such
sequences.
V. Praksh Singh, PhD
Department of Electronics & Comunication Engineering National Institute of Technology Andhra Pradesh Tadepalligudem, Andhra Pradesh India
Digital Signal Processing
Discrete-Time Fourier Transform Discrete-Time Fourier Series Discrete Fourier Transform Circular Shifting and Circular Convolution Properties of DFT
The DTFT can also be defined for a certain class of signals which
are neither absolutely summable nor square summable.
∞
X
δ[n] ←→ 2πδ(ω + 2πk)
k=−∞
∞
1 X
u[n] ←→ + πδ(ω + 2πk)
1 − e −jω
k=−∞
∞
X
e jω0 n ←→ 2πδ(ω − ω0 + 2πk)
k=−∞
1
an u[n], (|a| < 1) ←→
1 − ae −jω
1
(n + 1)an u[n], (|a| < 1) ←→
(1 − ae −jω )2
Properties of DTFT
x[n] ←→ X (e jω )
y [n] ←→ Y (e jω )
αx[n] + βy [n] ←→ αX (e jω ) + βY (e jω )
Time Reversal :
x[−n] ←→ X (e −jω )
Properties of DTFT
x[n − n0 ] ←→ e jωn0 X (e jω )
Frequency shifting
dX (e jω )
nx[n] ←→ j
dω
V. Praksh Singh, PhD
Department of Electronics & Comunication Engineering National Institute of Technology Andhra Pradesh Tadepalligudem, Andhra Pradesh India
Digital Signal Processing
Discrete-Time Fourier Transform Discrete-Time Fourier Series Discrete Fourier Transform Circular Shifting and Circular Convolution Properties of DFT
Properties of DTFT
Convolution DTFT of the convolution sum of two sequences is given
by the product of their DTFTs.
x[n] ∗ y [n] ←→ X (e jω )Y (e jω )
Modulation DTFT of the product of two sequences is given by the
convolution integral of their DTFTs.
Z π
1
x[n]y [n] ←→ X (e jθ )Y (e j(ω−θ) )dθ
2π −π
Parseval’s Theorem DTFT of the sum of the sample-by-sample
product of two sequences is given by an integral of the product of
their DTFTs.
∞ Z π
X 1
x[n]y ∗ [n] ←→ X (e jω )Y ∗ (e jω )dω
n=−∞
2π −π
The quantity
Sxx (e jω ) = |X (e jω )|2
is called the Energy density spectrum of the sequence. The energy
of the sequence can be obtained by integrating the area under the
curve in the range −π ≤ ω ≤ π.
Example The energy of a causal exponential sequence
x[n] = an u[n] |a| < 1 can be computed as
∞ Z π 2
X
2 1 1
Ex = |x[n]| =
jω
dω
n=−∞
2π −π
1 − ae
Outline
5 Properties of DFT
6 Applications of DFT
2π
where we use the notation WN = e j N
X̃ [k] are called the DTFS coefficients of the sequence x̃[n]. X̃ [k]
can be determined as
N−1 N−1
2π
X X
X̃ [k] = x̃[n]e −j N kn = x̃[n]WNkn
n=0 n=0
The proof of the above equation is quite straight forward using the
orthogonality of the set of complex exponential sequences.
N−1
(
1 X ∗ 1 k − r = mN for integer m
ek [n]er [n] =
N n=0 0 otherwise
2π
where WN = e j N
Properties of DTFS
x̃[n] ←→ X̃ [k]
ỹ [n] ←→ Ỹ [k]
Duality
X̃ [n] ←→ N x̃[−k]
Properties of DTFS
Frequency shifting
WN−nl x̃[n] ←→ X̃ [k − l]
Properties of DTFS
x̃ ∗ [n] ←→ X̃ ∗ [−k]
x̃ ∗ [−n] ←→ X̃ ∗ [k]
1
x̃real [n] ←→ X̃cs [k] = X̃ [k] + X̃ ∗ [−k]
2
1
j x̃imag [n] ←→ X̃ca [k] = X̃ [k] − X̃ ∗ [−k]
2
1 ∗
x̃cs [n] = x̃[n] + x̃ [−n] ←→ X̃real [k]
2
1 ∗
x̃ca [n] = x̃[n] − x̃ [−n] ←→ j X̃imag [k]
2
V. Praksh Singh, PhD
Department of Electronics & Comunication Engineering National Institute of Technology Andhra Pradesh Tadepalligudem, Andhra Pradesh India
Digital Signal Processing
Discrete-Time Fourier Transform Discrete-Time Fourier Series Discrete Fourier Transform Circular Shifting and Circular Convolution Properties of DFT
2π
which is an impulse train in the frequency domain with spacing N .
Outline
5 Properties of DFT
6 Applications of DFT
X̃ [k] = X (z)| 2π k
z=e j N
sin(πk/2)
X̃ [k] = e −j3πk/8
sin(πk/8)
2π 2π
Let us sample the X (e jω ) over one period of 2π at ∆ω = N = 8
sin(πk/2)
X (e jω )|ωk = 2π
N k
= e −j3πk/8
sin(πk/8)
We can see that the samples of the Fourier transform is same as the
Fourier series coefficients of the periodic extension of the signal.
X̃ [k] = X [k modulo N]
= X [((k))N ] Notation
V. Praksh Singh, PhD
Department of Electronics & Comunication Engineering National Institute of Technology Andhra Pradesh Tadepalligudem, Andhra Pradesh India
Digital Signal Processing
Discrete-Time Fourier Transform Discrete-Time Fourier Series Discrete Fourier Transform Circular Shifting and Circular Convolution Properties of DFT
The sequence x[n] can be recovered from X [k] using N-point IDFT
(Synthesis equation)
N−1 N−1
1 X 1 X
x[n] = x[n]e j2πkn/N = x[n]WN−kn k = 9, 1, . . . , N − 1
N N n=0
k=0
DFT Example
Example Consider x[n] = [1 1 1 1 1] is a length N = 5 sequence.
N−1
X
X [k] = x[n]e −j2πkn/N k = 0, 1, . . . , N − 1
n=0
4
X 1 − e −j2πk
= e −j2πkn/4 =
n=0
1 − e −j2πk/5
= 5 for k = 0 and 0 for k = 1, 2, 3, 4
We can show that the DFT coefficients are equal to the one period
of DTFS coefficients of the periodic extension of x[n].
We can also show that the DFT coefficients are equal to the N = 5
equally spaced samples of the DTFT over one period at
ωk = 2π5 k for k = 0, 1, . . . , 4
V. Praksh Singh, PhD
Department of Electronics & Comunication Engineering National Institute of Technology Andhra Pradesh Tadepalligudem, Andhra Pradesh India
Digital Signal Processing
Discrete-Time Fourier Transform Discrete-Time Fourier Series Discrete Fourier Transform Circular Shifting and Circular Convolution Properties of DFT
XN = WN xN
−1 1 ∗
xN = WN XN = W XN
N N
The N × N DFT matrix WN is a unitary (orthogonal) matrix i.e.
∗
WN WN = NIN
V. Praksh Singh, PhD
Department of Electronics & Comunication Engineering National Institute of Technology Andhra Pradesh Tadepalligudem, Andhra Pradesh India
Digital Signal Processing
Discrete-Time Fourier Transform Discrete-Time Fourier Series Discrete Fourier Transform Circular Shifting and Circular Convolution Properties of DFT
1 1 1 ··· 1
1 WN1 WN2 ··· WNN−1
WN = .. .. ..
. . ··· .
2(N−1) (N−1)(N−1)
1 WNN−1 WN ··· WN
Outline
5 Properties of DFT
6 Applications of DFT
Now, what is the relation between x[n] and x1 [n]? x1 [n] does not
correspond to the linear shift of x[n] as both the sequence are
confined in the interval 0 ≤ n ≤ N − 1.
Circular Convolution
Consider the two N-point sequences x1 [n] and x2 [n]. The circular
convolution of the sequences is given as
N−1
X
x3 [n] = x1 [n] ⊛ x2 [n] = x1 [m]x2 [((n − m))N ] 0≤n ≤N −1
N
m=0
x1 [n] = [2 1 2 1]
x2 [n] = [1 2 3 4]
The algorithm for computing circular convolution yCC [n] for each
n, (0 ≤ n ≤ N − 1) is as follows
S1: Circular time reverse the sequence x2 [m]
S2: Circularly shift the time reversed sequence (clock wise) by n
S3: Multiply the sequence x1 [m] and the sequence in S2 to obtain a
product sequence
S4: Summing the values of the product sequence
x2 [(−(m − 1)4 )] = [2 1 4 3]
P3
yCC [1] = m=0 x1 [m]x2 [(−(m − 1))4 ] = 16
x2 [(−(m − 2)4 )] = [3 2 1 4]
P3
yCC [2] = m=0 x1 [m]x2 [(−(m − 2))4 ] = 14
x2 [(−(m − 3)4 )] = [4 3 2 1]
P3
yCC [3] = m=0 x1 [m]x2 [(−(m − 1))4 ] = 16
Outline
5 Properties of DFT
6 Applications of DFT
Properties of DFT
x[n] ←→ X [k]
y [n] ←→ Y [k]
Duality
X [n] ←→ Nx[((−k))N ] 0≤k ≤N −1
Properties of DFT
Properties of DFT
N-point Circular convolution The circular convolution of two
sequences corresponds to product of the corresponding DFTs
N−1
X
x[n] ⊛ y [n] = x[m]y [((n − m))N ] ←→ X [k]Y [k]
N
m=0
Parseval’s Relation
N−1 N−1
X 1 X
|x[n]|2 = |X [k]|2
n=0
N
k=0
V. Praksh Singh, PhD
Department of Electronics & Comunication Engineering National Institute of Technology Andhra Pradesh Tadepalligudem, Andhra Pradesh India
Digital Signal Processing
Discrete-Time Fourier Transform Discrete-Time Fourier Series Discrete Fourier Transform Circular Shifting and Circular Convolution Properties of DFT
x ∗ [n] ←→ X ∗ [((−k))N ] = X ∗ [N − k]
x ∗ [((−n))N ] ←→ X ∗ [k]
1
xreal [n] ←→ Xcs [k] = X [k] + X ∗ [((−k))N ]
2
1
jximag [n] ←→ Xca [k] = X [k] − X ∗ [((−k))N ]
2
1 ∗
xcs [n] = x[n] + x [((−n))N ] ←→ Xreal [k]
2
1 ∗
xca [n] = x[n] − x [((−n))N ] ←→ jXimag [k]
2
V. Praksh Singh, PhD
Department of Electronics & Comunication Engineering National Institute of Technology Andhra Pradesh Tadepalligudem, Andhra Pradesh India
Digital Signal Processing
Discrete-Time Fourier Transform Discrete-Time Fourier Series Discrete Fourier Transform Circular Shifting and Circular Convolution Properties of DFT
Compute the periodic extension of yLC [n] and window the result
between 0 ≤ n ≤ N − 1. This will give us the N-point circular
convolution ∞
X
yCC [n] = yLC [n − rN] 0≤n ≤N −1
r =−∞
V. Praksh Singh, PhD
Department of Electronics & Comunication Engineering National Institute of Technology Andhra Pradesh Tadepalligudem, Andhra Pradesh India
Digital Signal Processing
Discrete-Time Fourier Transform Discrete-Time Fourier Series Discrete Fourier Transform Circular Shifting and Circular Convolution Properties of DFT
Outline
5 Properties of DFT
6 Applications of DFT
Consider x[n] and h[n] be two finite length causal sequences with
length L and M respectively. We wish to find the linear convolution
of these sequences as
yLC [n] = x[n] ∗ h[n]
We saw that yCC [n], can be written as periodic repetition of yLC [n]
followed by windowing between 0 ≤ n ≤ N − 1. We can recover
yLC [n] from yCC [n], when there is no overlapping in periodic
repletion of yLC [n] i.e. N ≥ L + M − 1
Algorithm :
S1: Zero pad (Insert zeros) the sequences x[n] and h[n] to make
their length N where N ≥ L + M − 1. Let us denote new sequences
xe [n] and he [n].
S2: Take N point DFT of xe [n] and he [n] as Xe [k] and He [k]
Overlap-Add Method
Overlap-Save Method
Overlap-Add Method
Key Idea The linear convolution is additive i.e.
Overlap-Add Method
where yi [n] = xi [n] ∗ h[n] is the ith output block of length L+M-1
Overlap-Add Method
Overlap-Add Method
Overlap-Save Method
Key Idea N-point circular convolution of a length N sequence xi [n]
with a length M, (N > M) sequence h[n] will generate ycc,i [n] such
that
(
incorrect for n = 0, 1, . . . , M − 2
yCC ,i [n] =
yLC ,i [n] for n = M − 1, M, . . . , N − 1
Overlap-Save Method
Overlap-Save Method
Overlap-Save Method