Mathematics For Electrical Engineers (EE 143) : Eigenvalues and Eigenvectors
Mathematics For Electrical Engineers (EE 143) : Eigenvalues and Eigenvectors
Krishnan C.M.C
Assistant Professor, E&E,
NITK Surathkal
Contents
Diagonalization
Complex Eigenvalues
Diagonalization
Complex Eigenvalues
Ex-1 1 6 6 3
Let 𝐴 = ,𝑥 = ,𝑦 = Check if the two given vectors are
5 2 −5 −2
eigenvectors of the matrix
−24 6
𝐴𝑥 = = −4 = −4𝑥 Eigenvector or 𝐴
20 −5
−9 3
𝐴𝑦 = ≠𝜆 Not an eigenvector or 𝐴
11 −2
−6 6 0 1 −1 0 1
⇒ ~ ⇒ 𝑥 = 𝑥2
5 −5 0 0 0 0 1
𝑑2
1
1
𝑑1
Ex-3 4 −1 6
Let 𝐴 = 2 1 6 and one of the eigenvalues is 2. Find a basis for the
2 −1 8
corresponding eigenspace
4−2 −1 6 0
Nul 𝐴 − 2𝐼3 ⇒ solve 2 1−2 6 ⋮ 0
2 −1 8 − 2 0
2 −1 6 0 2 −1 6 0 0.5 −3
2 −1 6 ⋮ 0 ~ 0 0 0 ⋮ 0 ⇒ 𝑥 = 1 𝑥2 + 0 𝑥3
2 −1 6 0 0 0 0 0 0 1
Proof In the indexed set, let 𝑣𝑝+1 be a linear combination of the preceding linearly
independent vectors (with 𝑝 < 𝑟 ).
𝑣𝑝+1 = 𝑐1 𝑣1 + 𝑐2 𝑣2 + ⋯ + 𝑐𝑝 𝑣𝑝 → (𝟏)
Multiply (𝟏) by the matrix 𝐴 ⇒ 𝜆𝑝+1 𝑣𝑝+1 = 𝑐1 𝜆1 𝑣1 + 𝑐2 𝜆2 𝑣2 + ⋯ + 𝑐𝑝 𝜆𝑝 𝑣𝑝 → (𝟐)
𝟐 − 𝝀𝒑+𝟏 (𝟏) ⇒
0 = 𝑐1 𝜆1 − 𝜆𝑝+1 𝑣1 + 𝑐2 𝜆2 − 𝜆𝑝+1 𝑣2 + ⋯ + 𝑐𝑝 𝜆𝑝 − 𝜆𝑝+1 𝑣𝑝 → (𝟑)
Diagonalization
Complex Eigenvalues
𝜆 = 0.92
0.6 3 1
Step 3: Represent 𝑥0 = as a linear combination of 𝑣1 = &𝑣2 =
0.4 5 −1
2
Note: it will be always possible since 𝑣1 , 𝑣2 span ℝ Why?
𝑐1 𝑐1 −1
𝑐1 𝑣1 + 𝑐2 𝑣2 = 𝑥0 ⇒ [𝑣1 𝑣2 ] 𝑐 = 𝑥0 ⇒ 𝑐 = 𝑣1 𝑣2 −1 𝑥0 = 3 1 0.6
2 2 5 −1 0.4
𝑐1 0.125
⇒ 𝑐 =
2 0.225
EE143 Dept. of E & E, NITK Surathkal
12
Characteristic Equation
0.95 0.03
Ex-5 Application to a dynamical system: Let 𝐴 = . Analyze the long-
0.05 0.97
Contnd… term behavior of a system is described by an iterative equation, 𝑥
𝑘+1 =
0.6
𝐴𝑥𝑘 (𝑘 = 0,1,2, … ) with 𝑥0 =
0.4
0.6 3 1
Step 3: Represent 𝑥0 = as a linear combination of 𝑣1 = &𝑣2 =
0.4 5 −1
2
Note: it will be always possible since 𝑣1 , 𝑣2 span ℝ
𝑐1 𝑐1 −1
𝑐1 𝑣1 + 𝑐2 𝑣2 = 𝑥0 ⇒ [𝑣1 𝑣2 ] 𝑐 = 𝑥0 ⇒ 𝑐 = 𝑣1 𝑣2 −1 𝑥0 = 3 1 0.6
2 2 5 −1 0.4
𝑐1 0.125
⇒ 𝑐 =
2 0.225
Step 4: Finding a general formula for 𝑥𝑘
We have 𝑥1 = 𝐴𝑥0 = 𝐴 𝑐1 𝑣1 + 𝑐2 𝑣2 = 𝑐1 𝐴𝑣1 + 𝑐2 𝐴𝑣2 = 𝑐1 𝜆1 𝑣1 + 𝑐2 𝜆2 𝑣2
Theorem If two 𝑛 × 𝑛 matrices 𝐴 & 𝐵 are similar, then they have the same
characteristic polynomial and hence the same eigenvalues.
= det 𝐴 − 𝜆𝐼
3 1 1
0 5 0 5, 6.41, 3.58
−2 0 7
5,5,2,3 3,1,3,1,0
Ex-10 If 𝐴2 is the zero matrix, then show that the eigenvalues of 𝐴 are all zeros.
0 2 3 3 0 2 3 3
𝐴 − 4𝐼 = 0 −2 ℎ 3 ~ 0 0 ℎ + 3 6
0 0 0 14 0 0 0 14
0 0 0 −2 0 0 0 −2
Diagonalization
Complex Eigenvalues
𝑘 2 × 5𝑘 − 3𝑘 5𝑘 − 3𝑘
𝐴 =
2 × 3𝑘 − 5𝑘 2 × 3𝑘 − 5𝑘
1 3 3
Ex-13 Diagonalize the following matrix 𝐴 = −3 −5 −3 if possible.
3 3 1
1 −1 0
𝜆1 = 3 , 𝐵1 = −1 𝜆2 = 2 , 𝐵2 = 1 𝜆3 = 3 , 𝐵3 = −1
0 −1 1
1 0 −1
𝜆1,3 = 3 , 𝐵1,3 = −1 , −1 𝜆2 = 2 , 𝐵2 = 1
0 1 −1
Ex-17 Show that if a matrix is invertible and diagonalizable, so will be its inverse
𝛼 𝛽
𝐴= with 𝛼 and 𝛽 two non-zero scalars
0 0
Diagonalization
Complex Eigenvalues
Eigenvectors:
𝜆=𝑖
Check: 𝐴𝑣1 = 0 −1 𝑖
−𝑖 −1 0 −𝑖 −1 0 𝑖 1 0 1
⋮ ~ ⋮ ⇒ 𝑣1 = 𝑐 −1 𝑖
1 −𝑖 0 0 0 0 1 =
𝑖 =𝑖 1
⇒ 𝑐 is in ℂ
𝜆 = −𝑖
𝑖 −1 0 𝑖 −1 0 −𝑖
⋮ ~ ⋮ ⇒ 𝑣2 = 𝑐
1 𝑖 0 0 0 0 1 Also 𝑣1 &𝑣2 are in ℂ2
Also notice, 𝜆1 = 𝜆∗2 And𝑣1 = 𝑣2 ∗
i.e., eigenvalues and the corresponding eigenvectors come in complex conjugate pairs
∗
IMP: . represents a conjugation operation (different from Lay et.al. notations)
i.e., eigenvalues and the corresponding eigenvectors come in complex conjugate pairs
𝐴 𝑣1 ∗ = 𝜆1 ∗ 𝑣1 ∗
∗ ∗
Thus 𝜆1 is an eigenvalue and the corresponding eigenvector is 𝑣1
Simillarly for: −2 + 4𝑖
𝜆2 = 0.8 + 0.6𝑖 ⇒ 𝑣2 = 𝑐
5 Taken from Lay
Lets now see how 𝐴 acts on some 𝑥 in ℝ2 et.al. and
reproduced here
2
Let 𝑥0 =
0
1.0
Then 𝑥1 = 𝐴𝑥0 =
1.5
−0.4
𝑥2 = 𝐴𝑥1 =
2.4
⋮
• Matrix with complex eigenvalues will results in rotations
• How to quantify them? Lets take a simple example in ℝ2
EE143 Dept. of E & E, NITK Surathkal
29
Complex Eigenvalues
Ex-22 𝑎 −𝑏
Let 𝐶 = . Find the eigenvalues.
𝑏 𝑎
Ch. roots:𝜆 = 𝑎 ± 𝑏𝑖 if:𝑟 = 𝜆 = 𝑎2 + 𝑏2
𝑟
𝑏
𝑟 0 cos 𝜑 − sin 𝜑
Then :𝐶 =
0 𝑟 sin 𝜑 cos 𝜑 𝜑 𝑎
scaling rotation
0.8 −0.6 𝑎 −𝑏
𝑃−1 𝐴𝑃 = Compare with 𝐶 =
0.6 0.8 𝑏 𝑎
0.8 −0.6 𝑎 −𝑏
𝑃−1 𝐴𝑃 = Compare with 𝐶 =
0.6 0.8 𝑏 𝑎
−2 −4 0.8 −0.6 1 0 4
𝐴 = 𝑃𝐶𝑃−1 =
5 0 0.6 0.8 20 −5 −2
Any 𝑥 in ℝ2
Change of Rotation Change of
coordinate by36.86° coordinate
back to 𝑥 = 𝑢 = 𝑃−1 𝑥
𝑃𝑢