Lecture 0 Introduction
Lecture 0 Introduction
3/21/2023 2
2. SPECIFIC LEARNING OBJECTIVES (1)
• Engineering Applications: electrical networks, pipe and traffic flow, data fitting;
• Systems of Linear Equations: solving systems of linear equations by Gaussian
elimination;
• Matrices: matrix operations, inverses, elementary matrices, special types of
matrices;
• Determinants: cofactor expansion, properties, Cramer's rule;
3/21/2023 3
2. SPECIFIC LEARNING OBJECTIVES (2)
• Orthogonality: inner product, orthonormal bases, Gram-Schmidt process, least-
squares approximations, orthonormal matrices;
• Linear transformations: linear mapping between vector spaces, matrix
representation of linear transformations (basic content);
• Eigenvectors: finding eigenvalues and eigenvectors, characteristic polynomial,
properties of eigenvalues and eigenvectors, diagonalization, geometric and
algebraic multiplicity, similarity, orthogonal diagonalization of real symmetric
matrices;
3/21/2023 4
2. SPECIFIC LEARNING OBJECTIVES (3)
ALL LECTURES:
1. Systems of Linear Equations and Matrices
2. Determinants
3. Vector Spaces and Subspaces
4. Inner Product Spaces, Orthogonality and Least Squares
5. Linear Transformations and numerical Methods for Linear Algebra
6. Eigenvalues and Eigenvectors
7. Ordinary differential equations
8. Applications
3/21/2023 5
3. COURSE CONTENTS (1)
LECTURE 1P1: COMPLEX NUMBERS (3 HOURS)
• What is a complex number?
• Basic Operations
• Geometric Interpretation
• Polar form
3/21/2023 6
3. COURSE CONTENTS (2)
LECTURE 1P2: SYSTEMS OF LINEAR EQUATIONS AND MATRICES (3 HOURS)
• Introduction to Systems of Linear Equations
• Gaussian Elimination
• Matrices and Matrix Operations
• Inverses;
• Algebraic Properties of Matrices
• Elementary Matrices and a Method for Finding
• More on Linear Systems and Invertible Matrices
• Diagonal, Triangular, and Symmetric Matrices
• Applications of Linear Systems
• Leontief Input-Output Models
3/21/2023 7
3. COURSE CONTENTS (3)
LECTURE 1P3: MATRICES (3 HOURS)
• Basic definitions: transpose matrices, zero matrices, identity matrices, triangular
matrices, symmetric and skew-symmetric matrices.
• Operations with Matrices: addition, subtraction, scalar and matrix multiplications
• Properties of Matrix Operations
• The Inverse of a Matrix
• Differentiation of Inverse Functions
• Linear Approximations-Differentials
• Elementary Matrices
• Markov Chains
• More Applications of Matrix Operations
3/21/2023 8
3. COURSE CONTENTS (4)
LECTURE 1P4: FURTHER MATRICES (3 HOURS)
• Basic definitions: transpose matrices, zero matrices, identity matrices, triangular
matrices, symmetric and skew-symmetric matrices.
• Operations with Matrices: addition, subtraction, scalar and matrix multiplications
• Properties of Matrix Operations
• The Inverse of a Matrix
• Differentiation of Inverse Functions
• Linear Approximations-Differentials
• Elementary Matrices
• Markov Chains
• More Applications of Matrix Operations
3/21/2023 9
3. COURSE CONTENTS (5)
LECTURE 2: DETERMINANTS (3 HOURS)
• The Determinant of a Matrix
• Evaluation of a Determinant Using Elementary Operations
• Properties of Determinants: Determinants by Cofactor Expansion; Cramer's
Rule; Triangularization of matrices
• Applications of Determinants
3/21/2023 10
3. COURSE CONTENTS (6)
LECTURE 3: VECTOR SPACES AND SUBSPACES (6 HOURS)
• Vectors in Rn
• Spaces and Subspaces
• Four Fundamental Subspaces
• Linear Independence
• Basis and Dimension
• More about Rank of a Matrix and Systems of Linear Equations
• Classical Least Squares
• Linear Transformations
• Change of Basis and Similarity
• Invariant Subspaces
• Applications of Vector Spaces
3/21/2023 11
3. COURSE CONTENTS (7)
LECTURE 4: INNER PRODUCT SPACES, ORTHOGONALITY AND LEAST SQUARES
(6 HOURS)
• Inner Products
• Angle and Orthogonality in Inner Product Spaces
• Gram–Schmidt Process; QR-Decomposition
• Best Approximation; Least Squares
• Mathematical Modeling Using Least Squares
• Function Approximation; Fourier Series
3/21/2023 12
3. COURSE CONTENTS (8)
LECTURE 4: INNER PRODUCT SPACES, ORTHOGONALITY AND LEAST SQUARES
(3 HOURS)
• Orthogonal Vectors and Subspaces
• Cosines and Projections onto Lines
• Projections and Least Squares; Best Approximation;
• Orthogonal Bases and Gram-Schmidt; QR-Decomposition
• Least Squares Fitting to Data
• Function Approximation; Fourier Series
3/21/2023 13
3. COURSE CONTENTS (9)
LECTURE 5P1: LINEAR TRANSFORMATIONS (3 HOURS)
• Introduction to Linear Transformations
• The Kernel and Range of a Linear Transformation
• Compositions and Inverse Transformations
• Matrices for Linear Transformations
• Transition Matrices and Similarity
• Applications of Linear Transformations
3/21/2023 14
3. COURSE CONTENTS (10)
LECTURE 5P2: NUMERICAL METHODS (3 HOURS)
• LU-Decompositions
• The Power Method
• Internet Search Engines
• Comparison of Procedures for Solving Linear Systems
• Singular Value Decomposition
• Data Compression Using Singular Value Decomposition
3/21/2023 15
3. COURSE CONTENTS (11)
LECTURE 6: EIGENVALUES AND EIGENVECTORS (6 HOURS)
• Eigenvalues and Eigenvectors
• Diagonalization
• Diagonalization of a Matrix
• Complex Vector Spaces;
• Complex Matrices
• Symmetric Matrices and Orthogonal Diagonalization
• Similarity Transformations
• Applications of Eigenvalues and Eigenvectors
3/21/2023 16
3. COURSE CONTENTS (12)
LECTURE 7: ORDINARY DIFFERENTIAL EQUATIONS (6 HOURS)
• Differential equations
• Separable equations
• First order linear differential equations
• Numerical methods to solve differential equations
• Second order linear differential equations.
3/21/2023 17
3. COURSE CONTENTS (13)
LECTURE 8: APPLICATIONS OF LINEAR ALGEBRA (EXTRA HOURS)
• Constructing Curves and Surfaces Through Specified Points
• Geometric Linear Programming
• The Earliest Applications of Linear Algebra
• Markov Chains
• Graph Theory
3/21/2023 18
4. Learning Activities
Attendance (10%): Attendance will be checked by doing 20 (or 30)-minute quick tests for
each lecture
Individual Assignments (10%): Homework for each lecture. No late submission.
Final exam (100%): It is a closed-book exam. However, the students are allowed to only use
a A4-sized double-side cheat sheet. The examination time is 90 minutes.
3/21/2023 19
5. Pass Conditions
3/21/2023 20
6. References (Text books)
[1] “Elementary Linear Algebra-Applications Version”, by Howard Anton and Chris Rorres.
[2] “Elementary Linear Algebra”, Ron Larson and David C. Falvo, HOUGHTON MIFFLIN
HARCOURT PUBLISHING COMPANY, 2009.
[3] Gilbert Strang, “Linear algebra and its applications”, Thomson, 2006.
[4] David C. Lay, “Linear algebra and its applications”, Thomson, 2011.
[5] Hill, David Ross, Kolman, Bernard, “Elementary linear algebra with applications,”
Pearson (2013_2014).
3/21/2023 21
3/21/2023 22
THANK YOU VERY MUCH
3/21/2023 23