Scribd
Upload
74 views8 pages

T&S Book

This document provides an introduction to linear functions, norms, matrices, and related concepts. It defines linear functions and describes how they satisfy the property of superposition. It introduces the Euclidean norm as a measure of the magnitude of a vector, and discusses how norms can be used to define distances. Finally, it defines what a matrix is, how they are represented and indexed, and some basic matrix operations.

Uploaded by

Fun Time
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
74 views8 pages

T&S Book

This document provides an introduction to linear functions, norms, matrices, and related concepts. It defines linear functions and describes how they satisfy the property of superposition. It introduces the Euclidean norm as a measure of the magnitude of a vector, and discusses how norms can be used to define distances. Finally, it defines what a matrix is, how they are represented and indexed, and some basic matrix operations.

Uploaded by

Fun Time
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 8

LINEAR FUNCTIONS

Trebin Mathew
Sathyajith M
Contents

1 Linear functions 3

2 Norm and distance 5


2.1 Norm . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5

3 Matrices 7
3.1 Matrices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7

2
Chapter 1

Linear functions

In this chapter we introduce linear and affine functions, and describe some com-
mon settings where they arise, including regression models.

Function notation. The notation f : Rn → R means that f is a function


that maps real n-vectors to real numbers, i.e., it is a scalar-valued function of
n-vectors. If x is an n-vector, then f (x), which is a scalar, denotes the value of
the function f at x. (In the notation f (x), x is referred to as the argument of
the function.) We can also interpret f as a function of n scalar arguments, the
entries of the vector argument, in which case we write f (x) as

f (x) = f (x1 , x2 , . . . , xn )

Here we refer to x1 , ..., xn as the arguments of f . We sometimes say that f is


real-valued, or scalar-valued, to emphasize that f (x) is a real number or scalar.
To describe a function f : Rn → R, we have to specify what its value
is for any possible argument x∈Rn . For example, we can define a function
f : R4 → R by
f (x) = x1 + x2 − x24
for any 4-vector x.In words,we might describe f as the sum of the first two
elements of its argument,minus the square of the last entry of the argument.(This
particular function does not depend on the third element of its argument.)
Sometimes we introduce a function without formally assigning a symbol
for it,by directly giving a formula for its value in terms of its arguments,or
describing how to find its value from its arguments.An example is the sum
function,whose value is x1 + · · · + xn .We can give a name to the value of the
function,as iny = x1 + · · · + xn ,and say that y is a function of x,in this case,the
sum of its entries.
Many functions are not given by formulas or equations.As an example,supposef :
R3 → R is the function that gives the lift(Vertical upward force) on a particular
airplane,as a function of the 3-vector x where x1 is the angle of attack of the
airplane(i.e,the angle between the airplane body and its direction of motion),x2

3
4 CHAPTER 1. LINEAR FUNCTIONS

is its air speed,and x3 is the air density.


The inner product function. Suppose a is an n-vector.We can define a
scalar-valued function f of n-vectors,given by

f (x) = aT x = a1 x1 + a2 x2 + · · · + an xn (2.1)

for any n-vector x.This function gives the inner product of its n -vector argument
x with some (fixed) n vector a.We can also think of f as forming a weighted
sum of the elements of x;the elements of a give the weights used in forming the
weighted sum.
Superposition and linearity. The inner product function f defined in (2.1)
satifies the property .

f (αx + βy) = aT (αx + βy))


= aT (αx) + aT (βy)
= α(aT x) + β(aT y)
= αf (x) + βf (y)

for all n-vectors x, y, and all scalars α, β. This property is called superposition.A
function that satisfies the superposition property is called linear.We have just
shown that the inner product with a fixed vector is a linear function.
The superposition equality

f (αx + βy) = αf (x) + βf (y)

look deceptively simple; it is easy to read it as just a re-arrangement of the


parentheses and the order of a few terms. But in fact it says a lot. On the
the left-hand side, the term αx + βy involves scalar-vector multiplication and
vector addition. On the the right-hand side,αf (x) + βf (y) involves ordinary
scalar multiplication and scalar addition.
If a function f is linear, superposition extends to linear combinations of any
number of vectors, and not just linear combinations of two vectors: We have

f (α1 x1 , . . . , α1 xk ) = α1 f (x1 ) + · · · + αn f (xk )

for any n vectors x1 , . . . , xk and scalarsα1 , . . . , αk . (This more general k-terms


form of superposition reduces to the two-term form given above when k=2.) To
see this, we note that

f (α1 x1 + · · · + αk xk ) = α1 f (x1 ) + f (α2 x2 + · · · + αk xk )


= α1 f (x1 ) + α2 f (x2 ) + f (α3 x3 + · · · + αk xk )
..
.
= α1 f (x1 ) + · · · + αk f (xk ).
Chapter 2

Norm and distance

In this chapter we focus on the norm of a vector ,a measure of its magnitude,and


on related concepts like distance,angle,standard deviation,and correlation.

2.1 Norm
The Euclidean norm of an n- vector x (named after the Greek mathematician
Euclid) denoted by ||x||,is the squareroot of the sum of the squares of the ele-
ments,
q
||x|| = x21 + x22 + · · · + x2n

The Euclidean norm can also be expressed


√ as the squareroot of the inner product
of the vector with itself i.e, ||x|| = xT x.
The Euclidean norm is sometimes written with the subscript 2,as ||x||2 .(The
subscript 2 indicates that the entries of x are raised to the second power.)Other
less widely used terms for the Euclidean norm of a vector are the magnitude,or
length,of a vector.(The term length should be avoided,since it is also often used
to refer to dimension of vector.)We use the same notation for the norms of
vectors of different dimensions.
As simple examples,we have
 
2 √
 
−1 = 9 = 3, 0
=1
−1
2
When x is a scalar, i.e., a 1-vector, the Euclidean norm is the same as the abso-
lute value of x. Indeed, the Euclidean norm can be considered a generalization
or extension of the absolute value or magnitude, that applies to vectors. The
double bar notation is meant to suggest this. Like the absolute value of a num-
ber, the norm of a vector is a (numerical) measure of its magnitude. We say a
vector is small if its norm is a small number, and we say it is large if its norm

5
6 CHAPTER 2. NORM AND DISTANCE

is a large number. (The numerical values of the norm that qualify for small or
large depend on the particular application and context.)
Chapter 3

Matrices

In this chapter we introduce matrices and some basic operations on them. We


give some applications in which they arise.

3.1 Matrices
A matrix is a rectangular array of numbers written between rectangular brack-
ets,as in
 
0 1 2.3 −0.1
1.3 4 −0.1 0 
4.1 −1 0.4 1.7
It is also common to use large parentheses instead of rectangular brackets, as in
 
0 1 2.3 −0.1
 1.3 4 −0.1 0 
4.1 −1 0.4 1.7
An important attribute of a matrix is its size or dimensions, i.e, the numbers
of rows and columns. The matrix above has 3 rows and 4 columns, so its size is
3 × 4.A matrix of size m × n is called an m × nmatrix.
The elements (or entries or coefficients) of a matrix are the values in the
array. The i, j element is the value in the ith row and jth column, denoted
by double subscripts: the i, j element of a matrix A is denoted Aij (or Ai,j ,
when i or j is more than one digit or character). The positive integers i and
j are called the (row and column) indices. If A is an m × n matrix, then the
row index i runs from 1 to m and the column index j runs from 1 to n. Row
indices go from top to bottom, so row 1 is the top row and row m is the bottom
row. Column indices go from left to right , so column 1 is the left column and
column n is the right column.
If the matrix above is B, then we have B13 = -2.3, B32 = -1. The row index
of the bottom left element (which has value 4.1) is 3; its column index is 1.

7
8 CHAPTER 3. MATRICES

Two matrices are equal if they have the same size, and the corresponding
entries are all equal. As with vectors, we normally deal with matrices with
entries that

You might also like

pFad - Phonifier reborn

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.


Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy