Scribd
Upload
24 views3 pages

Document 1

ML

Uploaded by

soura30so
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
24 views3 pages

Document 1

ML

Uploaded by

soura30so
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 3

Table of Contents

1. Algebra
Knowledge of algebra is perhaps fundamental to math in general. Besides
mathematical operations like addition, subtraction, multiplication and division, you'll
need to know the following:

 Exponents
 Radicals
 Factorials
 Summations
 Scientific Notations

2. Linear Algebra
Linear Algebra is the primary mathematical computation tool in Artificial Intelligence
and many areas of Science and Engineering. In this, 4 primary mathematical objects
and their properties need to be understood:

 Scalars - a single number (can be real or natural).


 Vectors - a list of numbers, arranged in order. Consider them as points in
space with each element representing the coordinate along an axis.
 Matrices - a 2-D array of numbers where each number is identified by 2
indices.
 Tensors - an N-D array of numbers (N>2), arranged on a regular grid with N-
axes. Important in Machine Learning, Deep Learning and Computer Vision
 Eigenvectors & Eigenvalues - special vectors and their corresponding scalar
quantity. Understand the significance and how to find them.
 Singular Value Decomposition - factorization of a matrix into 3 matrices.
Understand the properties and applications.
 Principal Component Analysis (PCA) - understand the significance, properties,
and applications.

Properties such as the Dot product, Vector product and the Hadamard product are
useful to know as well.

3. Calculus
Calculus deals with changes in parameters, functions, errors and approximations.
Working knowledge of multi-dimensional calculus is imperative in Data Science. The
following are the most important concepts (albeit non-exhaustive) in Calculus:

 Derivatives - rules (addition, product, chain rule etc), hyperbolic derivatives


(tanh, cosh etc) and partial derivatives.
 Vector/Matrix Calculus - different derivative operators (Gradient, Jacobian,
Hessian and Laplacian)
 Gradient Algorithms - local/global maxima & minima, saddle points, convex
functions, batches & mini-batches, stochastic gradient descent, and
performance comparison.

4. Statistics & Probability


 Basic Statistics - Mean, median, mode, variance, covariance etc
 Basic rules in probability - events (dependent & independent), sample spaces,
conditional probability.
 Random variables - continuous & discrete, expectation, variance, distributions
(joint & conditional).
 Bayes' Theorem - calculates validity of beliefs. Bayesian software helps
machines recognize patterns and make decisions.
 Maximum Likelihood Estimation (MLE) - parameter estimation. Requires
knowledge of fundamental probability concepts (joint probability and
independence of events).
 Common Distributions - binomial, poisson, bernoulli, gaussian, exponential.

5. Information Theory
An important field that has made significant contributions to AI and Deep Learning,
and is yet unknown to many. It can be thought of as an amalgamation of calculus,
statistics and probability.

 Entropy - also called Shannon Entropy. Used to measure the uncertainty of in


an experiment.
 Cross-Entropy - compares two probability distrubutions & tells us how similar
they are.
 Kullback Leibler Divergence - another measure of how similar two probability
distrubutions are.
 Viterbi Algorithm - widely used in Natural Language Processing (NLP) &
Speech
 Encoder-Decoder - used in Machine Translation RNNs & other models.

You might also like

pFad - Phonifier reborn

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.


Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy