Artificial Intelligence

DSE 313 –Lecture#1

Introduction: What to expect from AI

Vaibhav
Assistant Professor, Data Science and Engineering
IISERB

Based on slides/lectures by Stuart Russell, Henry Kautz, Subbarao Kambhampati, Amit

Sethi, Avijit Maji, B Ravindran, and Mausam
 Course Plan (Overview)
Development of generalized techniques to solve
complex/hard problems
• PART1 (Traditional AI: AI is Search): - Introduction; philosophy of AI,
agents; informed search, uninformed search; local search heuristic search;
evolutionary algorithms; adversarial search; minmax algorithm.

• PART2 (Traditional AI: AI is Representation): Constraint satisfaction,

Logic and satisfiability; decision theory; Bayesian networks representation,
inference and learning.

• PART3 (Modern AI: AI is Learning): Learning agents, Cost optimization,

Learning template, Discussions on few algorithms few algorithms
(Regression, Neural Network, Backpropagation, Convolution Neural
Networks).
 Course Goals
• Understanding Why AI is important, and what is its
philosophy
• Decoding AI template for solving a problem (historical
and modern)
• Controlled dives in to various breadth and depth of ideas
and tools in AI to solve a problem
• At the end of the Course you will be:
• Able to identify tools that can solve a specific problem
• Develop Intuitions of required methods given a problem
• Understanding of a breath of AI tools and its phylosphy
 Who Should take it
• To learn tools to solve new problems (General Computer
Scientist)
• To create a base for advanced studies in AI (Serious
Computer Scientist)
Book: Stuart Russell and Peter Norvig: Artificial Intelligence- A
Modern Approach
https://zoo.cs.yale.edu/classes/cs470/materials/aima2010.pdf
• Hand written/Typed notes wont be provided
• Relevant material/papers/reports/books/links will be
provided
• PPT slides will be provided
Disclaimer*: Don’t expect slides be a complete reference material, they
are just pointers
Desirable Prerequisites

• You should be familiar with programming

• Understanding of Algorithm and Data
Structures
 Lecture Assignments
and Exams will
Theory Focus on
Theory, Modeling,
Modelling and Application

Application

CODING
Grading (Absolute)

20 % for 2 Quizzes
20 % Assisgnments (one or two)
30 % Endsem exam
30 % Midsem exam
 Artificial Intelligence
DSE 313 –Lecture2

Introduction: History of AI

Vaibhav
Assistant Professor, Data Science and Engineering
IISERB

Based on slides/lectures by Stuart Russell, Henry Kautz, Subbarao Kambhampati, Amit

Sethi, Avijit Maji, B Ravindran, and Mausam
What is Intelligence?

You solving addition of two numbers

A 4-year-old kid writes 1-10
father multiplies 524*534 in 1 minute
Someone attempting suicide
You solve Taylor series
Ants finding a path
Brain vs. Computer
Our hope: the human brain is a form of computer
Our goal: we can create computer intelligence through
programming just as people become intelligent with events

But we see that the computer is

not like the brain

The computer performs tasks

without understanding what its
doing

Does the brain understand what

its doing when it solves
problems?
 Types of AI: Based on Evolutionary Stages
Artificial Narrow Intelligence (Weak AI):
Implemented on specific tasks with limited range of function

• A lot of current intelligent systems

• Lack of reasoning and thinking
• e.g., Alexa, self driving car

Artificial General Intelligence (Strong AI):

Machine has human like abilities

Artificial Super Intelligence (Hypothetical AI):

• Capability of Machines surpassing human capabilities
• Machine can control human
• By 2040 we may reach there
 History of AI
• AI has a long history
• Ancient Greece
• Aristotle
• Ancient India
• Sages
• Historical Figures Contributed
• Alan Turing (published a paper in 1950 on speculations of creating machines
that think)
• Ramon Lull
• Al Khowarazmi
• Leonardo da Vinci
• David Hume
• George Boole
• Charles Babbage
• John von Neuman
• As old as electronic computers themselves (c1940)
History of AI
History of AI
• The gestation of artificial intelligence (1943–1955)
• The birth of artificial intelligence (1956)
• Early enthusiasm, great expectations (1952–1969)
• A dose of reality (1966–1973)
• Knowledge-based systems: The key to power? (1969–1979)
• AI becomes an industry (1980–present)
• The return of neural networks (1986–present)
• AI adopts the scientific method (1987–present)
• The emergence of intelligent agents (1995–present)
• The availability of very large data sets (2001–present)
 The ‘von Neuman’ Architecture

ENIAC (1946): Electronic Numerical Integrator and Computing

 1950s
• The Turing Test (1950)
“Can Machines Think”
By Alan Turing, 1950

• Turing asked “How would I know an object thinks (philosophical

question)”

• Designed Turing test: Intelligence quantified as questions and

answers
1956: A new field is born
1956: We propose that a 2
month, 10 man study be
carried out in Artificial
Intelligence in the summer
of 1956 at Darthmouth
College, New Hamshire

(John McCarthy
Allen Newell, Herbert
Simon, Marvin Minsky)
Early period - 1950’s & 60’s

• 1950: The Turing Test for

Machine Learning
• 1956: AI Born
• 1964: Eliza – the chatbot psychotherapist
• 1966: Shakey- General purpose mobile robot

• Brute force (calculate your way out)

• Theorem proving
• symbol manipulation
• Biological models
• neural nets
AI Winters
1974 – 1980: Winter #1
• Failure of machine transition
• Negative results in Neural Nets
• Poor speech understanding
1987 – 1993: Winter#2
• Decline of LISP
• Decline of specialized hardware for expert systems

Lasting effects
“Economics07” “AI is associated with systems that have too
often failed to live up to expectations”
Some positive news though!!
• Symbolic application period - 70’s
• Early expert systems, use of knowledge
• Commercial period - 80’s
• boom in knowledge/ rule bases
 1990s : the period of success stories
1996: An AI algorithm proved a theorem “Robbin’s
Algebras are all Boolean”.

Very reluctantly praised

An Argonne lab program has come up with a major

mathematical proof that would have been called creative if a
human would have thought of it.
-New York Times, December, 1996
Flood gates open

1997: Convolution Neural Network (CNN) paper

1997: Deep Blue (IBM) wins chess from

Source: The Conversation, The Sportsman

 1990s : the period of success stories
• Real-world applications, modelling, better evidence,
use of theory, ......?
• Topics: data mining, formal models, GA’s, fuzzy logic,
agents, neural nets, autonomous systems
• Applications
• visual recognition of traffic
• medical diagnosis
• directory enquiries
• power plant control
• automatic cars
1999 and 2000s
• NASA is the place where AI developed quickly
• In the Deep Space1 mission an AI program “Remote Agent”
ran autonomously.
• 2004 & 2009 Mars rovers (Sojonour (1997), Opportunity
and Spirit (2004))
1999 and 2000s
• NASA is the place where AI developed quickly
• In the Deep Space1 mission an AI program “Remote Agent”
ran autonomously.
• 2004 & 2009 Mars rovers (Sojonour (1997), Opportunity
and Spirit (2004))
1999 and 2000s
• NASA is the place where AI developed quickly
• In the Deep Space1 mission an AI program “Remote Agent”
ran autonomously.
• 2004 & 2009 Mars rovers (Sojonour (1997), Opportunity
and Spirit (2004))
2000s – Present TRENDS

• Autonomous Vehicle
• Robotic Process Automation (RPA)
• Conversational AI
• AI in Healthcare
• AI for Cybersecurity and knowledge breach
• The Intersection of the Internet of Things with AI
(AIoT)
• Quantum AI
• Edge Computing
Autonomous Vehicle-2005 -2007
(240 km)
2005: Darpa Grand Challenge

Sandstorm (2nd ) Stanley (1st)

2007 Urban Challenge 96 km (60 mi) urban area course, to be completed in

less than 6 hours while following all the traffic rules

Winner: Tartan Racing, Stanford teaming with Volkswagen

 Present (2011-till)
Search -> neural Network->Logic -> neural networks-> probability
(Judea Pearl) -> neural network (present)

• 2016- AlphaGo defeated human in “Go” game (10 to the power of 170
possible board configurations).

• AlphaGo is a computer program that plays the board game Go

World's best Go player

flummoxed by Google’s
‘godlike’ AlphaGo AI
Atari games “Mario Pacman all run
on single neural net configuration”
What Changed??

Computational Algorithm
Power

6,00 Tweets
per second

Data
500 million
Tweets per day
A breakthrough (object recognition:
computer vision)
 Name layers Error%

AlexNet 8 16%

VGGNet 19 7.3%

MS ResNet 152 3.6%

Top-1 one-crop accuracy versus amount of operations required for a single forward pass.
The size of the blobs is proportional to the number of network parameters; a legend is
reported in the bottom right corner. Both these figures share the same y-axis, and the grey
dots highlight the centre of the blobs.

Alfredo Canziani, Adam Paszke, Eugenio Culurciello

Medicine:
• Image guided surgery
Robocup: Aim is to develop a team of autonomous
humanoid robots that can win human world champion
team in soccer
AI Applications
Other application areas:
• Bioinformatics:
• Gene expression data analysis
• Prediction of protein structure
• Text classification, document sorting:
• Web pages, e-mails
• Articles in the news
• Video, image classification
• Transport
• Urban Planning
• Disasters
• Music composition, picture drawing
• Natural Language Processing .
• Perception.

And many more…

Till Now
• Theory vs Modeling vs Application
• History of AI
• Applications of AI (Past, Present, and Future)
 Artificial Intelligence
DSE 313 –Lecture3

Defining AI

Vaibhav
Assistant Professor, Data Science and Engineering
IISERB

Based on slides/lectures by Stuart Russell, Henry Kautz, Subbarao Kambhampati, Amit

Sethi, Avijit Maji, B Ravindran, and Mausam
Science of AI

Physics: What laws guide the dynamics of physical

universe?
Biology: How do living organism function and life
evolves?

AI: Artificial (easy) + Intelligence (tough)??

What is Intelligence?
Dictionary.com: capacity for learning, reasoning,
understanding, and similar forms of mental activity

Ability to perceive and act in the world

Reasoning : proving theorems (based on evidence)
Planning: take decision
Learning and adaptation: movie recommendation, selecting
route.
Understanding: text, images, voices..
Human and Intelligence

Are humans intelligent?

Are humans always intelligent?

Are nonhumans intelligent?

An Ideal Scenario: collaboration of Human and Machine

which is intelligent
 What is Artificial Intelligence ?
(Definitions from noted researchers)

• making computers that think?

• the automation of activities we associate with human thinking,
like decision making, learning ... ?
• the art of creating machines that perform functions that
require intelligence when performed by people ?
• the study of mental faculties through the use of computational
models ?
What is Artificial Intelligence ?
• the study of computations that make it possible to
perceive, reason and act ?
• a field of study that seeks to explain and emulate
intelligent behaviour in terms of computational processes ?
• a branch of computer science that is concerned with the
automation of intelligent behaviour ?
• anything in Computing Science that we don't yet know how
to do properly ? (!)
What is Artificial Intelligence ?

THOUGHT Systems that thinkSystems that think

like humans rationally

Systems that act Systems that act

BEHAVIOUR like humans rationally

HUMAN RATIONAL
Systems that act like humans (Acting
humanly): Turing Test Proposed by Alan Turing (1950)

• To provide a satisfactory operational definition of

intelligence
• The Turing Test approach
• a human questioner cannot tell if
• there is a computer or a human answering his question, via teletype
(remote communication)
• the computer must behave intelligently
• Intelligent behavior
• to achieve human-level performance in all cognitive tasks
 Systems that act like humans

• You enter a room which has a computer terminal. You have a fixed
period of time to type what you want into the terminal, and study
the replies. At the other end of the line is either a human being or a
computer system.
• If it is a computer system, and at the end of the period you cannot
reliably determine whether it is a system or a human, then the
system is deemed to be intelligent.
Systems that act like humans
• These cognitive tasks include:
• Natural language processing
• for communication with human
• Knowledge representation
• to store information effectively & efficiently
• Automated reasoning
• to retrieve & answer questions using the stored information
• Machine learning
• to adapt to new circumstances
The total Turing Test

To pass the total Turing Test, the computer will

need
• Computer vision
• to perceive objects (seeing)
• Robotics
• to move objects (acting)
What is Artificial Intelligence ?

THOUGHT Systems that thinkSystems that think

like humans rationally

Systems that act Systems that act

BEHAVIOUR like humans rationally

HUMAN RATIONAL
Systems that think like humans: cognitive
modeling (Not necessary definition of AI)
• Cognitive Science (Very hard to understand how we think)
• Some way of determining how humans think: (get Inside:
observed from ‘inside’)
• How do we know how humans think?
• Introspection, psychological experiments
• Brain Imaging
• If program outcomes matches corresponding human behavior
(the goal of aeronautical engg is not to fool birds)
What is a good cognitive model??
What is Artificial Intelligence ?

THOUGHT Systems that thinkSystems that think

like humans rationally

Systems that act Systems that act

BEHAVIOUR like humans rationally

HUMAN RATIONAL
Systems that think ‘rationally’
"laws of thought"
• Humans are not always ‘rational’

• Rational - defined in terms of logic?

• Logic can’t express everything (e.g. uncertainty)

• Logical approach is often not feasible in terms of

computation time (needs ‘guidance’), (e.g. You don't
use logic to remove hand from hot surface)
What is Artificial Intelligence ?

THOUGHT Systems that thinkSystems that think

like humans rationally

Systems that act Systems that act

BEHAVIOUR like humans rationally

HUMAN RATIONAL
 Systems that act rationally:
“Rational agent”
• Rational behavior: doing the right thing
• The right thing: that which is expected to maximize goal
achievement, given the available information
• Giving answers to questions is ‘acting’.
• An agent is just something that acts operate
autonomously, perceive their environment, persist over a
prolonged time period, adapt to change, and create and
pursue goals
•. A rational agent is one that acts so as to achieve the best
outcome or, when there is uncertainty, the best expected
outcome.
Rational agents

 This course is about designing rational agents

 Abstractly, an agent is a function from percept

histories to actions:
[f: P* → A]

 For any given class of environments and tasks, we

seek the agent (or class of agents) with the best
performance
Systems that act rationally
Study AI as rational agent –
Advantages:
• It is more general than using logic only
• Because: LOGIC + Domain knowledge
• It allows extension of the approach with more
scientific methodologies
 Ideal Rational Agent

For each percept sequence, does whatever action is

expected to maximize its performance measure on the
basis of evidence perceived so far and built-in knowledge
Rationality vs omniscience
Goals of AI
• To make computers more useful by letting them
take over dangerous or tedious tasks from human
• Understand principles of human intelligence
represent those actions using computers.
The Foundation of AI
Philosophy
• At that time, the study of human intelligence began with
no formal expression
• Initiate the idea of mind as a machine and its internal
operations
The Foundation of AI
Mathematics formalizes the three main area of AI:
computation, logic, and probability
 Computation leads to analysis of the problems that can
be computed
 complexity theory
 Probability contributes the “degree of belief” to handle
uncertainty in AI
 Decision theory combines probability theory and utility
theory (bias)
The Foundation of AI
Psychology
• How do humans think and act?
• The study of human reasoning and acting
• Provides reasoning models for AI
• Strengthen the ideas
• humans and other animals can be considered as information
processing machines
The Foundation of AI
Computer Engineering
• How to build an efficient computer?
• Provides the artifact that makes AI application possible
• The power of computer makes computation of large and
difficult problems more easily
• AI has also contributed its own work to computer
science, including: time-sharing, the linked list data type,
OOP, etc.
The Foundation of AI
Control theory and Cybernetics
• How can artifacts operate under their own control?
• The artifacts adjust their actions
• To do better for the environment over time
• Based on an objective function and feedback from the
environment
• Not limited only to linear systems but also other
problems
• as language, vision, and planning, etc.
The Foundation of AI
Linguistics
• For understanding natural languages
• different approaches has been adopted from the linguistic
work
• Formal languages
• Syntactic and semantic analysis
• Knowledge representation
Areas of AI and Some Dependencies

Knowledge
Search Logic Representation

Machine
Planning
Learning

Expert
NLP Vision Robotics Systems
The main topics in AI
Artificial intelligence can be considered under a number of
headings:
• Search (includes Game Playing).
• Representing Knowledge and Reasoning with it.
• Planning.
• Learning.
• Natural language processing.
• Expert Systems.
• Interacting with the Environment (e.g. Vision, Speech
recognition, Robotics)
We won’t have time in this course to consider all of these.
Search
• Search is the fundamental technique of AI.
• Possible answers, decisions or courses of action are structured into an
abstract space, which we then search.
• Search is either "blind" or “uninformed":
• blind
• we move through the space without worrying about what is
coming next, but recognising the answer if we see it
• informed
• we guess what is ahead, and use that information to decide
where to look next.
• We may want to search for the first answer that satisfies our goal, or we
may want to keep searching until we find the best answer.
Knowledge Representation & Reasoning
• The second most important concept in AI
• If we are going to act rationally in our environment, then we must have
some way of describing that environment and drawing inferences from
that representation.
• how do we describe what we know about the world ?
• how do we describe it concisely ?
• how do we describe it so that we can get hold of the right piece of
knowledge when we need it ?
• how do we generate new pieces of knowledge ?
• how do we deal with uncertain knowledge ?
 Knowledge

Declarative Procedural

• Declarative knowledge deals with factoid questions

(what is the capital of India? Etc.)
• Procedural knowledge deals with “How”
• Procedural knowledge can be embedded in
declarative knowledge
Planning
Given a set of goals, construct a sequence of actions that achieves
those goals:
• often very large search space
• but most parts of the world are independent of most other parts
• often start with goals and connect them to actions
• no necessary connection between order of planning and order of
execution
• what happens if the world changes as we execute the plan and/or
our actions don’t produce the expected results?
 Learning
• If a system is going to act truly appropriately, then it
must be able to change its actions in the light of
experience:
• how do we generate new facts from old ?
• how do we generate new concepts ?
• how do we learn to distinguish different
situations in new environments ?
Interacting with the Environment

• In order to enable intelligent behaviour, we will

have to interact with our environment.
• Properly intelligent systems may be expected to:
• accept sensory input
• vision, sound, …
• interact with humans
• understand language, recognise
speech,
generate text, speech and graphics, …
• modify the environment
• robotics
Symbolic and Sub-symbolic AI
• Symbolic AI is concerned with describing and manipulating
our knowledge of the world as explicit symbols, where
these symbols have clear relationships to entities in the
real world.
• Sub-symbolic AI (e.g. neural-nets) is more concerned with
obtaining the correct response to an input stimulus
without ‘looking inside the box’ to see if parts of the
mechanism can be associated with discrete real world
objects.
• This course is concerned with symbolic AI.
Some Advantages of Artificial Intelligence

• more powerful and more useful computers

• new and improved interfaces
• solving new problems
• better handling of information
• relieves information overload
• conversion of information into knowledge
The Disadvantages

• increased costs
• difficulty with software development - slow and expensive
• few experienced programmers
• few practical products have reached the market as yet.
 Reading
Pg (1 – 31) From the book

Book: Stuart Russell and Peter Norvig: Artificial Intelligence- A Modern

Approach