CC-309 Introduction to Artificial

Intelligence and Machine Learning

Prepared By :
Prof. Parth D. Joshi
L J College of Computer Applications, Vastrapur, Ahmedabad
Unit 1: Fundamentals of Artificial Intelligence and Intelligent Agents

01 Introduction to AI
- What is Artificial Intelligence
- Approaches of Artificial Intelligence
--Acting Humanly : The Turing Test Approach
--Thinking Humanly : The cognitive science model Approach
--Thinking Rationally : The “Laws of thought” Approach
--Acting Rationally : The rational agent approach
- State of the Art (Application of AI)
- Agents and Its Environment
- The Concept of Rationality
- The Nature of Environment
- The Structure of Agents

Case Study: Create a new health care market with AI

Prepared By : Prof. Parth D. Joshi

L J College of Computer Applications, Vastrapur, Ahmedabad
Introduction to Artificial Intelligence

Prepared By : Prof. Parth D. Joshi

L J College of Computer Applications, Vastrapur, Ahmedabad
Introduction
In today's world, technology is growing very fast, and we are getting in
touch with different new technologies day by day.

Here, one of the booming technologies of computer science is Artificial

Intelligence which is ready to create a new revolution in the world by
making intelligent machines.The Artificial Intelligence is now all around
us. It is currently working with a variety of subfields, ranging from
general to specific, such as self-driving cars, playing chess, proving
theorems, playing music, Painting, etc.

AI is one of the fascinating and universal fields of Computer science

which has a great scope in future. AI holds a tendency to cause a
machine to work as a human.

AI is a technique that enables machines to mimic human behavior.

Artificial Intelligence is the theory and development of computer
systems able to perform tasks normally requiring human intelligence,
such as visual perception, speech recognition, decision-making and
translation between languages.

Prepared By : Prof. Parth D. Joshi

L J College of Computer Applications, Vastrapur, Ahmedabad
What is Intelligence?

Intelligence has been defined in many ways: the capacity

for logic, understanding, self-awareness, learning, emotional
knowledge, reasoning, planning, creativity, critical thinking,
and problem solving. More generally, it can be described as
the ability to perceive or infer information, and to retain it as
knowledge to be applied towards adaptive behaviours within
an environment or context.

Prepared By : Prof. Parth D. Joshi

L J College of Computer Applications, Vastrapur, Ahmedabad
 What is Artificial Intelligence?

Artificial Intelligence Artificial Intelligence

Artificial intelligence (AI) is wide-ranging branch of computer science concerned with building smart machines
capable of performing tasks that typically require human intelligence. AI is an interdisciplinary science with
multiple approaches. AI is an art which is used to make machines which can understand likes humans, works
like humans, predicts like humans and make decisions like humans.

Prepared By : Prof. Parth D. Joshi

L J College of Computer Applications, Vastrapur, Ahmedabad
 What is Artificial Intelligence?
According to the father of Artificial Intelligence, John McCarthy, artificial intelligence is “The science and
engineering of making intelligent machines, especially intelligent computer programs”.

Artificial Intelligence is a way of creating a computer or mobile, a robot, or an application which can
think intelligently, just in the way a normal human think and process his/her thoughts.

It is an area of computer science that emphasizes the creation of intelligent machines which work and react
like humans.

Various application of AI includes gaming, natural language processing, expert systems, speech recognition,
handwriting recognition, and intelligent robots.

The term “Robotics” was introduced in 1945. AI saw major advantages after 1990 in various fields.

Definitions of artificial intelligence according to eight recent textbooks are shown in the table below. These
definitions vary along two main dimensions. The ones on top are concerned with thought
processes and reasoning, whereas the ones on the bottom address behavior. Also, the definitions on the left
measure success in terms of human performance, whereas the ones on the right measure against
an ideal concept of intelligence, which we will call rationality. A system is rational if it does the right thing.

Prepared By : Prof. Parth D. Joshi

L J College of Computer Applications, Vastrapur, Ahmedabad
 What is Artificial Intelligence?
``The exciting new effort to make computers think ... machines ``The study of mental faculties through the use of
with minds, in the full and literal sense'' (Haugeland, 1985) computational models'' (Charniak and McDermott, 1985)

``The automation of activities that we associate with human ``The study of the computations that make it possible to
thinking, activities such as decision-making, problem solving, perceive, reason, and act'' (Winston, 1992)
learning ...'' (Bellman, 1978)
``The art of creating machines that perform functions that ``A field of study that seeks to explain and emulate intelligent
require intelligence when performed by people'' (Kurzweil, behavior in terms of computational processes'' (Schalkoff,
1990)`` 1990)

The study of how to make computers do things at which, at the ``The branch of computer science that is concerned with the
moment, people are better'' (Rich and Knight, 1991) automation of intelligent behavior'' (Luger and Stubblefield,
1993)

This gives us four possible goals to pursue in artificial intelligence:

Systems that think like humans. Systems that think rationally.

Systems that act like humans Systems that act rationally

Prepared By : Prof. Parth D. Joshi

L J College of Computer Applications, Vastrapur, Ahmedabad
Approaches Thinking Humanly

of Artificial The Cognitive Science Approach

- Introspection Method
- Psychological Experiments Method

Intelligence Acting Humanly

-The Turing Test Approach
-The Total Turing Test Approach

Thinking Rationally
- Laws of Thoughts Approaches

Acting Rationally
- The Rational Agent Approaches

Prepared By : Prof. Parth D. Joshi

L J College of Computer Applications, Vastrapur, Ahmedabad
 Acting Humanly: The Turing Test Approach

Less than a decade after breaking the Nazi encryption

machine Enigma and helping the Allied Forces win World
War II, mathematician Alan Turing changed history a second
time with a simple question: "Can machines think?"

Turing's paper "Computing Machinery and Intelligence"

(1950), and it's subsequent Turing Test, established the
fundamental goal and vision of artificial intelligence.

A Turing Test is a method of inquiry in artificial intelligence

(AI) for determining whether or not a computer is capable of
thinking like a human being. The test is named after Alan
Turing, the founder of the Turning Test and an English
computer scientist, cryptanalyst, mathematician and
theoretical biologist.

Prepared By : Prof. Parth D. Joshi

L J College of Computer Applications, Vastrapur, Ahmedabad
 How it works?
Turing proposed that a computer can be said to possess artificial
intelligence if it can mimic human responses under specific
conditions. The original Turing Test requires three terminals, each of
which is physically separated from the other two. One terminal is
operated by a computer, while the other two are operated by
humans.

During the test, one of the humans functions as the questioner, while
the second human and the computer function as respondents. The
questioner interrogates the respondents within a specific subject
area, using a specified format and context. After a preset length of
time or number of questions, the questioner is then asked to decide
which respondent was human and which was a computer.

The test is repeated many times. If the questioner makes the correct
determination in half of the test runs or less, the computer is
considered to have artificial intelligence because the questioner
regards it as "just as human" as the human respondent.

Prepared By : Prof. Parth D. Joshi

L J College of Computer Applications, Vastrapur, Ahmedabad
Components required for the Test
Machine Learning

Autonomous Processing

Knowledge Representation

Natural Language Processing

Prepared By : Prof. Parth D. Joshi

L J College of Computer Applications, Vastrapur, Ahmedabad
 Components required for the Test
✓Natural Language Processing: to enable it to communicate successfully in
English (or some other human language);

✓Knowledge representation: to store information provided before or during the

interrogation;

✓Automated reasoning: to use the stored information to answer questions and

to draw new conclusions;

✓Machine learning: to adapt to new circumstances and to detect and

extrapolate patterns.

Prepared By : Prof. Parth D. Joshi

L J College of Computer Applications, Vastrapur, Ahmedabad
 The Total Turing Test

In the Total Turing Test, verbal behaviours are not the sole
standard for intelligence: other behaviours are examined
too. “‘The candidate must be able to do, in the real world of
objects and people, everything that real people can do”. In
other words, the Total Turing Test can only be applied to a
robot, or some other agent that is situated and embodied in
the physical world.

Prepared By : Prof. Parth D. Joshi

L J College of Computer Applications, Vastrapur, Ahmedabad
Components required for the Total Turing Test

Robotics

Computer Vision

Prepared By : Prof. Parth D. Joshi

L J College of Computer Applications, Vastrapur, Ahmedabad
Components required for the Test
✓Computer Vision: to perceive objects

✓Robotics: to move them about.

Prepared By : Prof. Parth D. Joshi

L J College of Computer Applications, Vastrapur, Ahmedabad
 Thinking Humanly: The Cognitive Modeling Approach
If we are going to say that a given program thinks like a human, we must have some way of determining
how humans think. We need to get inside the actual workings of human minds. There are two ways to do
this: through introspection--trying to catch our own thoughts as they go by--or through psychological
experiments. Once we have a sufficiently precise theory of the mind, it becomes possible to express the
theory as a computer program. If the program's input/output and timing behavior matches human
behavior, that is evidence that some of the program's mechanisms may also be operating in humans.

For example, Newell and Simon, who developed GPS, the ``General Problem Solver'' (Newell and Simon,
1961), were not content to have their program correctly solve problems. They were more concerned with
comparing the trace of its reasoning steps to traces of human subjects solving the same problems. This is
in contrast to other researchers of the same time (such as Wang (1960)), who were concerned with
getting the right answers regardless of how humans might do it. The interdisciplinary field of cognitive
science brings together computer models from AI and experimental techniques from psychology to try to
construct precise and testable theories of the workings of the human mind. Although cognitive science is a
fascinating field in itself, we are not going to be discussing it all that much in this book. We will
occasionally comment on similarities or differences between AI techniques and human cognition. Real
cognitive science, however, is necessarily based on experimental investigation of actual humans or
animals, and we assume that the reader only has access to a computer for experimentation. We will
simply note that AI and cognitive science continue to fertilize each other, especially in the areas of vision,
natural language, and learning.
Prepared By : Prof. Parth D. Joshi
L J College of Computer Applications, Vastrapur, Ahmedabad
 Thinking Rationally: The Laws of thought Approach
The Greek philosopher Aristotle was one of the first to attempt to codify ``right thinking,'' that is, irrefutable reasoning
processes. His famous syllogisms provided patterns for argument structures that always gave correct conclusions
given correct premises. For example, ``Socrates is a man; all men are mortal; therefore Socrates is mortal.'' These laws
of thought were supposed to govern the operation of the mind, and initiated the field of logic.

The development of formal logic in the late nineteenth and early twentieth centuries, which we describe in more detail in
Chapter 6, provided a precise notation for statements about all kinds of things in the world and the relations between
them. (Contrast this with ordinary arithmetic notation, which provides mainly for equality and inequality statements
about numbers.) By 1965, programs existed that could, given enough time and memory, take a description of a problem
in logical notation and find the solution to the problem, if one exists. (If there is no solution, the program might never
stop looking for it.) The so-called logicist tradition within artificial intelligence hopes to build on such programs to create
intelligent systems.

There are two main obstacles to this approach. First, it is not easy to take informal knowledge and state it in the formal
terms required by logical notation, particularly when the knowledge is less than 100% certain. Second, there is a big
difference between being able to solve a problem ``in principle'' and doing so in practice. Even problems with just a few
dozen facts can exhaust the computational resources of any computer unless it has some guidance as to which
reasoning steps to try first. Although both of these obstacles apply to any attempt to build computational reasoning
systems, they appeared first in the logicist tradition because the power of the representation and reasoning systems
are well-defined and fairly well understood.

Prepared By : Prof. Parth D. Joshi

L J College of Computer Applications, Vastrapur, Ahmedabad
 Acting Rationally: The Rational Agent Approach
Acting rationally means acting so as to achieve one's goals, given one's beliefs. An agent is just
something that perceives and acts. In the logical approach to AI, the emphasis is on correct inferences.
This is often part of being a rational agent because one way to act rationally is to reason logically and then
act on ones conclusions. But this is not all of rationality because agents often find themselves in situations
where there is no provably correct thing to do, yet they must do something.

There are also ways to act rationally that do not seem to involve inference, e.g., reflex actions.

The study of AI as rational agent design has two advantages:

❖ It is more general than the logical approach because correct inference is only a useful
mechanism for achieving rationality, not a necessary one.

❖ It is more amenable to scientific development than approaches based on human behaviour or

human thought because a standard of rationality can be defined independent of humans.

Achieving perfect rationality in complex environments is not possible because the computational demands
are too high. However, we will study perfect rationality as a starting place.

Prepared By : Prof. Parth D. Joshi

L J College of Computer Applications, Vastrapur, Ahmedabad
 State of the Art (Applications of AI)
1. Robotic Vehicles

2. Speech Recognition

3. Autonomous Planning and Scheduling

4. Game Playing

5. Spam Fighting

6. Robotics

7. Machine Translation

8. Logistics Planning

Prepared By : Prof. Parth D. Joshi

L J College of Computer Applications, Vastrapur, Ahmedabad
 Robotic Vehicles
A driverless robotic car named STANLEY sped through the rough terrain of the Mojave dessert at 22 mph,
finishing the 132-mile course first to win the 2005 DARPA Grand Challenge. STANLEY is a Volkswagen
Touareg outfitted with cameras, radar, and laser rangefinders to sense the environment and onboard
software to command the steering, braking, and acceleration (Thrun, 2006). The following year CMU’s
BOSS won the Urban Challenge, safely driving in traffic through the streets of a closed Air Force base,
obeying traffic rules and avoiding pedestrians and other vehicles.

Speech Recognition
A traveler calling United Airlines to book a flight can have the entire conversation guided by an automated
speech recognition and dialog management system.

Robotics
The iRobot Corporation has sold over two million Roomba robotic vacuum cleaners for home use. The
company also deploys the more rugged PackBot to Iraq and Afghanistan, where it is used to handle
hazardous materials, clear explosives, and identify the location of snipers.

Prepared By : Prof. Parth D. Joshi

L J College of Computer Applications, Vastrapur, Ahmedabad
 Autonomous Planning and Scheduling
A hundred million miles from Earth, NASA’s Remote Agent program became the first on-board
autonomous planning program to control the scheduling of operations for a spacecraft (Jonsson et al.,
2000). REMOTE AGENT generated plans from high-level goals specified from the ground and monitored
the execution of those plans—detecting, diagnosing, and recovering from problems as they occurred.
Successor program MAPGEN (Al-Chang et al., 2004) plans the daily operations for NASA’s Mars
Exploration Rovers, and MEXAR2 (Cesta et al., 2007) did mission planning—both logistics and science
planning—for the European Space Agency’s Mars Express mission in 2008.

Game Playing
IBM’s DEEP BLUE became the first computer program to defeat the world champion in a chess match
when it bested Garry Kasparov by a score of 3.5 to 2.5 in an exhibition match (Goodman and Keene,
1997). Kasparov said that he felt a “new kind of intelligence” across the board from him. Newsweek
magazine described the match as “The brain’s last stand.” The value of IBM’s stock increased by $18
billion. Human champions studied Kasparov’s loss and were able to draw a few matches in subsequent
years, but the most recent human-computer matches have been won convincingly by the computer.

Prepared By : Prof. Parth D. Joshi

L J College of Computer Applications, Vastrapur, Ahmedabad
 Spam Fighting
Each day, learning algorithms classify over a billion messages as spam, saving the recipient from having
to waste time deleting what, for many users, could comprise 80% or 90% of all messages, if not classified
away by algorithms. Because the spammers are continually updating their tactics, it is difficult for a static
programmed approach to keep up, and learning algorithms work best (Sahami et al., 1998; Goodman and
Heckerman, 2004).

Logistics Planning
During the Persian Gulf crisis of 1991, U.S. forces deployed a Dynamic Analysis and Replanning Tool,
DART (Cross and Walker, 1994), to do automated logistics planning and scheduling for transportation.
This involved up to 50,000 vehicles, cargo, and people at a time, and had to account for starting points,
destinations, routes, and conflict resolution among all parameters. The AI planning techniques generated
in hours a plan that would have taken weeks with older methods. The Defense Advanced Research
Project Agency (DARPA) stated that this single application more than paid back DARPA’s 30-year
investment in AI.

Prepared By : Prof. Parth D. Joshi

L J College of Computer Applications, Vastrapur, Ahmedabad
 Machine Translation
A computer program automatically translates from Arabic to English, allowing an English speaker to see
the headline “Ardogan Confirms That Turkey Would Not Accept Any Pressure, Urging Them to Recognize
Cyprus.” The program uses a statistical model built from examples of Arabic-to-English translations and
from examples of English text totaling two trillion words (Brants et al., 2007). None of the computer
scientists on the team speak Arabic, but they do understand statistics and machine learning algorithms.

Prepared By : Prof. Parth D. Joshi

L J College of Computer Applications, Vastrapur, Ahmedabad
 Agents and its
Environment

Prepared By : Prof. Parth D. Joshi

L J College of Computer Applications, Vastrapur, Ahmedabad
 What is Agent and Environment?
An AI system is composed of an agent and its environment. The
agents act in their environment. The environment may contain
other agents.

What are Agent and Environment?

An agent is anything that can perceive its environment through

sensors and acts upon that environment through effectors.

A human agent has sensory organs such as eyes, ears, nose,

tongue and skin parallel to the sensors, and other organs such as
hands, legs, mouth, for effectors.

A robotic agent replaces cameras and infrared range finders for

the sensors, and various motors and actuators for effectors.

A software agent has encoded bit strings as its programs and

actions.
Prepared By : Prof. Parth D. Joshi
L J College of Computer Applications, Vastrapur, Ahmedabad
 What is Agent and Environment?
What is agent?

•An agent is anything that can perceive its environment

through sensors and acts upon that environment
through effectors.

•An agent is something that has senses and it can act, though it is
not a human or a living creature.

•Not all agents are intelligent.

•Agents can be a robot, software or a softbot (Software + robot)

•Agent’s behavior is described by agent function that maps any

given percept sequence to action.

Prepared By : Prof. Parth D. Joshi

L J College of Computer Applications, Vastrapur, Ahmedabad
 What is Agent and Environment?
An agent program is a concrete implementation, running within some physical system. As a real world example,
we can take vacuum cleaner. There is a situation where vacuum cleaner has two blocks to move, A and B. the
agent- vacuum cleaner perceives which block it is in, if there is any dirt over there or not. From the in-built actions-
SUCK and MOVE, it will suck if it will find dust. Else it will move to other block to find dust.

For the given figure:

Environment: Block A & B,

Percepts: [Location and content] [A, Dirty]
Operation: Left, Right, Suck

Prepared By : Prof. Parth D. Joshi

L J College of Computer Applications, Vastrapur, Ahmedabad
 What is Agent and Environment?
Agent Terminology
Performance Measure of Agent − It is the criteria, which determines how successful an agent is.

Behavior of Agent − It is the action that agent performs after any given sequence of percepts.

Percept − It is agent’s perceptual inputs at a given instance.

Percept Sequence − It is the history of all that an agent has perceived till date.

Agent Function − It is a map from the precept sequence to an action.

What is environment?

It is the global space where an agent performs given actions. With the help of sensors, actions, percepts
(ability to see, hear, understood etc. Agent’s perceptual inputs at a given instance) and effectors(agents act in
the environment with help of effectors), agent work in the environment.

Prepared By : Prof. Parth D. Joshi

L J College of Computer Applications, Vastrapur, Ahmedabad
 The Concept of Rationality

Rationality is status of being reasonable, sensible, and

having good sense of judgment. To gain the useful and exact
information as outcome of performed actions is the goal of
rational agent. Agent’s rationality depends upon perception
measures, percept sequences, prior knowledge about
environment, and actions. An ideal rational agent is the one
who is does given actions to improve its performance on the
basis of its own built-in knowledge and percept sequence.

Prepared By : Prof. Parth D. Joshi

L J College of Computer Applications, Vastrapur, Ahmedabad
 The Concept of Rationality
What is Ideal Rational Agent?
An ideal rational agent is the one, which is capable of doing expected actions to
maximize its performance measure, on the basis of −

•Its percept sequence

•Its built-in knowledge base

Rationality of an agent depends on the following −

•The performance measures, which determine the degree of success.

•Agent’s Percept Sequence till now.
•The agent’s prior knowledge about the environment.
•The actions that the agent can carry out.

A rational agent always performs right action, where the right action means the
action that causes the agent to be most successful in the given percept
sequence. The problem the agent solves is characterized by Performance
Measure, Environment, Actuators, and Sensors (PEAS).

Prepared By : Prof. Parth D. Joshi

L J College of Computer Applications, Vastrapur, Ahmedabad
 The Nature of Environment
Some programs operate in the entirely artificial environment confined
to keyboard input, database, computer file systems and character output
on a screen.

In contrast, some software agents (software robots or softbots) exist in

rich, unlimited softbots domains. The simulator has a very detailed,
complex environment. The software agent needs to choose from a
long array of actions in real time. A softbot designed to scan the online
preferences of the customer and show interesting items to the customer
works in the real as well as an artificial environment.

The most famous artificial environment is the Turing Test

environment, in which one real and other artificial agents are tested on
equal ground. This is a very challenging environment as it is highly
difficult for a software agent to perform as well as a human.

Prepared By : Prof. Parth D. Joshi

L J College of Computer Applications, Vastrapur, Ahmedabad
 The Nature of Environment
It is necessary to get a “task environment”. In designing an agent, the
first step must be to specify a task environment as fully as possible. It is
said as PEAS description.
Where, P – Performance, E- Environment, A- Actuators, S- Sensors.

A next level example of AI can be an automated taxi. Where, for Agent

type taxi driver, PEAS can be:

Agent type Taxi Driver

Performance measure Safe, fast, comfortable trip, maximize profit.
Environment Roads, traffic, pedestrians, cyclists.
Actuators steering, accelerator, break, horn, display
Sensors GPS, camera, speedometer
Table 1.1 PEAS for taxi driver

We need a metric or a rule to measure the performance of the agent in the

environment.

Prepared By : Prof. Parth D. Joshi

L J College of Computer Applications, Vastrapur, Ahmedabad
 The Properties of Environment
The environment has multifold properties −

Discrete / Continuous − If there are a limited number of distinct, clearly defined, states of the
environment, the environment is discrete (For example, chess); otherwise it is continuous (For
example, driving).

Observable / Partially Observable − If it is possible to determine the complete state of the

environment at each time point from the percepts it is observable; otherwise it is only partially
observable.

Static / Dynamic − If the environment does not change while an agent is acting, then it is static;
otherwise it is dynamic.

Single agent / Multiple agents − The environment may contain other agents which may be of the
same or different kind as that of the agent.

Prepared By : Prof. Parth D. Joshi

L J College of Computer Applications, Vastrapur, Ahmedabad
 The Properties of Environment
Accessible / Inaccessible − If the agent’s sensory apparatus can have access to the complete state
of the environment, then the environment is accessible to that agent.

Deterministic / Non-deterministic − If the next state of the environment is completely determined by

the current state and the actions of the agent, then the environment is deterministic; otherwise it is
non-deterministic.

Episodic / Non-episodic − In an episodic environment, each episode consists of the agent

perceiving and then acting. The quality of its action depends just on the episode itself. Subsequent
episodes do not depend on the actions in the previous episodes. Episodic environments are much
simpler because the agent does not need to think ahead.

Prepared By : Prof. Parth D. Joshi

L J College of Computer Applications, Vastrapur, Ahmedabad
 The Structure of Intelligent Agent
The task of AI is to design an agent program which implements the agent function. The structure of an
intelligent agent is a combination of architecture and agent program. It can be viewed as:

Agent = Architecture + Agent program

Following are the main three terms involved in the structure of an AI agent:

Architecture: Architecture is machinery that an AI agent executes on.

Agent Function: Agent function is used to map a percept to an action.

f:P* → A

Agent program: Agent program is an implementation of agent function. An agent program executes on the
physical architecture to produce function f.

Prepared By : Prof. Parth D. Joshi

L J College of Computer Applications, Vastrapur, Ahmedabad
 Types of Agents

Simple Reflex Agent. Utility Agent

Model Based Reflex Agent. Problem Solving Agent

Types of
Agents

Goal Based Agent. Learning Agent

Prepared By : Prof. Parth D. Joshi

L J College of Computer Applications, Vastrapur, Ahmedabad
 Types of Agents
There are four program agents available:

•Simple reflex agents

•Model based reflex agents

•Goal-based agents

•Utility- based agents

Prepared By : Prof. Parth D. Joshi

L J College of Computer Applications, Vastrapur, Ahmedabad
 Simple Reflex Agents
•The Simple reflex agents are the simplest agents. These agents take decisions on the basis of the current
percepts and ignore the rest of the percept history.

•These agents only succeed in the fully observable environment.

•The Simple reflex agent does not consider any part of percepts history during their decision and action
process.

•The Simple reflex agent works on Condition-action rule, which means it maps the current state to action. Such
as a Room Cleaner agent, it works only if there is dirt in the room.

•Problems for the simple reflex agent design approach:

•They have very limited intelligence
•They do not have knowledge of non-perceptual parts of the current state
•Mostly too big to generate and to store.
•Not adaptive to changes in the environment.

Prepared By : Prof. Parth D. Joshi

L J College of Computer Applications, Vastrapur, Ahmedabad
 Simple Reflex Agents

oIn left figure, rectangles are used to denote the current internal state of the agent’s decision process, and ovals to
represent the background information used in the process.
oIn right, The INTERPRET-INPUT function generates an abstracted description of the current state from the
percept; the RULE-MATCH function returns the first rule in the set of rules which matches with provided state
description.
When the environment is fully observable, only then right figure will be succeed.
Prepared By : Prof. Parth D. Joshi
L J College of Computer Applications, Vastrapur, Ahmedabad
 Model Based Reflex Agents
•The Model-based agent can work in a partially observable environment, and track the situation.

•A model-based agent has two important factors:

•Model: It is knowledge about "how things happen in the world," so it is called a Model-based agent.

•Internal State: It is a representation of the current state based on percept history.

•These agents have the model, "which is knowledge of the world" and based on the model they perform
actions.

•Updating the agent state requires information about:

•How the world evolves

•How the agent's action affects the world.

Prepared By : Prof. Parth D. Joshi

L J College of Computer Applications, Vastrapur, Ahmedabad
 Model Based Reflex Agents

Model based reflex agents keep track of current state of the world, using its own internal model; and then selects the
action. In the right figure, UPDATE-STATE is responsible for creating the new internal state description.

Prepared By : Prof. Parth D. Joshi

L J College of Computer Applications, Vastrapur, Ahmedabad
 Goal Based Agents
•The knowledge of the current state environment is not always sufficient to decide for an agent to what to do.

•The agent needs to know its goal which describes desirable situations.

•Goal-based agents expand the capabilities of the model-based agent by having the "goal" information.

•They choose an action, so that they can achieve the goal.

•These agents may have to consider a long sequence of possible actions before deciding whether the goal is
achieved or not. Such considerations of different scenario are called searching and planning, which makes an
agent proactive.

Prepared By : Prof. Parth D. Joshi

L J College of Computer Applications, Vastrapur, Ahmedabad
 Utility Based Agents
•These agents are similar to the goal-based agent but provide an extra component of utility measurement
which makes them different by providing a measure of success at a given state.

•Utility-based agent act based not only goals but also the best way to achieve the goal.

•The Utility-based agent is useful when there are multiple possible alternatives, and an agent has to choose in
order to perform the best action.

•The utility function maps each state to a real number to check how efficiently each action achieves the goals.

Prepared By : Prof. Parth D. Joshi

L J College of Computer Applications, Vastrapur, Ahmedabad
 Learning Agents
•A learning agent in AI is the type of agent which can learn from its past experiences, or it has learning
capabilities.

•It starts to act with basic knowledge and then able to act and adapt automatically through learning.

•A learning agent has mainly four conceptual components, which are:

•Learning element: It is responsible for making improvements by learning from environment

•Critic: Learning element takes feedback from critic which describes that how well the agent is doing with
respect to a fixed performance standard.

•Performance element: It is responsible for selecting external action

•Problem generator: This component is responsible for suggesting actions that will lead to new and
informative experiences.

•Hence, learning agents are able to learn, analyze performance, and look for new ways to improve the
performance.

Prepared By : Prof. Parth D. Joshi

L J College of Computer Applications, Vastrapur, Ahmedabad
 Learning Agents

Prepared By : Prof. Parth D. Joshi

L J College of Computer Applications, Vastrapur, Ahmedabad
 Thank You

Prepared By : Prof. Parth D. Joshi

L J College of Computer Applications, Vastrapur, Ahmedabad