Scribd
Upload
20 views5 pages

Lecture 02

An AI agent interacts with its environment by taking input from sensors and providing output through actuators. A rational agent aims to maximize its performance by selecting actions expected to have the best outcome based on its knowledge and percept sequence. Task environments, also called problems, are described using PEAS: the Performance measure, Environment, Actuators, and Sensors. Environments can be fully/partially observable, deterministic/stochastic, episodic/sequential, static/dynamic, discrete/continuous, and single-agent/multi-agent.

Uploaded by

lirina4508
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
20 views5 pages

Lecture 02

An AI agent interacts with its environment by taking input from sensors and providing output through actuators. A rational agent aims to maximize its performance by selecting actions expected to have the best outcome based on its knowledge and percept sequence. Task environments, also called problems, are described using PEAS: the Performance measure, Environment, Actuators, and Sensors. Environments can be fully/partially observable, deterministic/stochastic, episodic/sequential, static/dynamic, discrete/continuous, and single-agent/multi-agent.

Uploaded by

lirina4508
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 5

“AI Agent, Task Environment, Environment Type”

AI Agent: An Agent is anything that can be viewed as perceiving its environment


through sensors and acting upon that environment through actuators.

Fig 1: How Agent interact with Environment

Environment: An environment in artificial intelligence is the surrounding of the


agent. The agent takes input from the environment through sensors and delivers the
output to the environment through actuators.

Fig 2: Several Environments with their Agents


Good Behavior: Here, we will introduce the concept of Rationality.
Rationality: What is rational at any given time depends on four things:
● The performance measure that defines the criterion of success
● The agent's prior knowledge of the environment
● The actions that the agent can perform
● The agent's percept sequence to date

This leads to a definition of a rational agent:


For each possible percept sequence, a rational agent should select an action that is
expected to maximize its performance measure, given the evidence provided by the
percept sequence and whatever built-in knowledge the agent has.

Some of the related concepts are:


● Omniscience
● Learning
● Autonomy

Task Environment: Those are essentially the “Problems” to which rational


agents are the “Solutions”.
For specifying the task environment, we use the term PEAS (Performance,
Environments, Actuators, Sensors).

Fig 3: PEAS description of automatic taxi driver

Kinds of environment:
● Fully Observable vs Partially Observable
● Deterministic vs Stochastic
● Episodic vs Sequential
● Static vs Dynamic
● Discrete vs Continuous
● Single-agent vs Multi-agent

1. Fully Observable vs Partially Observable

● When an agent sensor is capable of sensing or accessing the complete state of


an agent at each point in time, it is said to be a fully observable environment
else it is partially observable
● Maintaining a fully observable environment is easy as there is no need to keep
track of the history of the surrounding area
● An environment is called unobservable when the agent has no sensors in all
environments

2. Deterministic vs Stochastic

● When a uniqueness in the agent’s current state completely determines the next
state of the agent, the environment is said to be deterministic
● The stochastic environment is random in nature which is not unique and
cannot be completely determined by the agent

3. Episodic vs Sequential

● In an Episodic task environment, each of the agent’s actions is divided into


atomic incidents or episodes. There is no dependency between current and
previous incidents. In each incident, an agent receives input from the
environment and then performs the corresponding action
● Example: Consider an example of a Pick and Place robot, which is used to
detect defective parts from the conveyor belts. Here, every time the
robot(agent) will make the decision on the current part i.e. there is no
dependency between current and previous decisions
● In a Sequential environment, the previous decisions can affect all future
decisions. The next action of the agent depends on what action he has taken
previously and what action he is supposed to take in the future
4. Dynamic vs Static

● An environment that keeps constantly changing itself when the agent is up


with some action is said to be dynamic
● A roller coaster ride is dynamic as it is set in motion and the environment
keeps changing every instant
● An idle environment with no change in its state is called a static environment
● An empty house is static as there’s no change in the surroundings when an
agent enters

5. Discrete vs Continuous

● If an environment consists of a finite number of actions that can be deliberated


in the environment to obtain the output, it is said to be a discrete environment
● The game of chess is discrete as it has only a finite number of moves. The
number of moves might vary with every game, but still, it’s finite
● The environment in which the actions are performed cannot be numbered i.e.
is not discrete, is said to be continuous
● Self-driving cars are an example of continuous environments as their actions
are driving, parking, etc. which cannot be numbered

6. Single-agent vs multi-agent

● An environment consisting of only one agent is said to be a single-agent


environment
● A person left alone in a maze is an example of the single-agent system
● An environment involving more than one agent is a multi-agent environment
● The game of football is multi-agent as it involves 11 players in each team
Fig 4: Examples of task environment and their characteristics

You might also like

pFad - Phonifier reborn

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.


Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy