Artificial Intelligence | 1

RENAISSANCE UNIVERSITY, INDORE

SCHOOL OF COMPUTER SCIENCE
Artificial Intelligence BCA/BSC CS-403
UNIT -1
Index

Topics Page No.

Artificial intelligence Definition 2

History of AI 3

Application of AI 6

Types of AI 8

Limitation of AI 10

Advantages and Disadvantages of AI 11

Role of AI in Engineering 12

AI in daily life 13

Intelligence and Artificial Intelligence 14

Different task domains of AI 15

Programming methods 16

Intelligent Agent: Agent(Agent architecture) 17

Agent classification(Types of Agents) 21

Task environment of agent 23

School of Computer Science 1

 Artificial Intelligence | 2

RENAISSANCE UNIVERSITY, INDORE

SCHOOL OF COMPUTER SCIENCE
Artificial Intelligence BCA/BSC CS-403
Artificial intelligence Definition:-
Artificial Intelligence is composed of two words Artificial and Intelligence, where
Artificial defines "man-made," and intelligence defines "thinking power", hence AI means "a man-
made thinking power."
So, we can define AI as: "It is a branch of computer science by which we can create
intelligent machines which can behave like a human, think like humans, and able to make
decisions."

It is believed that AI is not a new technology, and some people says that as per Greek
myth, there were Mechanical men in early days which can work and behave like humans.

John McCarthy:- “The Science & Engineering of making intelligent Machines, especially for
computer programs.”

Yann Lecan:- “Our Intelligence is what make us human & AI is an extension of that quality.”

Why Artificial Intelligence?

Before Learning about Artificial Intelligence, we should know that what is the importance of
AI and why should we learn it. Following are some main reasons to learn about AI:
 With the help of AI, you can create such software or devices which can solve real-world
problems very easily and with accuracy such as health issues, marketing, traffic issues, etc.
 With the help of AI, you can create your personal virtual Assistant, such as Cortana,
Google Assistant, Siri, etc.
 With the help of AI, you can build such Robots which can work in an environment where
survival of humans can be at risk.
 AI opens a path for other new technologies, new devices, and new Opportunities.

Goals of Artificial Intelligence

Following are the main goals of Artificial Intelligence:
1. Replicate human intelligence
2. Solve Knowledge-intensive tasks
3. An intelligent connection of perception and action
4. Building a machine which can perform tasks that requires human intelligence such as:
 Proving a theorem
 Playing chess
 Plan some surgical operation
 Driving a car in traffic
5. Creating some system which can exhibit intelligent behavior, learn new things by itself,
demonstrate, explain, and can advise to its user.

School of Computer Science 2

 Artificial Intelligence | 3

RENAISSANCE UNIVERSITY, INDORE

SCHOOL OF COMPUTER SCIENCE
Artificial Intelligence BCA/BSC CS-403

History of AI:-

 Year 1941: The initial Computer, even to run a single program they need to do many
connections and it is used to be a complex task.

Maturation of Artificial Intelligence (1943-1952)

 Year 1943: The first work which is now recognized as AI was done by Warren McCulloch
and Walter pits in 1943. They proposed a model of artificial neurons.
 Year 1949: Donald Hebb demonstrated an updating rule for modifying the connection
strength between neurons. His rule is now called Hebbian learning.
 Year 1950: The Alan Turing who was an English mathematician and pioneered Machine
learning in 1950. Alan Turing publishes "Computing Machinery and Intelligence" in which
he proposed a test. The test can check the machine's ability to exhibit intelligent behavior
equivalent to human intelligence, called a Turing test.

The birth of Artificial Intelligence (1952-1956)

 Year 1955: An Allen Newell and Herbert A. Simon created the "first artificial intelligence
program "Which was named as "Logic Theorist". This program had proved 38 of 52
Mathematics theorems, and find new and more elegant proofs for some theorems.

 Year 1956: The word "Artificial Intelligence" first adopted by American Computer scientist
John McCarthy at the Dartmouth Conference. For the first time, AI coined as an academic
field.

School of Computer Science 3

 Artificial Intelligence | 4

RENAISSANCE UNIVERSITY, INDORE

SCHOOL OF COMPUTER SCIENCE
Artificial Intelligence BCA/BSC CS-403
At that time high-level computer languages such as FORTRAN, LISP, or COBOL were invented.
And the enthusiasm for AI was very high at that time.

The golden years-Early enthusiasm (1956-1974)

 Year 1966: The researchers emphasized developing algorithms which can solve
mathematical problems. Joseph Weizenbaum created the first chatbot in 1966, which was
named as ELIZA.
 Year 1972: The first intelligent humanoid robot was built in Japan which was named as
WABOT-1.

The first AI winter (1974-1980)

 The duration between years 1974 to 1980 was the first AI winter duration. AI winter
refers to the time period where computer scientist dealt with a severe shortage of funding
from government for AI researches.
 During AI winters, an interest of publicity on artificial intelligence was decreased.

A boom of AI (1980-1987)
 Year 1980: After AI winter duration, AI came back with "Expert System". Expert systems
were programmed that emulate the decision-making ability of a human expert.
 In the Year 1980, the first national conference of the American Association of Artificial
Intelligence was held at Stanford University.

The second AI winter (1987-1993)

 The duration between the years 1987 to 1993 was the second AI Winter duration.
 Again Investors and government stopped in funding for AI research as due to high cost but
not efficient result. The expert system such as XCON was very cost effective.

The emergence of intelligent agents (1993-2011)

 Year 1997: In the year 1997, IBM Deep Blue beats world chess champion, Gary Kasparov,
and became the first computer to beat a world chess champion.
 Year 2002: for the first time, AI entered the home in the form of Roomba, a vacuum
cleaner.
 Year 2006: AI came in the Business world till the year 2006. Companies like Facebook,
Twitter, and Netflix also started using AI.

Deep learning, big data and artificial general intelligence (2011-present)

 Year 2011: In the year 2011, IBM's Watson won jeopardy, a quiz show, where it had to
solve the complex questions as well as riddles. Watson had proved that it could
understand natural language and can solve tricky questions quickly.

School of Computer Science 4

 Artificial Intelligence | 5

RENAISSANCE UNIVERSITY, INDORE

SCHOOL OF COMPUTER SCIENCE
Artificial Intelligence BCA/BSC CS-403
 Year 2012: Google has launched an Android app feature "Google now", which was able to
provide information to the user as a prediction.
 Year 2014: In the year 2014, Chatbot "Eugene Goostman" won a competition in the
infamous "Turing test."
 Year 2018: The "Project Debater" from IBM debated on complex topics with two master
debaters and also performed extremely well.
 Google has demonstrated an AI program "Duplex" which was a virtual assistant and which
had taken hairdresser appointment on call, and lady on other side didn't notice that she
was talking with the machine.

Now AI has developed to a remarkable level. The concept of Deep learning, big data, and data
science are now trending like a boom. Nowadays companies like Google, Facebook, IBM, and
Amazon are working with AI and creating amazing devices. The future of Artificial Intelligence is
inspiring and will come with high intelligence.

School of Computer Science 5

 Artificial Intelligence | 6

RENAISSANCE UNIVERSITY, INDORE

SCHOOL OF COMPUTER SCIENCE
Artificial Intelligence BCA/BSC CS-403
Application of AI:-
Artificial Intelligence has various applications in today's society. It is becoming essential
for today's time because it can solve complex problems with an efficient way in multiple
industries, such as Healthcare, entertainment, finance, education, etc. AI is making our daily life
more comfortable and fast.
Following are some sectors which have the application of Artificial Intelligence:

1. AI in Astronomy
 Artificial Intelligence can be very useful to solve complex universe problems. AI
technology can be helpful for understanding the universe such as how it works, origin, etc.
2. AI in Healthcare
 In the last, five to ten years, AI becoming more advantageous for the healthcare industry
and going to have a significant impact on this industry.
 Healthcare Industries are applying AI to make a better and faster diagnosis than humans.
AI can help doctors with diagnoses and can inform when patients are worsening so that
medical help can reach to the patient before hospitalization.
3. AI in Gaming
 AI can be used for gaming purpose. The AI machines can play strategic games like chess,
where the machine needs to think of a large number of possible places.

4. AI in Finance
 AI and finance industries are the best matches for each other. The finance industry is
implementing automation, chatbot, adaptive intelligence, algorithm trading, and machine
learning into financial processes.

5. AI in Data Security
 The security of data is crucial for every company and cyber-attacks are growing very
rapidly in the digital world. AI can be used to make your data more safe and secure. Some
examples such as AEG bot, AI2 Platform,are used to determine software bug and cyber-
attacks in a better way.

6. AI in Social Media
School of Computer Science 6
 Artificial Intelligence | 7

RENAISSANCE UNIVERSITY, INDORE

SCHOOL OF COMPUTER SCIENCE
Artificial Intelligence BCA/BSC CS-403
 Social Media sites such as Facebook, Twitter, and Snapchat contain billions of user
profiles, which need to be stored and managed in a very efficient way. AI can organize and
manage massive amounts of data. AI can analyze lots of data to identify the latest trends,
hashtag, and requirement of different users.

7. AI in Travel & Transport

 AI is becoming highly demanding for travel industries. AI is capable of doing various travel
related works such as from making travel arrangement to suggesting the hotels, flights,
and best routes to the customers. Travel industries are using AI-powered chatbots which
can make human-like interaction with customers for better and fast response.

8. AI in Automotive Industry
 Some Automotive industries are using AI to provide virtual assistant to their user for
better performance. Such as Tesla has introduced TeslaBot, an intelligent virtual assistant.
 Various Industries are currently working for developing self-driven cars which can make
your journey more safe and secure.

9. AI in Robotics:
 Artificial Intelligence has a remarkable role in Robotics. Usually, general robots are
programmed such that they can perform some repetitive task, but with the help of AI, we
can create intelligent robots which can perform tasks with their own experiences without
pre-programmed.
 Humanoid Robots are best examples for AI in robotics, recently the intelligent Humanoid
robot named as Erica and Sophia has been developed which can talk and behave like
humans.

10. AI in Entertainment
 We are currently using some AI based applications in our daily life with some
entertainment services such as Netflix or Amazon. With the help of ML/AI algorithms,
these services show the recommendations for programs or shows.

11. AI in Agriculture
 Agriculture is an area which requires various resources, labor, money, and time for best
result. Now a day's agriculture is becoming digital, and AI is emerging in this field.
Agriculture is applying AI as agriculture robotics, solid and crop monitoring, predictive
analysis. AI in agriculture can be very helpful for farmers.

12. AI in E-commerce
 AI is providing a competitive edge to the e-commerce industry, and it is becoming more
demanding in the e-commerce business. AI is helping shoppers to discover associated
products with recommended size, color, or even brand.

13. AI in education:
 AI can automate grading so that the tutor can have more time to teach. AI chatbot can
communicate with students as a teaching assistant.
 AI in the future can be work as a personal virtual tutor for students, which will be
accessible easily at any time and any place.

School of Computer Science 7

 Artificial Intelligence | 8

RENAISSANCE UNIVERSITY, INDORE

SCHOOL OF COMPUTER SCIENCE
Artificial Intelligence BCA/BSC CS-403
Types of AI:-
Artificial Intelligence can be divided in various types, there are mainly two types of main
categorization which are based on capabilities and based on functionally of AI. Following is flow
diagram which explains the types of AI.

AI type-1: Based on Capabilities

1. Weak AI or Narrow AI:
 Narrow AI is a type of AI which is able to perform a dedicated task with intelligence.The
most common and currently available AI is Narrow AI in the world of Artificial
Intelligence.
 Narrow AI cannot perform beyond its field or limitations, as it is only trained for one
specific task. Hence it is also termed as weak AI. Narrow AI can fail in unpredictable ways
if it goes beyond its limits.
 Apple Siriis a good example of Narrow AI, but it operates with a limited pre-defined range
of functions.
 IBM's Watson supercomputer also comes under Narrow AI, as it uses an Expert system
approach combined with Machine learning and natural language processing.
 Some Examples of Narrow AI are playing chess, purchasing suggestions on e-commerce
site, self-driving cars, speech recognition, and image recognition.

2. General AI:
 General AI is a type of intelligence which could perform any intellectual task with
efficiency like a human.
 The idea behind the general AI to make such a system which could be smarter and think
like a human by its own.
 Currently, there is no such system exist which could come under general AI and can
perform any task as perfect as a human.
 The worldwide researchers are now focused on developing machines with General AI.
 As systems with general AI are still under research, and it will take lots of efforts and time
to develop such systems.

3. Super AI:
 Super AI is a level of Intelligence of Systems at which machines could surpass human
intelligence, and can perform any task better than human with cognitive properties. It is
an outcome of general AI.

School of Computer Science 8

 Artificial Intelligence | 9

RENAISSANCE UNIVERSITY, INDORE

SCHOOL OF COMPUTER SCIENCE
Artificial Intelligence BCA/BSC CS-403
 Some key characteristics of strong AI include capability include the ability to think, to
reason,solve the puzzle, make judgments, plan, learn, and communicate by its own.
 Super AI is still a hypothetical concept of Artificial Intelligence. Development of such
systems in real is still world changing task.

Artificial Intelligence type-2: Based on functionality

1. Reactive Machines
 Purely reactive machines are the most basic types of Artificial Intelligence.
 Such AI systems do not store memories or past experiences for future actions.
 These machines only focus on current scenarios and react on it as per possible best action.
 IBM's Deep Blue system is an example of reactive machines.
 Google's AlphaGo is also an example of reactive machines.

2. Limited Memory
 Limited memory machines can store past experiences or some data for a short period of
time.
 These machines can use stored data for a limited time period only.
 Self-driving cars are one of the best examples of Limited Memory systems. These cars can
store recent speed of nearby cars, the distance of other cars, speed limit, and other
information to navigate the road.

3. Theory of Mind
 Theory of Mind AI should understand the human emotions, people, beliefs, and be able to
interact socially like humans.
 This type of AI machines are still not developed, but researchers are making lots of efforts
and improvement for developing such AI machines.

4. Self-Awareness:-
 Self-awareness AI is the future of Artificial Intelligence. These machines will be super
intelligent, and will have their own consciousness, sentiments, and self-awareness.
 These machines will be smarter than human mind.
 Self-Awareness AI does not exist in reality still and it is a hypothetical concept.

School of Computer Science 9

 Artificial Intelligence | 10

RENAISSANCE UNIVERSITY, INDORE

SCHOOL OF COMPUTER SCIENCE
Artificial Intelligence BCA/BSC CS-403
Limitation of AI
AI has several limitations, including:

 Lack of Creativity: AI can perform tasks based on predefined algorithms or patterns but
struggles with truly creative tasks or generating entirely novel ideas.

 Ethical Concerns: AI systems may perpetuate biases present in their training data,
leading to unfair outcomes or discriminatory decisions.

 Interpretability: Deep learning models, in particular, can be difficult to interpret, making

it challenging to understand why they make certain decisions or predictions.

 Contextual Understanding: AI often struggles to grasp nuances of human language or

understand context effectively, leading to errors in understanding or generating content.

 Data Dependency: AI algorithms require large amounts of high-quality data for training,
and their performance can suffer if the data is incomplete, biased, or unrepresentative.

 Lack of Common Sense: AI lacks human-like common sense reasoning abilities, which
can lead to misunderstandings or errors in decision-making when faced with unexpected
situations.

 Security Risks: AI systems can be vulnerable to adversarial attacks, where malicious

actors manipulate inputs to deceive or mislead the AI system.

 Job Displacement: While AI can automate many tasks, it may also lead to job
displacement in certain industries, potentially exacerbating societal inequalities.

Addressing these limitations requires ongoing research and development in AI ethics,

interpretability, robustness, and human-AI collaboration.

School of Computer Science 10

 Artificial Intelligence | 11

RENAISSANCE UNIVERSITY, INDORE

SCHOOL OF COMPUTER SCIENCE
Artificial Intelligence BCA/BSC CS-403
Advantages and Disadvantages of AI
Advantages of Artificial Intelligence
Following are some main advantages of Artificial Intelligence:
 High Accuracy with less error: AI machines or systems are prone to less errors and high
accuracy as it takes decisions as per pre-experience or information.
 High-Speed: AI systems can be of very high-speed and fast-decision making; because of
that AI systems can beat a chess champion in the Chess game.
 High reliability: AI machines are highly reliable and can perform the same action multiple
times with high accuracy.
 Useful for risky areas: AI machines can be helpful in situations such as defusing a bomb,
exploring the ocean floor, where to employ a human can be risky.
 Digital Assistant: AI can be very useful to provide digital assistant to the users such as AI
technology is currently used by various E-commerce websites to show the products as per
customer requirement.
 Useful as a public utility: AI can be very useful for public utilities such as a self-driving car
which can make our journey safer and hassle-free, facial recognition for security purpose,
Natural language processing to communicate with the human in human-language, etc.

Disadvantages of Artificial Intelligence:-

 High Cost: The hardware and software requirement of AI is very costly as it requires lots of
maintenance to meet current world requirements.
 Can't think out of the box: Even we are making smarter machines with AI, but still they
cannot work out of the box, as the robot will only do that work for which they are trained,
or programmed.
 No feelings and emotions: AI machines can be an outstanding performer, but still it does
not have the feeling so it cannot make any kind of emotional attachment with human, and
may sometime be harmful for users if the proper care is not taken.
 Increase dependency on machines: With the increment of technology, people are getting
more dependent on devices and hence they are losing their mental capabilities.
 No Original Creativity: As humans are so creative and can imagine some new ideas but still
AI machines cannot beat this power of human intelligence and cannot be creative and
imaginative.

School of Computer Science 11

 Artificial Intelligence | 12

RENAISSANCE UNIVERSITY, INDORE

SCHOOL OF COMPUTER SCIENCE
Artificial Intelligence BCA/BSC CS-403
Role of AI in Engineering
AI plays a significant role in engineering across various domains:

1. Design Optimization: AI algorithms can assist engineers in optimizing designs by rapidly

exploring and evaluating numerous design options, leading to more efficient and cost-
effective solutions.
2. Predictive Maintenance: AI-powered predictive maintenance systems can monitor
equipment health in real-time, detect potential failures before they occur, and schedule
maintenance proactively, thereby reducing downtime and maintenance costs.
3. Simulation and Modeling: AI techniques such as machine learning and computational fluid
dynamics (CFD) can be used to simulate and model complex engineering systems, allowing
engineers to analyze performance, identify potential improvements, and optimize designs.
4. Robotics and Automation: AI-driven robotics and automation systems are used in
manufacturing and industrial settings to perform tasks such as assembly, welding, and
inspection with precision and efficiency.
5. Structural Health Monitoring: AI algorithms can analyze sensor data to monitor the health
and integrity of structures such as bridges, buildings, and pipelines, enabling early detection
of defects or structural weaknesses.
6. Energy Efficiency: AI can optimize energy consumption in engineering systems by
analyzing data from sensors and actuators to adjust parameters in real-time, leading to
energy savings and reduced environmental impact.
7. Supply Chain Optimization: AI can optimize supply chain operations by analyzing data to
predict demand, optimize inventory levels, and improve logistics and distribution processes.
8. Decision Support Systems: AI-powered decision support systems can assist engineers in
making informed decisions by analyzing data, identifying patterns, and providing
recommendations for action.

Overall, AI enhances the efficiency, accuracy, and innovation in engineering processes,

leading to improved performance, reduced costs, and faster time-to-market for products and
solutions.

School of Computer Science 12

 Artificial Intelligence | 13

RENAISSANCE UNIVERSITY, INDORE

SCHOOL OF COMPUTER SCIENCE
Artificial Intelligence BCA/BSC CS-403
AI in daily life

AI is increasingly integrated into various aspects of daily life, including:

1. Personal Assistants: Virtual assistants like Siri, Alexa, and Google Assistant use AI
algorithms to understand voice commands, answer questions, set reminders, and perform
tasks such as sending messages or playing music.
2. Recommendation Systems: AI powers recommendation algorithms used by platforms
like Netflix, Amazon, and Spotify to suggest movies, products, or music based on users'
preferences and past behavior.
3. Social Media: AI algorithms analyze user behavior and content to personalize news feeds,
target advertisements, detect spam or offensive content, and recommend connections or
groups.
4. Navigation and Maps: Navigation apps like Google Maps and Waze utilize AI to provide
real-time traffic updates, suggest alternate routes, and estimate arrival times based on
historical traffic data.
5. Healthcare: AI applications in healthcare include medical image analysis for diagnosis,
predictive analytics for disease prevention, virtual health assistants for patient care, and
drug discovery.
6. Smart Home Devices: AI powers smart home devices such as thermostats, security
cameras, and appliances, enabling automation, remote control, and energy efficiency.
7. Language Translation: AI-based language translation services like Google Translate use
machine learning algorithms to translate text and speech between different languages.
8. Financial Services: AI is used in financial services for fraud detection, risk assessment,
algorithmic trading, customer service chatbots, and personalized investment advice.
9. Entertainment: AI is employed in gaming for non-player character behavior, procedural
content generation, and realistic graphics rendering. It also powers music and art
generation algorithms for creative applications.
10. Autonomous Vehicles: AI technology enables self-driving cars to perceive their
environment, make decisions, and navigate safely on the road.

These examples illustrate how AI has become an integral part of daily life, enhancing
convenience, efficiency, and personalization across various domains.

School of Computer Science 13

 Artificial Intelligence | 14

RENAISSANCE UNIVERSITY, INDORE

SCHOOL OF COMPUTER SCIENCE
Artificial Intelligence BCA/BSC CS-403
Intelligence and Artificial Intelligence:-
Intelligence refers to the ability to acquire and apply knowledge, solve problems,
adapt to new situations, and learn from experience. It encompasses a wide range of cognitive
abilities, including reasoning, perception, memory, language comprehension, and creativity.
Human intelligence is highly complex and multifaceted, influenced by genetics, environment,
education, and individual experiences.

Artificial intelligence (AI), on the other hand, refers to the development of computer
systems capable of performing tasks that typically require human intelligence. AI encompasses a
broad spectrum of technologies, including machine learning, natural language processing,
computer vision, robotics, and expert systems. While AI systems may not possess human-like
consciousness or emotions, they can simulate aspects of human intelligence to varying degrees,
depending on the specific application and level of sophistication.

AI systems are designed to analyze data, recognize patterns, make decisions, and
interact with the environment in ways that mimic human cognitive processes. They can be
trained to perform specific tasks, such as image recognition, speech synthesis, language
translation, or autonomous driving, often with a level of accuracy and efficiency that surpasses
human capabilities in certain domains.

However, it's essential to recognize that AI is not a perfect replica of human

intelligence and has its limitations and challenges, including biases in data, lack of common sense
reasoning, interpretability issues, and ethical concerns. While AI has made significant
advancements in recent years, it still falls short in many aspects compared to human intelligence,
particularly in areas requiring creativity, emotional intelligence, moral judgment, and social
understanding.

School of Computer Science 14

 Artificial Intelligence | 15

RENAISSANCE UNIVERSITY, INDORE

SCHOOL OF COMPUTER SCIENCE
Artificial Intelligence BCA/BSC CS-403
Different task domains of AI:-
AI encompasses various task domains, each addressing specific challenges and
applications. Some key task domains of AI include:

1. Machine Learning: This domain focuses on developing algorithms that enable computers
to learn from data and improve their performance over time without being explicitly
programmed. Machine learning includes subfields such as supervised learning,
unsupervised learning, and reinforcement learning.

2. Natural Language Processing (NLP): NLP involves enabling computers to understand,

interpret, and generate human language. Tasks within NLP include language translation,
sentiment analysis, named entity recognition, text summarization, and question answering.

3. Computer Vision: Computer vision aims to enable computers to interpret and understand
visual information from images or videos. Tasks in computer vision include image
classification, object detection, image segmentation, facial recognition, and scene
understanding.

4. Robotics: Robotics involves designing, building, and programming physical robots to

perform various tasks autonomously or semi-autonomously. AI techniques are used in
robotics for perception, motion planning, manipulation, and human-robot interaction.

5. Knowledge Representation and Reasoning: This domain focuses on representing

knowledge in a structured format that computers can understand and reason with. Tasks
include knowledge graph construction, semantic web technologies, and logical reasoning.

6. Expert Systems: Expert systems are AI systems that emulate the decision-making ability of
human experts in specific domains. They use knowledge bases and rule-based reasoning to
provide advice, make diagnoses, or solve problems within their domain of expertise.

7. Recommender Systems: Recommender systems analyze user preferences and behavior to

recommend relevant items or content. This includes personalized recommendations for
movies, products, music, news articles, and social connections.

8. Autonomous Systems: Autonomous systems, such as self-driving cars, drones, and

unmanned aerial vehicles (UAVs), use AI algorithms to perceive their environment, make
decisions, and navigate autonomously without human intervention.

9. Generative Models: Generative models aim to generate new data samples that resemble a
given dataset. This includes tasks such as image generation, text generation, and music
composition.

10. Game Playing: AI techniques are used in game playing to develop agents capable of playing
various games, including board games (e.g., chess, Go), video games, and strategy games,
often competing against human players or other AI agents.

These are just a few examples of the diverse task domains within the field of AI, each
with its own set of challenges, techniques, and applications.
School of Computer Science 15
 Artificial Intelligence | 16

RENAISSANCE UNIVERSITY, INDORE

SCHOOL OF COMPUTER SCIENCE
Artificial Intelligence BCA/BSC CS-403
Programming methods:-
In artificial intelligence (AI), several programming methods and techniques are used
to develop intelligent systems capable of performing tasks that typically require human
intelligence. Some of the prominent programming methods in AI include:

 Symbolic AI: Also known as "classical AI" or "good old-fashioned AI," this approach involves
representing knowledge and reasoning using symbolic logic and rules. Symbolic AI systems
manipulate symbols and perform logical inference to simulate human-like reasoning. Expert
systems and rule-based systems are examples of symbolic AI approaches.
 Machine Learning: Machine learning is a subfield of AI that focuses on developing
algorithms capable of learning from data and making predictions or decisions based on that
data. Supervised learning, unsupervised learning, and reinforcement learning are common
approaches within machine learning. Programming in machine learning involves training
models on labeled data (in supervised learning), clustering data (in unsupervised learning),
or learning from rewards (in reinforcement learning).
 Deep Learning: Deep learning is a subset of machine learning that uses artificial neural
networks with multiple layers (hence the term "deep") to learn from large amounts of data.
Deep learning algorithms have demonstrated remarkable success in tasks such as image
recognition, natural language processing, and speech recognition. Programming in deep
learning involves designing and training neural network architectures, tuning hyper
parameters, and optimizing models using techniques such as backpropagation and gradient
descent.
 Evolutionary Algorithms: Evolutionary algorithms are optimization techniques inspired by
the principles of natural selection and genetics. These algorithms iteratively generate
candidate solutions, evaluate their fitness based on an objective function, and use selection,
crossover, and mutation operators to evolve better solutions over successive generations.
Genetic algorithms, genetic programming, and evolutionary strategies are examples of
evolutionary algorithms used in AI programming.
 Fuzzy Logic: Fuzzy logic is a computational paradigm that deals with reasoning under
uncertainty or vagueness. Unlike traditional binary logic, which operates with precise
true/false values, fuzzy logic allows for degrees of truth between 0 and 1. Fuzzy logic is often
used in control systems, decision-making, and pattern recognition tasks where the
boundaries between categories are fuzzy or ambiguous.
 Probabilistic Graphical Models: Probabilistic graphical models are graphical
representations of probability distributions that capture dependencies between random
variables. Bayesian networks and Markov networks are examples of probabilistic graphical
models used in AI programming to model uncertainty, make predictions, and perform
inference.
 Agent-based Systems: Agent-based systems model intelligent agents that interact with their
environment to achieve certain goals. These agents have autonomy, perception, decision-
making capabilities, and the ability to learn and adapt. Agent-oriented programming
languages and frameworks, such as Jason and Jade, are used to develop agent-based systems.
These programming methods and techniques are not mutually exclusive, and AI
systems often combine multiple approaches to solve complex problems effectively. The choice of
programming method depends on the nature of the problem, the availability of data,
computational resources, and the specific requirements of the application.

School of Computer Science 16

 Artificial Intelligence | 17

RENAISSANCE UNIVERSITY, INDORE

SCHOOL OF COMPUTER SCIENCE
Artificial Intelligence BCA/BSC CS-403
Intelligent Agent: Agent
Agents in Artificial Intelligence
An AI system can be defined as the study of the rational agent and its environment.
The agents sense the environment through sensors and act on their environment through
actuators. An AI agent can have mental properties such as knowledge, belief, intention, etc.

What is an Agent?
An agent can be anything that perceiveits environment through sensors and act upon
that environment through actuators. An Agent runs in the cycle of perceiving, thinking,
and acting. An agent can be:
 Human-Agent: A human agent has eyes, ears, and other organs which work for sensors
and hand, legs, vocal tract work for actuators.
 Robotic Agent: A robotic agent can have cameras, infrared range finder, NLP for sensors
and various motors for actuators.
 Software Agent: Software agent can have keystrokes, file contents as sensory input and act
on those inputs and display output on the screen.

Hence the world around us is full of agents such as thermostat, cellphone, camera, and even
we are also agents.

Before moving forward, we should first know about sensors, effectors, and actuators.
 Sensor: Sensor is a device which detects the change in the environment and sends the
information to other electronic devices. An agent observes its environment through
sensors.
 Actuators: Actuators are the component of machines that converts energy into motion.
The actuators are only responsible for moving and controlling a system. An actuator can
be an electric motor, gears, rails, etc.
 Effectors: Effectors are the devices which affect the environment. Effectors can be legs,
wheels, arms, fingers, wings, fins, and display screen.

School of Computer Science 17

 Artificial Intelligence | 18

RENAISSANCE UNIVERSITY, INDORE

SCHOOL OF COMPUTER SCIENCE
Artificial Intelligence BCA/BSC CS-403
Intelligent Agents:
An intelligent agent is an autonomous entity which act upon an environment using
sensors and actuators for achieving goals. An intelligent agent may learn from the environment
to achieve their goals. A thermostat is an example of an intelligent agent.

Following are the main four rules for an AI agent:

Rule 1: An AI agent must have the ability to perceive the environment.
Rule 2: The observation must be used to make decisions.
Rule 3: Decision should result in an action.
Rule 4: The action taken by an AI agent must be a rational action.

Rational Agent:
A rational agent is an agent which has clear preference, models uncertainty, and acts in a way to
maximize its performance measure with all possible actions.

A rational agent is said to perform the right things. AI is about creating rational agents to use for
game theory and decision theory for various real-world scenarios.

For an AI agent, the rational action is most important because in AI reinforcement learning
algorithm, for each best possible action, agent gets the positive reward and for each wrong
action, an agent gets a negative reward.

Note: Rational agents in AI are very similar to intelligent agents.

Rationality:-The rationality of an agent is measured by its performance measure. Rationality

can be judged on the basis of following points:
 Performance measure which defines the success criterion.
 Agent prior knowledge of its environment.
 Best possible actions that an agent can perform.
 The sequence of percepts.

Note: Rationality differs from Omniscience because an Omniscient agent knows the actual outcome
of its action and act accordingly, which is not possible in reality.

Structure of an AI Agent:- The task of AI is to design an agent program which implements the
agent function. The structure of an intelligent agent is a combination of architecture and agent
program. It can be viewed as:

Agent = Architecture + Agent program

Following are the main three terms involved in the structure of an AI agent:

 Architecture: Architecture is machinery that an AI agent executes on.

 Agent Function: Agent function is used to map a percept to an action.
f:P* → A
 Agent program: Agent program is an implementation of agent function. An agent
program executes on the physical architecture to produce function f.

School of Computer Science 18

 Artificial Intelligence | 19

RENAISSANCE UNIVERSITY, INDORE

SCHOOL OF COMPUTER SCIENCE
Artificial Intelligence BCA/BSC CS-403
PEAS Representation:- PEAS is a type of model on which an AI agent works upon. When we
define an AI agent or rational agent, then we can group its properties under PEAS representation
model. It is made up of four words:

P: Performance measure
E: Environment
A: Actuators
S: Sensors

Here performance measure is the objective for the success of an agent's behavior.
PEAS for self-driving cars:

Let's suppose a self-driving car then PEAS representation will be:

 Performance: Safety, time, legal drive, comfort
 Environment: Roads, other vehicles, road signs, pedestrian
 Actuators: Steering, accelerator, brake, signal, horn
 Sensors: Camera, GPS, speedometer, odometer, accelerometer, sonar.
Example of Agents with their PEAS representation
Performance Environment Actuators Sensors
Agent measure

1. Medical Healthy patient Patient Tests Keyboard

Diagnose Minimized cost Hospital Treatments (Entry of symptoms)
Staff

2. Vacuum Cleanness Room Wheels Camera

Cleaner Efficiency Table Brushes Dirt detection sensor
Battery life Wood floor Vacuum Extractor Cliff sensor
Security Carpet Bump Sensor
Various obstacles Infrared Wall Sensor

3. Part - Percentage of Conveyor belt with Jointed Arms Camera

picking parts in correct parts, Hand Joint angle sensors.
Robot bins. Bins

School of Computer Science 19

 Artificial Intelligence | 20

RENAISSANCE UNIVERSITY, INDORE

SCHOOL OF COMPUTER SCIENCE
Artificial Intelligence BCA/BSC CS-403
Types of AI Agents:-
Agents can be grouped into five classes based on their degree of perceived intelligence
and capability. All these agents can improve their performance and generate better action over
the time.
These are given below:
1. Simple Reflex Agent
2. Model-based reflex agent
3. Goal-based agents
4. Utility-based agent
5. Learning agent

1. Simple Reflex agent:-The Simple reflex agents are the simplest agents. These agents take
decisions on the basis of the current percepts and ignore the rest of the percept history.
 These agents only succeed in the fully observable environment.
 The Simple reflex agent does not consider any part of percepts history during their decision
and action process.
 The Simple reflex agent works on Condition-action rule, which means it maps the current
state to action. Such as a Room Cleaner agent, it works only if there is dirt in the room.
 Problems for the simple reflex agent design approach:
 They have very limited intelligence
 They do not have knowledge of non-perceptual parts of the current state
 Mostly too big to generate and to store.
 Not adaptive to changes in the environment.

2. Model-based reflex agent:-The Model-based agent can work in a partially observable

environment, and track the situation.

A model-based agent has two important factors:

 Model: It is knowledge about "how things happen in the world," so it is called a Model-
based agent.
 Internal State: It is a representation of the current state based on percept history.

These agents have the model, "which is knowledge of the world" and based on the model they
perform actions.

School of Computer Science 20

 Artificial Intelligence | 21

RENAISSANCE UNIVERSITY, INDORE

SCHOOL OF COMPUTER SCIENCE
Artificial Intelligence BCA/BSC CS-403
Updating the agent state requires information about:
 How the world evolves
 How the agent's action affects the world.

3. Goal-based agents:-
 The knowledge of the current state environment is not always sufficient to decide for an
agent to what to do.
 The agent needs to know its goal which describes desirable situations.
 Goal-based agents expand the capabilities of the model-based agent by having the "goal"
information.
 They choose an action, so that they can achieve the goal.
 These agents may have to consider a long sequence of possible actions before deciding
whether the goal is achieved or not. Such considerations of different scenario are called
searching and planning, which makes an agent proactive.

School of Computer Science 21

 Artificial Intelligence | 22

RENAISSANCE UNIVERSITY, INDORE

SCHOOL OF COMPUTER SCIENCE
Artificial Intelligence BCA/BSC CS-403
4. Utility-based agents:-
 These agents are similar to the goal-based agent but provide an extra component of utility
measurement which makes them different by providing a measure of success at a given
state.
 Utility-based agent act based not only goals but also the best way to achieve the goal.
 The Utility-based agent is useful when there are multiple possible alternatives, and an
agent has to choose in order to perform the best action.
 The utility function maps each state to a real number to check how efficiently each action
achieves the goals.

5. Learning Agents:-A learning agent in AI is the type of agent which can learn from its past
experiences, or it has learning capabilities.
It starts to act with basic knowledge and then able to act and adapt automatically through
learning.
A learning agent has mainly four conceptual components, which are:
 Learning element: It is responsible for making improvements by learning from
environment
 Critic: Learning element takes feedback from critic which describes that how well the
agent is doing with respect to a fixed performance standard.
 Performance element: It is responsible for selecting external action
 Problem generator: This component is responsible for suggesting actions that will lead to
new and informative experiences.
Hence, learning agents are able to learn, analyze performance, and look for new ways
to improve the performance.

School of Computer Science 22

 Artificial Intelligence | 23

RENAISSANCE UNIVERSITY, INDORE

SCHOOL OF COMPUTER SCIENCE
Artificial Intelligence BCA/BSC CS-403

Task environment of agent:-

Agent Environment in AI:-An environment is everything in the world which surrounds the
agent, but it is not a part of an agent itself. An environment can be described as a situation in
which an agent is present.

The environment is where agent lives, operate and provide the agent with something
to sense and act upon it. An environment is mostly said to be non-feministic.
Features of Environment

As per Russell and Norvig, an environment can have various features from the point of view of
an agent:
1. Fully observable vs Partially Observable
2. Static vs Dynamic
3. Discrete vs Continuous
4. Deterministic vs Stochastic
5. Single-agent vs Multi-agent
6. Episodic vs sequential
7. Known vs Unknown
8. Accessible vs Inaccessible
1. Fully observable vs Partially Observable:
 If an agent sensor can sense or access the complete state of an environment at each point
of time then it is a fully observable environment, else it is partially observable.
 A fully observable environment is easy as there is no need to maintain the internal state
to keep track history of the world.
 An agent with no sensors in all environments then such an environment is called
as unobservable.
2. Deterministic vs Stochastic:
 If an agent's current state and selected action can completely determine the next state of
the environment, then such environment is called a deterministic environment.
 A stochastic environment is random in nature and cannot be determined completely by
an agent.
 In a deterministic, fully observable environment, agent does not need to worry about
uncertainty.
3. Episodic vs Sequential:
 In an episodic environment, there is a series of one-shot actions, and only the current
percept is required for the action.
 However, in Sequential environment, an agent requires memory of past actions to
determine the next best actions.
4. Single-agent vs Multi-agent
 If only one agent is involved in an environment, and operating by itself then such an
environment is called single agent environment.
 However, if multiple agents are operating in an environment, then such an environment
is called a multi-agent environment.
 The agent design problems in the multi-agent environment are different from single
agent environment.

School of Computer Science 23

 Artificial Intelligence | 24

RENAISSANCE UNIVERSITY, INDORE

SCHOOL OF COMPUTER SCIENCE
Artificial Intelligence BCA/BSC CS-403
5. Static vs Dynamic:
 If the environment can change itself while an agent is deliberating then such environment
is called a dynamic environment else it is called a static environment.
 Static environments are easy to deal because an agent does not need to continue looking
at the world while deciding for an action.
 However for dynamic environment, agents need to keep looking at the world at each
action.
 Taxi driving is an example of a dynamic environment whereas Crossword puzzles are an
example of a static environment.

6. Discrete vs Continuous:
 If in an environment there are a finite number of percepts and actions that can be
performed within it, then such an environment is called a discrete environment else it is
called continuous environment.
 A chess gamecomes under discrete environment as there is a finite number of moves that
can be performed.
 A self-driving car is an example of a continuous environment.

7. Known vs Unknown
 Known and unknown are not actually a feature of an environment, but it is an agent's
state of knowledge to perform an action.
 In a known environment, the results for all actions are known to the agent. While in
unknown environment, agent needs to learn how it works in order to perform an action.
 It is quite possible that a known environment to be partially observable and an Unknown
environment to be fully observable.

8. Accessible vs Inaccessible:-
 If an agent can obtain complete and accurate information about the state's environment,
then such an environment is called an Accessible environment else it is called
inaccessible.
 An empty room whose state can be defined by its temperature is an example of an
accessible environment.
 Information about an event on earth is an example of Inaccessible environment.

School of Computer Science 24