Artificial Intelligence

Niloy Ganguly
Professor IIT Kharagpur
 Turing Test

• (Human) judge communicates with a

human and a machine over text-only
channel.
• Both human and machine try to act
like a human.
• Judge tries to tell which is which.
• Numerous variants

image from
http://en.wikipedia.org/wiki/Turing_test
 Turing Test on Unsuspecting
Judges

• It is possible to (temporarily) fool humans

who do not realize they may be talking to a
bot

• ELIZA program [Weizenbaum 66] rephrases

partner’s statements and questions
(~psychotherapist)
 What is Artificial Intelligence
“[The automation of] activities that we associate with human
thinking, activities such as decision making, problem solving,
learning” (Bellman 1978)

“The study of mental faculties through the use of computational

models” (Charniak & McDermott, 1985)
Good Old AI Days
Representing Knowledge

• Logic

• Rules

• Semantic Graphs/Nets
 A Few Statements

• All people who are graduating are happy.

• All happy people smile.

• Someone is graduating.

• Is someone smiling? (Conclusion)

 Predicates

1. For all (x) graduating (x) → happy (x)

2. For all (x) happy (x) → smiling (x)

3. There exists (x) graduating (x)

 Rule Based Inference Example

(R1) if gas_in_engine and does not start, then

problem(spark_plugs).

(R2) if not (does not start) and not (lights_on), then

problem(battery).

(R3) if not(turns_over) and light_on, then

problem(starter).

(R4) if gas_in_tank and gas_in_carb, then gas_in_engine

 Semantic Nets

Animal
Is a
Is a
Elephant has
Nellie

Lives in head

Africa
 Hit the Wall
– Ambiguity: highly funded translation programs (Russian
to English) were good at syntactic manipulation but bad
at disambiguation

“The spirit is willing but the flesh is weak” becomes

“The vodka is good but the meat is rotten”

– Scalability/complexity: early examples were very small,

programs could not scale to bigger instances

– Limitations of representations used

AI Winter
Machine Learning
Data
 Data

一 Collection of
measurements or
observations that can be
used to train a model.
一 Can be categorical
(cats,dogs,lion,etc),
ordinal (tall, medium,
short), continuous (10-
15,15-20,20-25,...).
Data
 Machine Learning
—a field of study in artificial intelligence concerned with
the development and study of statistical algorithms that
can learn from data (seen data) and generalize to unseen
data and thus perform tasks without explicit instructions.

—“a computer program is said to learn from experience E

with respect to some task T and some performance
measure P, if its performance on T, as measured by P,
improves with experience E.” - Tom Mitchell, 1997

Emergence of Supervised Learning

 Supervised Learning
Human Perspective
– Scenario [How a child learns]
• Below are the images of cats and dogs

Cats Dogs
 Supervised Learning
Human Perspective
– Scenario [How a child learns]
• Now, we provide the child with some images and ask
the child which is what?
 Supervised Learning
Human Perspective
– Scenario [How a child learns]
• Child guesses the images are cats and dogs as shown
below.
Cats Dogs

How did a child know?

 Supervised Learning
Human Perspective
– Scenario [How a child learns]
• The child understood the features which distinguishes
dogs from cats!
Cats Eyes Dogs

Facial Features
 Supervised Learning
Model Perspective
– Model Perspective
• If we are to use a machine learning model which tells
us how to decide/classify which is a cat or dog, we train
the model on the images as shown below
Cats Dogs

Train
Machine Learning
Model
 Supervised Learning
Model Perspective
– Procedure :
• Divide Dataset into Train and Test

Training Dataset Testing Dataset

 Supervised Learning
Model Perspective
– Procedure
• Predict the classes from the Model on the images in the
similar manner
Feature
Extractor Feed Machine
Learning
Model
Predict

Cats Dogs
 Problems with
Data Annotation
– Supervised Learning requires labelled data.
– Large amounts of data available (in Zettabytes).
– Almost all are unlabelled.
– Cannot label each and every data be it image, text, audio,
video, molecules etc. Labour Intensive
– What can we do?
Unsupervised Learning
When data is unlabelled
 Unsupervised Learning
– Definition :
Type of learning where data is unlabelled/unknown and
models learn these type of data for hidden patterns or data
groupings.

– Types :
● Clustering : Discover groupings from unknown data.
Example : Spam Emails
● Association : Find out rules to express your unknown
data. Example : Recommendation System
 Unsupervised Learning
– Scenario [Human Behavior]
• Suppose your class is being ready for a group photograph and
taking positions in order of heights.
• You do not possess any prior knowledge of the heights of your
classmates.
 Unsupervised Learning
– Scenario [Human Behavior]
• You try to get into a position according to the height.
• You figure it out without being told as to where to
stand.
 Unsupervised Learning

Those who bought

this

Cluster of
Detective
Novels also bought these

Recommender Systems
Example of Unsupervised Learning
 Semi Supervised Learning

– Definition :
● Supervised Unsupervised
● Using labelled and unlabelled data for classification and
regression tasks.
● Number of labelled data is usually much less than that
of unlabelled data.
● Primarily dealing with unlabelled data.
– One such example is pseudo labelling.
Semi Supervised Learning

Books are
present, know
labels of some
and not of
others
 Semi Supervised Learning

We know the labels of these 2 books

among other books

History Chemistry

How can we get to know about the

class of other books?
 Semi Supervised Learning

History Chemistry

We use Clustering Algorithm (Unsupervised Learning) to

cluster similar books (based on content) and label them!
 Semi Supervised Learning

History Chemistry

We use Clustering Algorithm (Unsupervised Learning) to

cluster similar books (based on content) and label them!
 Semi Supervised Learning

Model Learned
Parameters

History Chemistry

We then use these labelled data and train our Model in a

Supervised Learning Manner!
 Types of Learning
Supervised Learning
Unsupervised Learning
Semi-Supervised Learning.

Ensemble Learning [combining models together]

Self Supervised Learning [how we learn language]

Reinforcement Learning [how robot learns]

 Discriminative And Generative
Tasks
— Discriminative Tasks : Classification

• Identify whether Cat or Dog

• Identify whether the next word would be noun or
pronoun.

— Generative Tasks :
• Generates sentences based on instruction.
• ChatGpt
 Generative Task is a
Discriminative Task!
Consider the well known sentence containing all the
English Alphabets -

“The quick brown fox jumps over a lazy dog”

Suppose Given

“The quick brown

The model needs to generate the entire sentence

 Generative Task is a
Discriminative Task!
Task given “The quick brown” classify which of the following words
will be the next word.
[fox, ox, tiger, ant, duck] — the model l classify “fox” as 1 and the
rest as 0.

Recursively Given “The quick brown fox”, classify which word will be
the next word — the model classify “jumps”

Given .“The quick brown fox jumps”, classify which word will be the
next word — the model will classify “over” and so on….

We observe that if a series of such Prediction (or) Classification task (or)

Discriminative Task are done, and each word predicted is appended with the
phrase and run again for Prediction, we get a sentence.
 Generative Task is a
Discriminative Task!

Et Voila! We find that Generative Task is a

Sequence of Discriminative Task!
 Outcomes of HAAI Cohort 2

➢ Concepts of Machine Learning from Basics to Advanced (Supervised,

Unsupervised, Semi supervised).
➢ Introduction to Reinforcement Learning.
➢ Concepts of Deep Learning from Basics to Advanced.
➢ Foundations of Generative AI.

➢ Hands on with Python Programming Language, Python ML tools,

Pytorch and Mathematical Foundations.
 Happy Learning!!

niloy@cse.iitkgp.ac.in
End of Slides