Scribd
Upload
17 views16 pages

AIFA 26 Bayesian Logic 140324

The document discusses Bayesian networks and conditional independence. It explains that a Bayesian network consists of nodes and directed links, and each node has a conditional probability distribution given its parents. An example network is given about a burglar alarm. The document also discusses how conditional independence allows simplifying the joint probability distribution in a Bayesian network.

Uploaded by

herewego759
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
17 views16 pages

AIFA 26 Bayesian Logic 140324

The document discusses Bayesian networks and conditional independence. It explains that a Bayesian network consists of nodes and directed links, and each node has a conditional probability distribution given its parents. An example network is given about a burglar alarm. The document also discusses how conditional independence allows simplifying the joint probability distribution in a Bayesian network.

Uploaded by

herewego759
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 16

AIFA: Reasoning Under

Uncertainty
14/03/2024

Koustav Rudra
Bayesian Network
• A set of random variables makes up the nodes of the network
• Variables may be discrete or continuous

• A set of directed links or arrows connects pairs of nodes


• Arrows represent probabilistic dependence among variables

• An arrow from X →Y indicates X is parent of Y

• Each node 𝑋! ℎ𝑎𝑠 𝑎 𝑐𝑜𝑛𝑑𝑖𝑡𝑖𝑜𝑛𝑎𝑙 𝑝𝑟𝑜𝑏𝑎𝑏𝑖𝑙𝑖𝑡𝑦 𝑑𝑖𝑠𝑡𝑟𝑖𝑏𝑢𝑡𝑖𝑜𝑛 𝑃(𝑋! |𝑃𝑎𝑟𝑒𝑛𝑡𝑠 𝑋! )


• Quantifies the effect of the parents on the node

• The graph has no directed cycles (DAG)


Example
• Burglar alarm at home
• Fairly reliable at detecting a burglary
• Responds at times to minor earthquakes

• Two neighbors, on hearing alarm, calls police


• John always calls when he hears the alarm
• But sometimes confuses the telephone ringing with the alarm and calls then too

• Mary likes loud music


• But sometimes misses the alarm altogether
Belief Network
P(B) P(E) Earthquake
Burglary 0.001 0.002

Alarm
A P(J) A P(M)
t 0.90 B E P(A) t 0.70
f 0.05 t t 0.95 f 0.01
t f 0.94
f t 0.29
JohnCalls f f 0.001 MaryCalls
Joint probability distribution
• 𝑃 𝑥! , … , 𝑥" = ∏"#$! 𝑃(𝑥# |𝑃𝑎𝑟𝑒𝑛𝑡𝑠(𝑥# ))

• 𝑃(𝐽 ∧ 𝑀 ∧ 𝐴 ∧ ~𝐵 ∧ ~𝐸)
• 𝑃 𝐽𝐴 ∗
• 𝑃 𝑀𝐴 ∗
• 𝑃 𝐴 ~𝐵 ∧ ~𝐸 ∗
• 𝑃 ~𝐵 ∗
• P(~𝐸)

• 𝑃 𝐽 ∧ 𝑀 ∧ 𝐴 ∧ ~𝐵 ∧ ~𝐸 = 0.9×0.7×0.001×0.999×0.998 = 0.00062

• 𝑃 𝐽 =?
Conditional Independence
• 𝑃 𝑥! , … , 𝑥" = 𝑃 𝑥" 𝑥"#! , … , 𝑥! 𝑃(𝑥"#! , … , 𝑥! )
• 𝑃 𝑥! , … , 𝑥" = 𝑃 𝑥" 𝑥"#! , … , 𝑥! 𝑃 𝑥"#! 𝑥"#$ , … , 𝑥! … 𝑃 𝑥$ 𝑥! 𝑃(𝑥! )
• 𝑃 𝑥! , … , 𝑥" = ∏"%&! 𝑃(𝑥% |𝑥%#! , … , 𝑥! )

• The belief network represents conditional independence:


• 𝑃 𝑥% 𝑥% , … , 𝑥! = 𝑃(𝑥% |𝑃𝑎𝑟𝑒𝑛𝑡𝑠 𝑥% )

How to construct this network?


Conditional Independence
• 𝑃 𝐽, 𝑀, 𝐴, 𝐵, 𝐸 = 𝑃 𝐽 𝑀, 𝐴, 𝐵, 𝐸 𝑃(𝑀, 𝐴, 𝐵, 𝐸)

• 𝑃 𝐽, 𝑀, 𝐴, 𝐵, 𝐸 = 𝑃 𝐽 𝐴 𝑃 𝑀 𝐴, 𝐵, 𝐸 𝑃(𝐴, 𝐵, 𝐸)

• 𝑃 𝐽, 𝑀, 𝐴, 𝐵, 𝐸 = 𝑃 𝐽 𝐴 𝑃 𝑀 𝐴 𝑃 𝐴 𝐵, 𝐸 𝑃(𝐵, 𝐸)

• 𝑃 𝐽, 𝑀, 𝐴, 𝐵, 𝐸 = 𝑃 𝐽 𝐴 𝑃 𝑀 𝐴 𝑃 𝐴 𝐵, 𝐸 𝑃(𝐵)𝑃(𝐸)

How does ordering matter?


Conditional Independence
Conditional Independence Relation
• If every undirected path from a node in X to a node in Y is d-separated by a given set of evidence
nodes E
• X and Y are conditionally independent given E

• A set of nodes E d-separates two set of nodes X and Y if every undirected path from a node in X to
a node in Y is blocked given E
Conditional Independence Relation
• A path is blocked given a set of nodes E if there is a node Z on the path for which one of three
conditions hold:
• Z is in E and Z has one arrow on the path leading in and one arrow out
• Z is in E and Z has both path arrows leading out
• Neither Z nor any descendent of Z is in E and both path arrows lead into Z
Conditional Independence Relation: Summary
• A path is blocked given a set of nodes E if there is a X Y
Z X Y
node Z on the path for which one of three conditions
hold:
• Z is in E and Z has one arrow on the path leading
in and one arrow out Z Z
• Z is in E and Z has both path arrows leading out Z
X Y
• Neither Z nor any descendent of Z is in E and
both path arrows lead into Z
Y X
• If every undirected path from a node in X to a node in Diagnostic Causal InterCausal Mixed
Y is d-separated by a given set of evidence nodes E
• X and Y are conditionally independent given E

• A set of nodes E d-separates two set of nodes X and Y


if every undirected path from a node in X to a node in
Y is blocked given E
Conditional Independence Relation
Battery

Petrol
Radio Ignition

Starts

• Whether there is petrol and whether the radio plays are independent given evidence about whether
the ignition takes place
• Petrol and Radio are independent if it is known whether the battery works
Conditional Independence Relation
Battery

Petrol
Radio Ignition

Starts

• Petrol and Radio are independent given no evidence at all


• But they are dependent given evidence about whether the car starts
• If the car does not start, then radio works is an increase evidence that car is out of petrol
Bayesian Network: Topological Semantics
• A node is conditionally independent of its non-descendants, given its parents

B E

JohnCalls is independent of Burglary


and Earthquake given the value of Alarm
A

J M
Bayesian Network: Topological Semantics
• A node is conditionally independent of all other nodes in the network, given its
parents, children, and children’s parents
• Markov Blanket

B E

Burglary is independent of JohnCalls


and MaryCalls given the value of Alarm
A
and Earthquake

J M
Thank You

You might also like

pFad - Phonifier reborn

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.


Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy