Scribd
Upload
643 views3 pages

Chapter 17 Exercise

This document contains problems about Markov chains. It covers determining steady-state probabilities and long-run fractions of time in each state for various Markov chains. It also includes problems about mean first passage times, modeling real-world systems as Markov chains, and using Markov chains to analyze topics like customer purchasing behavior, a student's progression through college, and air pollution levels across cities.

Uploaded by

asdf
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOC, PDF, TXT or read online on Scribd
643 views3 pages

Chapter 17 Exercise

This document contains problems about Markov chains. It covers determining steady-state probabilities and long-run fractions of time in each state for various Markov chains. It also includes problems about mean first passage times, modeling real-world systems as Markov chains, and using Markov chains to analyze topics like customer purchasing behavior, a student's progression through college, and air pollution levels across cities.

Uploaded by

asdf
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOC, PDF, TXT or read online on Scribd
You are on page 1/ 3

Markov Chains

Section 19.5 (p.940)


1.Find the steady-state probabilities for Problem 1 of section 17.3.
2.For the gambler's ruin problem, why is it unreasonable to talk about steady-state
probabilities?
3.For each of the following Markov chains, determine the long-run fraction of the time
that each state will be occupied.

(a)

2
3
1
2

1
3
1
2

0.8

(b) 0
0.8

0 .2
0 .2
0 .2

0
0.8
0

(c)Find all mean first passage times for part (b).

4.At the beginning of each year, my car is in good, fair, or broken-down condition. A
good car will be good at the beginning of next year with probability .85; fair with
probability .10; or broken-down with probability .05. A fair car will be fair at the
beginning of the next year with Probability .70 or broken-down with probability .30. It
costs $6,000 to purchase a good car; a fair car can be traded in for $2,000; and a
broken-down car has no trade-in value and must immediately be replaced by a good
car. It costs $1,000 per year to operate a good car and $1,500 to operate a fair car.
Should I replace my car as soon as it becomes a fair car, or should I drive my car until
it breaks down? Assume that the cost of operating a car during a year depends on the
type of car on hand at the beginning of the year (after a new car, if any, arrives).
5. A square matrix is said to be doubly stochastic if its entries are all nonnegative and
the entries in each row and each column sum to 1. For any ergodic, doubly stochastic
matrix, show that all states have the same steady-state probability.
6. This problem will show why steady-state probabilities are sometimes referred to as
stationary probabilities. Let probabilities for 1, 2 s,. ergodic chain with transition
matrix P. Also suppose that with probabilityi, the Markov chain begins in state i.
(a).What is the probability that after one transition, the system will be in state i?
(Hint: Use Equation (8).)
(b) For any value of n (n = 1,2, ...), what is the probability that a Markov chain will be
in state i after n transitions?
(c) Why are steady-state probabilities sometimes called stationary probabilities?
7 Consider two stocks. Stock 1 always sells for $10 or $20. If stock 1 is selling for $10
today, there is a .80 chance that it will sell for $10 tomorrow. If it is selling for $20
today, there is a .90 chance that it will sell for $20 tomorrow. Stock 2 always sells for
$10 or $25. If stock 2 sells today for $10, there is a .90 chance that it will sell
tomorrow for $10. If it sells today for $25, there is a .85 chance that it will sell
tomorrow for $25. ON the average, which stock will sell for a higher price? Find and
interrupt all mean first Passage times.
8.Three balls are divided between two containers. During each period a ball is randomly
chosen and switched to the other container.
(a) Find (in the steady state) the fraction of the time that a container will contain
0,1,2 or 3 balls.
(b) If container 1 contains no balls, on the average how many periods will go by

before it again contains no balls? (NoteThis is special case of the Ehrenfest Diffusion
model, which is used in biology to model diffusion through a membrane)
9.Two type of squirrelsgray and blackhave been seen in Pine Valley. At the beginning
of each year, we determine which of the following is true:
Gray Black Both Neither
.2 .05 .05
Gray .7
There are only gray squirrels in Pine Valley.
.2 .6 .1 .1
Black
There are only black squirrels in Pine Valley.

.1 .8
0
Both .1
There are both gray and black squirrels in Pine Valley.

.8
Neithe .05 .05 .1
There are no squirrels in Pine Valley.
Over the course of many year, the following transition matrix has been estimated.
(a) During what fraction of yeas will gray squirrels living in Pine Valley?
(b) During what fraction of yeas will black squirrels living in Pine Valley?

Section 19.6 (p.947)


1.The State College admissions office had modeled the path of a student through State
College as a Markov Chain.
Freshman
Freshman

Sophomore

Junior

Senior

Quits

Graduates

.10

.08

.10

Sophomore

.10

.85

.05

Junior

.15

.80

.05

Senior

.10

.05

.85

Quits

Graduates

Each students state is observed at the beginning of each fall semester


(a)If a student enters State College as a freshman, how many years can he expect to
spend as a student at State?
(b)What is the probability that a freshman graduates?
2.The Herald Tribble has obtained the following information about its subscribers: During
the first year as subscribers, 20% of all subscribers cancel their subscriptions. Of
those who have subscribed for one year, 10% cancel during the second year. Of those
who have been subscribing for more than two years, 4% will cancel during any giving
year. On the average, how long does a subscriber subscribe to the Herald Tribble ?
3.A forest consists of two types of trees: those that are 0-5 ft and those that are taller
than 5 ft. Each year, 40% of all 0-5-ft tall tree die, 10% are sold for $20 each, 30%
stay between 0 and 5 ft, and 20% grow to be more than 5 ft. Each year, 50% of all
trees taller than 5 ft are sold for $50, 20% are sold for $30, and 30% remain in the
forest.
(a)What is the probability that a 0-5-ft tall tree will die before being sold?
(b)If a tree(less than 5 ft) is planted, what is the expected revenue earned from that
tree?
4. Absorbing Markov chains are used in marketing to model the probability that a
customer who is contacted by telephone will eventually buy a product. Consider a
prospective customer who has never been called about purchasing a product. After one
call, there is a 60% chance that the customer will express a low degree of interest in the

product, a 30% chance of a high degree of interest, and a 10% chance the customer will
be deleted from the companys list of prospective customers. Consider a customer who
currently expresses a low degree of interest in the product. After another call, there is a
30% chance that the customer will purchase the product, a 20% chance the person will
be deleted from the list, a 30% chance that the customer will still possess a low degree
of interest, and a 20% chance that a customer will express a high degree of interest.
Consider a customer who currently expresses a high degree of interest in the product.
After another call, there is a 50% chance that the customer will have purchased the
product, a 40% chance that the customer will still have purchased the product, a 40%
chance that the customer will still have a high degree of interest, and a 10% chance
that the customer will have a low degree of interest.
(a)What is the probability that a new prospective customer will eventually purchase the
product?
(b) What is the probability that a low-interest prospective customer will ever be deleted
from the list?
(c)On the average, how many times will a new prospective customer be called before
either purchasing the product or being deleted from the list?

Section 19.7 (p.953)


1.Refer to Problem 1 of section 19.6. Suppose that each year, State College admits
7,000 freshman, 500 sophomore transfers, and 500 junior transfers. In the long run,
what will be the composition of the State College student body?
2.In Example 9, suppose that advances in the medical science have reduced the annual
death rate for retired people from 5% to 3%. By how much would this increase the
annual pension contribution that a working adult would have to make to the pension
fund?
3.New York City produces 1,000 tons of air pollution per day, Jersey City 100 tons, and
Newark 50 tons. Each day, 1/3 of New Yorks pollution is blown to Newark,
1/3dissipates, and 1/3remains in the New York. Each day, 1/3 of Jersey Citys
pollution is blown to New York, 1/3 stay in Jersey City, and 1/3is blown to Newark.
Each day, 1/3 Newarks pollution stays in Newark, and the rest is blown to Jersey City.
On a typical day, which city will be the most polluted?

You might also like

pFad - Phonifier reborn

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.


Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy