Applications of Sequences and Limits
Applications of Sequences and Limits
Modules in
Undergraduate Applications of
Mathematics
and Its
Sequences and
Applications Limits in Calculus
Published in Yves Nievergelt
cooperation with
1.5 x 10–12
The Mathematical
1 x 10–12
Association of America,
5 x 10–13
U0 X W0
The National Council 0.00001
2 x 10–6 4 x 10–6 6 x 10–6 8 x 10–6
of Teachers of –5 x 10–13
Mathematics, –1 x 10–12
F
–1.5 x 10–12
The American
Mathematical
Association of
Two-Year Colleges,
The American
Statistical Association.
Applications of Precalculus,
Calculus, and Analysis
to Chemistry and Finance
COMAP, Inc., Suite 210, 57 Bedford Street, Lexington, MA 02420 (781) 862–7878
110 Tools for Teaching 1999
Tools for Teaching 1999, 109–134. Reprinted from The UMAP Journal 20 (1) (1999) 139–164.
Copyright
c 1999, 2000 by COMAP, Inc. All rights reserved.
Permission to make digital or hard copies of part or all of this work for personal or classroom use
is granted without fee provided that copies are not made or distributed for profit or commercial
advantage and that copies bear this notice. Abstracting with credit is permitted, but copyrights
for components of this work owned by others than COMAP must be honored. To copy otherwise,
to republish, to post on servers, or to redistribute to lists requires prior permission from COMAP.
Table of Contents
1. INTRODUCTION . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
4. FURTHER ISSUES . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10
5. SOLVING EQUATIONS THROUGH Regula Falsi . . . . . . . . . . . . . 12
6. CONCLUSIONS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14
1. Introduction
The mathematical concepts of “sequence” and “limit” are introduced in
calculus texts of many genres as a technicality necessary for the presentation
of such mathematical concepts as “continuity,” “derivative,” “integral,” and
“series” [Etgen 1999; Ostebee and Zorn 1997, 1998; Spivak 1980; Stewart 1995;
Strang 1991]. Consequently, if the corresponding calculus course fails to pro-
vide extensive and intensive practice with limits, then students can earn high
grades in calculus without having a clue about the nature and significance of
the concept of a limit. As evidence of students’ weak command of the concept
of limit, an informal poll of students in second term calculus and linear algebra
showed that over 93% of students do not solve the following exercise correctly:
1. Indicate whether the following statement is true or whether it is false:
“For each function f defined in an open interval containing a number T ,
if the value of f (t) gets closer and closer to a number L
as the value of t gets closer and closer to the number T ,
then limt→T f (t) = L. ”
1
114 Tools for Teaching 1999
d
1
Figure 1. d2 = 12 + 12 .
Exercises
2. Write √down an equation involving only integer arithmetic (polynomial)
with 3 as one of its solutions.
2
Applications of Sequences and Limits 115
3. Write √
down an equation involving only integer arithmetic (polynomial)
3
with 2 as one of its solutions.
fHw 0 L > 0
u0
w 0
fHu 0 L < 0
To narrow the interval, the method tests the value of f at the midpoint
u0 + w0
v0 := ,
2
where two cases may arise. (The symbol := defines the yet undefined left-hand
side in terms of the already defined right-hand side.)
• (+) If f (v0 ) ≥ 0 , then
f (u0 ) ≤ 0 ≤ f (v0 ), f (w0 ),
3
116 Tools for Teaching 1999
and the method narrows the interval to the left-hand half [u1 , w1 ] := [u0 , v0 ] .
• (−) If f (v0 ) < 0 , then
and the method narrows the interval to the right-hand half [u1 , w1 ] :=
[v0 , w0 ] .
fHxL = x 2 - 2
2 fHw 0 L > 0
u0 w 0
1 2
-1 fHu 0 L<0
4
Applications of Sequences and Limits 117
Consequently,
f (u0 ) < 0 < f (v0 ), f (w0 ),
so the shorter interval [u0 , v0 ] = [1, 3/2] may replace the longer initial
interval [u0 , w0 ] = [1, 2] ; set
u1 := u0 = 1, w1 := v0 = 3/2.
Thus, the first step yields the result [u1 , w1 ] = [1, 3/2] .
Step 2. The method of bisection then proceeds by testing f at the new
midpoint v1 :
u1 + w1 1 + 3/2
v1 := = = 5/4,
2 2
f (v1 ) = f ( 5/4) = ( 5/4)2 − 2 = 25/16 − 2 = − 7/16 < 0.
Consequently,
f (u1 ), f (v1 ) < 0 < f (w1 ),
so the shorter interval [v1 , w1 ] = [ 5/4, 3/2] may replace the longer initial
interval [u1 , w1 ] = [1, 3/2] ; set
u2 := v1 = 5/4, w2 := w1 = 3/2.
Thus, the second step yields the result [u2 , w2 ] = [ 5/4, 3/2] .
Similarly, the next few steps produce the results of Table 1.
Table 1.
Steps in the calculation, by means of bisection, of the length of the diagonal of a unit square.
n un vn wn
0 1 1.5 2
1 1 1.25 1.5
2 1.25 1.375 1.5
3 1.375 1.4375 1.5
4 1.375 1.40625 1.4375
5 1.40625 1.4140625 1.4375
6 1.4140625 1.41796875 1.421875
7 1.4140625 1.416015625 1.41796875
8 1.4140625 1.4150390625 1.416015625
9 1.4140625 1.41455078125 1.4150390625
10 1.4140625 1.414306640625 1.41455078125
.. .. .. ..
. . . .
5
118 Tools for Teaching 1999
The last line displayed shows that 1.4140 < d < 1.4146 ; thus, the bi-
section method has produced the first four decimal digits: d = 1.414 . . . .
f (un ) ≤ 0 ≤ f (wn ).
To narrow the interval, the method tests the value of f at the midpoint
un + wn
vn := ,
2
where two cases may arise.
and the interval narrows to the left-hand half [un+1 , wn+1 ] := [un , vn ] .
• (−) If f (vn ) < 0 , then
and the interval narrows to the right-hand half [un+1 , wn+1 ] := [vn , wn ] .
6
Applications of Sequences and Limits 119
u0 ≤ w0 ,
f (u0 ) ≤ 0 ≤ f (w0 ),
w0 − u0 = (w0 − u0 )/20 .
un ≤ wn ,
f (un ) ≤ 0 ≤ f (wn ),
wn − un = (w0 − u0 )/2n .
un+1 = un ≤ vn = wn+1 ,
whence
u0 ≤ · · · ≤ un ≤ un+1 ≤ vn ≤ wn+1 ≤ wn ≤ · · · ≤ w0 ,
wn+1 − un+1 = vn − un
un + wn wn − un (w0 − u0 )/2n w0 − u0
= − un = = = .
2 2 2 2n+1
un+1 = vn ≤ wn = wn+1 ,
whence
u0 ≤ · · · ≤ un ≤ un+1 ≤ vn ≤ wn+1 ≤ wn ≤ · · · ≤ w0 ,
wn+1 − un+1 = wn − vn
un + wn wn − un (w0 − u0 )/2n w0 − u0
= wn − = = = .
2 2 2 2n+1
7
120 Tools for Teaching 1999
In either case,
u0 ≤ · · · ≤ un ≤ un+1 ≤ vn ≤ wn+1 ≤ wn ≤ · · · ≤ w0 ,
f (un+1 ) ≤ 0 ≤ f (wn+1 ),
w0 − u0
wn+1 − un+1 = .
2n+1
Example 4. Consider the problem of determining in advance the number
n of steps sufficient (though perhaps not necessary) to compute to twelve
significant digits the solution d of the equation x2 − 2 = 0 from u0 := 1
and w0 := 2 . Before starting the bisection algorithm, we know that the
formula
w0 − u0 2−1 1
wn − un = n
= n = n
2 2 2
expresses the accuracy that will be achieved at the n th step. Thus, the
problem amounts to solving for n the equation
Hence
2n−1 ≥ 1012 .
Logarithms to base ten would give the solution in the form n − 1 ≥
12 log(10)/ log(2) = 12/ log(2) = 39.863 . . . , so that n ≥ 41 suffices.
However, computing a logarithm can demand more computational re-
sources than computing d . One way to find such a value of n without
logarithms is to compute powers of 2 until one of them exceeds 1012 , for
instance, 2 , 22 , 24 , 28 = 256 , 216 , 232 > 4∗109 , 232 ∗28 > 4∗109 ∗256 >
1012 , whence n − 1 = 32 + 8 = 40 and n = 41 suffices. A faster but
less conservative method is to use the inequality 24 > 10 to simplify the
problem 2n−1 ≥ 1012 into the form
8
Applications of Sequences and Limits 121
Exercises
The following four exercises provide practice using the method of bisection.
√
4. Apply the method of bisection to compute 3.
√
5. Apply the method of bisection to compute 3 2 .
√
6. Determine a number n of steps sufficient to compute 3 by the method
of bisection to twelve significant digits.
√
3
7. Determine a number n of steps sufficient to compute 2 by the method
of bisection to twelve significant digits.
The following two exercises show results from the method of bisection ap-
plied to situations that do not satisfy the conditions stated for the method of
bisection.
8. Apply the method of bisection to
x4 + x2 − 6
f (x) = 4
x − 5x2 + 6
with u0 = 1 and w0 = 2 .
9. Apply the method of bisection to
10. Apply the method of bisection to compute the positive solution v∗ of the
equation
9
122 Tools for Teaching 1999
11. Apply the method of bisection to compute the positive solution X of the
equation
14. Investigate the consequences of modifying the test so that either f (vn ) > 0
or f (vn ) ≤ 0 , instead of f (vn ) ≥ 0 or f (vn ) < 0 .
15. Investigate the consequences of requiring that f (u0 ) < 0 < f (w0 ) instead
of f (u0 ) ≤ 0 ≤ f (w0 ) .
4. Further Issues
The preceding considerations raise a first and fundamental issue, about the
precise nature of the “number” d . First, d is not a rational number.
Proposition 2. There is no rational number d such that d2 = 2 .
Proof: The main resource for this proof is the Fundamental Theorem of Arith-
metic and the associated unique prime factorization, borrowed from algebra
[Birkhoff and Mac Lane 1991, 23]. If d2 = 2 and d = p/q is rational, with
relatively prime integers p and q , then 2 = (p/q)2 , whence 2q 2 = p2 . The
unique prime factorizations of p = pr11 · · · prkk and q = q1s1 · · · qs then would
give 2q12s1 · · · q2s = 2q 2 = p2 = p2r
1 · · · pk , where the left-hand side has an
1 2rk
10
Applications of Sequences and Limits 123
odd power of 2 while the right-hand side has an even power of 2 , so that they
cannot equal each other.
Therefore, discussing the “number” d requires numbers different from the
rational numbers. What are such numbers? Essentially, the answer lies right
in the numerical experiments from the preceding examples. All a user ever
sees from d are sequences of rational numbers such as (un ) and (wn ) . Thus,
d corresponds to all the sequences produced by the bisection method (or any
√ of x − 2 = 0 ; the
2
other algorithm) in computing the nonnegative solution
collection
√ of all such sequences could be denoted by 2 . This description of
2 in terms of a collection of sequences is similar to the description of a rational
number 2/3 in terms of such equivalent fractions as 4/6 or -14/-21 . Such ways
to define real numbers are called equivalent Cauchy sequences and are outlined
in Spivak [1980, 565].
Alternatively, because all that a user ever sees from d are either rationals p/q
√
such that (p/q)2 < 2 or rationals p/q such that 2 < (p/q)2 , the “number” 2
can be defined as the set of all positive rationals
√ p/q such that 2 < (p/q)2 . All
that a digital computer ever produces for 2 is either a rational number from
that set, with 2 < (p/q)2 , or a positive rational number from its complement,
with (p/q)2 < 2 . Such ways to define real numbers are called Dedekind cuts
and are described in detail in the original source [Dedekind 1963] and in the
calculus text [Spivak 1980, 555].
Thus, whether the results from the method of bisection “converge” toward
a solution of the equation f (x) = 0 depends on both the function f and the
type of “numbers” allowed by the problem under consideration. For example,
with f (x) = x2 − 2 and real numbers in√ [u0 , w0 ] = [1, 2] , the sequences (un )
and (wn ) “converge” to the solution 2 . In contrast, working with only
rational numbers produces
√ the same sequences (un ) and (wn ) —but they fail
to converge, because 2 is not a rational number.
The mathematical concept of “convergence” of a sequence does not mean
that the terms of the sequence get closer and closer to the limit, but, rather, that
they eventually get and remain closer than any specified tolerance.
Definition 1. A sequence (vn ) converges to a limit v∗ if and only if
for every ε > 0 (the “tolerance”)
there exists an integer m such that
|vn − v∗ | < ε for every integer n > m .
11
124 Tools for Teaching 1999
The justification of the statement that “for every ε > 0 there exists an
integer m such that ε > 2−m > 0 ” depends on the definition of the real
numbers adopted in the course.
Another issue pertains to multiple zeroes. If a function f has more than one
zero inside an interval [u0 , w0 ] , then the method of bisection converges to some
zero of f , which zero depends on f , as seen in Benjamin [1987]. Moreover,
the rate at which the method of bisection converges does not depend on the
function f but depends only on the binary expansion of the selected zero
[Nievergelt 1995].
Yet another issue relates to simultaneous systems of equations. Systems of
equations with more than one real unknown require more sophisticated meth-
ods specialized to individual systems. For one complex polynomial equation
with one complex unknown, which constitutes a special case of a system of
two equations with two real unknowns, an algorithm of Herman Weyl’s works
similarly to the method of bisection, as explained by Victor Pan [1997].
Still another issue relates to the type of equation that defines a number.
Some numbers cannot be defined by polynomial equations and require equa-
tions involving nonalgebraic functions. One such number is the ratio π of the
circumference to the diameter of a circle [Lang 1965, 493–494].
A different issue relates to the accuracy obtainable in practice. In practice,
the accuracy of the results depends on the accuracy of the computations of
the values f (vn ) , in particular, whether the computer carries enough digits to
determine which of f (vn ) ≥ 0 or f (vn ) < 0 holds. Eventually, a computer’s
rounding can yield the wrong sign.
Exercises
16. Define the positive solution of x3 = 2 in terms of Dedekind cuts.
17. This exercise pertains to the issue of computability.
a) Prove that computations carried out to exactly ten decimal digits (round-
ing all intermediate arithmetic results to ten significant decimal digits)
erroneously indicate that the following quadratic equation has no real
solutions:
b) Prove that the following quadratic equation has two distinct real solu-
tions:
0.3 124 999 999 ∗ Z 2 − 0.707 106 781 1 ∗ Z + 0.4 = 0.
12
Applications of Sequences and Limits 125
this end, this section outlines the algorithm and leaves the investigations to the
exercises.
The method of false position, also called by its Latin name regula falsi, proceeds
as does the method of bisection, except for a different choice of the intermediate
points vn , which need no longer lie at the midpoint of [un , wn ] . To solve an
equation of the form
f (x) = 0,
regula falsi requires only two initial estimates u0 < w0 with
p0 := f (u0 ),
q0 := f (w0 ),
(u0 , p0 ), (w0 , q0 ),
with p0 < 0 < q0 . Therefore, the straight line through (u0 , p0 ) and (w0 , q0 )
crosses the horizontal axis at some point (v0 , 0) with u0 < v0 < w0 . Regula
falsi selects this point v0 .
Then, exactly as for the method of bisection, at least two cases may arise.
• (+) If f (v0 ) > 0 , then
Exercises
18. Design a way to specify what the algorithm does for the yet unexamined
cases f (u0 ) = 0 , f (v0 ) = 0 , and f (w0 ) = 0 .
19. Write an equation y = mv + b for the straight line through two points
(u0 , p0 ) and (w0 , q0 ) , and solve for the value v0 where the line crosses the
horizontal axis: this gives a formula for v0 in terms of u0 , p0 , w0 , q0 .
13
126 Tools for Teaching 1999
20. Imagine that you are a newly hired junior member of a scientific computing
team and that you have just received the following assignment, with results
to be reported to your boss: Locate a source in the library or elsewhere
that proves that regula falsi converges to a solution of f (x) = 0 . You may
look in the index of books in the category called “numerical analysis” under
Library of Congress Classification Numbers (“call numbers”) QA297 . . . ,
where a similar (but not quite as good) method called “secant method”
may also appear. You need not reproduce the content of the proof here.
Just name the source and report the page numbers, the authors’ full names,
the full book title, publisher, year, and the location in the library (such as
Dewey Decimal Classification Number or Library of Congress Classification
Number), so that on the sole basis of your report your boss can find this
proof very quickly.
√
21. Apply a few steps of regula falsi to compute 3 .
22. Prove that each of the sequences (un ) and (wn ) produced by regula falsi
converges to some limit in the real numbers.
23. Apply the method of regula falsi to compute the nonnegative solution X of
6. Conclusions
The mathematical concepts of sequence and limit are not only technicali-
ties necessary for other concepts; they are also concepts that arise in scientific
computing, and they form the basis for all the other concepts from calculus,
including derivatives, integrals, inverse functions, and infinite series. More-
over, the mathematical concept of limit appears to be the major philosophical
achievement of mathematics presented, distorted, or withheld, in calculus.
14
Applications of Sequences and Limits 127
Table 2.
Steps in the calculation, by means of bisection, of the real cube root of 2.
n un vn wn
0 1 1.5 2
1 1 1.25 1.5
2 1.25 1.375 1.5
3 1.25 1.3125 1.375
4 1.25 1.28125 1.3125
5 1.25 1.265625 1.28125
6 1.25 1.2578125 1.265625
7 1.2578125 1.26171875 1.265625
8 1.2578125 1.259765625 1.26171875
9 1.259765625 1.2607421875 1.26171875
10 1.259765625 1.26025390625 1.2607421875
.. .. .. ..
. . . .
√
3
The last line of the table shows that 1.259765625 < 2 < 1.2607421875 .
15
128 Tools for Teaching 1999
11.
-12
2×10
-12
1.5×10
-12
1×10
-13
5×10
U0 X W 0
2×10
-6
4×10
-6
6×10
-6
8×10
-6 0.00001
-13
-5×10
-12
-1×10
-12 F
-1.5×10
See Figure 4. Substitutions show that F (0) = −2.70883 ∗ 10−19 < 0 <
1 − 2.70883 ∗ 10−19 < F (1) . Consequently, U0 := 0 and W0 := 1 satisfy the
requirements, but from such initial values the bisection requires dozens of
steps to produce at least one exact significant digit, showing that 8.0∗10−6 <
X < 8.1∗10−6 . Additional steps give the approximation X ≈ 8.067∗10−6 .
See also Figure 4.
13. Because 8.0 ∗ 10−6 < X < 8.1 ∗ 10−6 , it follows that for an accuracy of
twelve significant digits it suffices that
( 1/2) ∗ 10−12 ∗ X > ( 1/2) ∗ 10−12 ∗ 8.0 ∗ 10−6 = 4 ∗ 10−18 ≥ (W0 − U0 )/2n .
15. With f (u0 ) < 0 < f (w0 ) , it can happen that f (vn ) = 0 at some later stage
n > 0 . This does not cause any difficulty, but it requires a special case
in the bisection algorithm, for instance, stopping the algorithm, or setting
uk := wk := vn for every k > n .
16
Applications of Sequences and Limits 129
Therefore, the proposed quadratic equation has two distinct real roots.
19. Write the two-point equation of the line, and solve for v0 where y = 0 :
y2 − y1
y − y1 = (x − x1 ),
x2 − x1
q 0 − p0
y − p0 = (x − u0 ),
w0 − u0
17
130 Tools for Teaching 1999
q 0 − p0
0 − p0 = (v0 − u0 ),
w0 − u0
w0 − u 0
−p0 ∗ = (v0 − u0 ),
q 0 − p0
w0 − u 0
u 0 − p0 ∗ = v0 .
q 0 − p0
Thus, u1 = v0 = 5/3 , and the new interval is [u1 , w1 ] = [ 5/3, 2] . Repeat the
same process:
18
Applications of Sequences and Limits 131
19
132 Tools for Teaching 1999
3. This confirms that x lies in the narrower range 8 < x < 9 , so that
8 ∗ 10−6 < X < 9 ∗ 10−6 :
6. Thus, X = 8.05 ∗ 10−6 ± 0.05 ∗ 10−6 , with a relative error less than
1% :
|X − X̃| 0.05 ∗ 10−6
< = 0.00625 = 0.625%.
|X| 8 ∗ 10−6
(The number of digits listed has nothing to do with accuracy: anyone
who insists on writing either 8.0 or 8.1 doubles the error.)
20
Applications of Sequences and Limits 133
References
Benjamin, Arthur. 1987. The bisection method. Which root? American Mathe-
matical Monthly 94 (9): 861–863.
Birkhoff, Garrett, and Saunders Mac Lane. 1977. A Survey of Modern Algebra.
4th ed. 50th anniversary 1991 printing. New York: Macmillan.
Dedekind, Richard. 1963. Essays on the Theory of Numbers. New York: Dover.
1963. (Republication of the English translation from the German published
by the Open Court Publishing Company in 1901.)
Edwards, Charles Henry. 1979. The Historical Development of the Calculus. New
York: Springer-Verlag.
Etgen, Garret, reviser. 1999. Salas and Hille’s Calculus: One and Several Variables.
8th ed. New York: Wiley.
Hungerford, Thomas W., and Richard Mercer. 1985. Precalculus Mathematics.
2nd ed. Philadelphia, PA: Saunders College Publishing.
Lang, Serge. 1965. Algebra. Reading, MA: Addison-Wesley.
Mac Lane, Saunders. 1997. On the Harvard Consortium Calculus. Notices of
the American Mathematical Society 44 (8): 893.
MacLeod, Allan J. 1984. The calculation of pH. International Journal of Mathe-
matics Education in Science and Technology 15 (6): 691–696.
Neugebauer, O. 1969. Vorlesungen über die Geschichte der antiken mathematischen
Wissenschaften. Erster Band: Vorgriechische Mathematik. 2nd ed. Berlin:
Springer-Verlag.
Nievergelt, Yves. 1995. Bisection hardly ever converges linearly. Numerische
Mathematik 70 (1995): 111–118. Reviewed in Mathematical Reviews #95k:65055.
Ostebee, Arnold, and Paul Zorn. 1997. Calculus from Graphical, Numerical, and
Symbolic Points of View. 2 vols. Fort Worth, TX: Saunders College Publishing.
. 1998. Multivariable Calculus from Graphical, Numerical, and Symbolic
Points of View. Fort Worth, TX: Saunders College Publishing.
Pan, Victor Y. 1997. Solving a polynomial equation: Some history and recent
progress. SIAM Review 39 (2): 187–220.
Pulskamp, Richard J., and James A. Delaney. 1991. Computer and Calculator
Computation of Elementary Functions. UMAP Modules in Undergraduate
Mathematics and Its Applications: Module 708. Lexington, MA: COMAP,
1991. Reprinted in The UMAP Journal 12 (1991): 315–348. Reprinted in
UMAP Modules: Tools for Teaching 1991, edited by Paul J. Campbell, 1–34.
Lexington, MA: COMAP, 1992.
Schelin, C.W. 1983. Calculator function approximation. American Mathematical
Monthly 90 (5): 317–325.
21
134 Tools for Teaching 1999
Spivak, Michael. 1980. Calculus. 2nd ed. Wilmington, DE: Publish or Perish.
Stewart, James. 1995. Calculus. 3rd ed. Pacific Grove, CA: Brooks/Cole.
Strang, Gilbert. 1991. Calculus. Wellesley, MA: Wellesley-Cambridge Press.
Wall Street Journal. 1993. Western Ed. 79 (25 August 1993): C21.
van der Waerden, Bartel Leenert. 1983. Geometry and Algebra in Ancient Civi-
lizations. New York: Springer-Verlag.
22