STM Notes - Unit-3
STM Notes - Unit-3
Domain testing is a software testing technique in which selecting a small number of test cases
from a nearly infinite group of test cases. For testing few applications, Domain specific knowledge
plays a very crucial role.
Domain testing is a type of functional testing and tests the application by feeding interesting
inputs and evaluating its outputs.
CH.Johnwesily| wesily013@gmail.com
Unit-3 Software Testing Methodologies 2
Structural knowledge is not needed for this model - only a consistent, complete specification
of input values for each case.
We can infer that for each case there must be atleast one path to process that case.
A DOMAIN IS A SET:
An input domain is a set.
If the source language supports set definitions (E.g. PASCAL set types and C enumerated
types) less testing is needed because the compiler does much of it for us.
Domain testing does not work well with arbitrary discrete sets of data objects.
Domain for a loop-free program corresponds to a set of numbers defined over the input
vector
DOMAINS, PATHS AND PREDICATES:
In domain testing, predicates are assumed to be interpreted in terms of input vector variables.
If domain testing is applied to structure, then predicate interpretation must be based on actual
paths through the routine - that is, based on the implementation control flowgraph.
Conversely, if domain testing is applied to specifications, interpretation is based on a
specified data flowgraph for the routine; but usually, as is the nature of specifications, no
interpretation is needed because the domains are specified directly.
For every domain, there is at least one path through the routine.
There may be more than one path if the domain consists of disconnected parts or if the
domain is defined by the union of two or more domains.
Domains are defined their boundaries. Domain boundaries are also where most domain bugs
occur.
For every boundary there is at least one predicate that specifies what numbers belong to the
domain and what numbers don't.
For example, in the statement IF x>0 THEN ALPHA ELSE BETA we know that numbers
greater than zero belong to ALPHA processing domain(s) while zero and smaller numbers
belong to BETA domain(s).
A domain may have one or more boundaries - no matter how many variables define it.
For example, if the predicate is x2 + y2 < 16, the domain is the inside of a circle of radius 4
about the origin. Similarly, we could define a spherical domain with one boundary but in
three variables.
Domains are usually defined by many boundary segments and therefore by many predicates.
i.e. the set of interpreted predicates traversed on that path (i.e., the path's predicate
expression) defines the domain's boundaries.
A DOMAIN CLOSURE:
A domain boundary is closed with respect to a domain if the points on the boundary
belong to the domain.
If the boundary points belong to some other domain, the boundary is said to be open.
Figure 4.2 shows three situations for a one-dimensional domain - i.e., a domain defined
over one input variable; call it x
The importance of domain closure is that incorrect closure bugs are frequent domain
bugs. For example, x >= 0 when x > 0 was intended.
CH.Johnwesily| wesily013@gmail.com
Unit-3 Software Testing Methodologies 3
DOMAIN DIMENSIONALITY:
Every input variable adds one dimension to the domain.
One variable defines domains on a number line.
Two variables define planar domains.
Three variables define solid domains.
Every new predicate slices through previously defined domains and cuts them in half.
Every boundary slices through the input vector space with a dimensionality which is less
than the dimensionality of the space.
Thus, planes are cut by lines and points, volumes by planes, lines and points and n-spaces by
hyperplanes.
UG ASSUMPTION:
The bug assumption for the domain testing is that processing is okay but the domain
definition is wrong.
An incorrectly implemented domain means that boundaries are wrong, which may in turn
mean that control flow predicates are wrong.
Many different bugs can result in domain errors. Some of them are:
Domain Errors:
o Double Zero Representation : In computers or Languages that have a distinct positive and
negative zero, boundary errors for negative zero are common.
o Floating point zero check: A floating point number can equal zero only if the previous
definition of that number set it to zero or if it is subtracted from it self or multiplied by zero.
So the floating point zero check to be done against a epsilon value.
o Contradictory domains: An implemented domain can never be ambiguous or
contradictory, but a specified domain can. A contradictory domain specification means that
at least two supposedly distinct domains overlap.
o Ambiguous domains: Ambiguous domains means that union of the domains is incomplete.
That is there are missing domains or holes in the specified domains. Not specifying what
happens to points on the domain boundary is a common ambiguity.
o Over specified Domains: the domain can be overloaded with so many conditions that the
result is a null domain. Another way to put it is to say that the domain's path is unachievable.
o Boundary Errors: Errors caused in and around the boundary of a domain. Example,
boundary closure bug, shifted, tilted, missing, extra boundary.
o Closure Reversal: A common bug. The predicate is defined in terms of >=. The
programmer chooses to implement the logical complement and incorrectly uses <= for the
CH.Johnwesily| wesily013@gmail.com
Unit-3 Software Testing Methodologies 4
new predicate; i.e., x >= 0 is incorrectly negated as x <= 0, thereby shifting boundary values
to adjacent domains.
o Faulty Logic: Compound predicates (especially) are subject to faulty logic transformations
and improper simplification. If the predicates define domain boundaries, all kinds of domain
bugs can result from faulty logic manipulations.
RESTRICTIONS TO DOMAIN TESTING: Domain testing has restrictions, as do other
testing techniques. Some of them include:
Co-incidental Correctness: Domain testing isn't good at finding bugs for which the
outcome is correct for the wrong reasons. If we're plagued by coincidental correctness we
may misjudge an incorrect boundary. Note that this implies weakness for domain testing
when dealing with routines that have binary outcomes (i.e., TRUE/FALSE)
Representative Outcome: Domain testing is an example of partition testing. Partition-
testing strategies divide the program's input space into domains such that all inputs within a
domain are equivalent (not equal, but equivalent) in the sense that any input represents all
inputs in that domain. If the selected input is shown to be correct by a test, then processing is
presumed correct, and therefore all inputs within that domain are expected (perhaps
unjustifiably) to be correct. Most test techniques, functional or structural, fall under partition
testing and therefore make this representative outcome assumption. For example, x 2 and
2x are equal for x = 2, but the functions are different. The functional differences between
adjacent domains are usually simple, such as x + 7 versus x + 9, rather than x2 versus 2x.
Simple Domain Boundaries and Compound Predicates: Compound predicates in which
each part of the predicate specifies a different boundary are not a problem: for example, x >=
0 AND x < 17, just specifies two domain boundaries by one compound predicate. As an
example of a compound predicate that specifies one boundary, consider: x = 0 AND y >= 7
AND y <= 14. This predicate specifies one boundary equation (x = 0) but alternates closure,
putting it in one or the other domain depending on whether y < 7 or y > 14. Treat compound
predicates with respect because they’re more complicated than they seem.
Functional Homogeneity of Bugs: Whatever the bug is, it will not change the functional
form of the boundary predicate. For example, if the predicate is ax >= b, the bug will be in
the value of a or b but it will not change the predicate to ax >= b, say.
Linear Vector Space: Most papers on domain testing, assume linear boundaries - not a bad
assumption because in practice most boundary predicates are linear.
Loop Free Software: Loops are problematic for domain testing. The trouble with loops is
that each iteration can result in a different predicate expression (after interpretation), which
means a possible domain boundary change.
////////////////////////////////////////////////////////////////////////////////////////////////////
CH.Johnwesily| wesily013@gmail.com
Unit-3 Software Testing Methodologies 5
3. Systematic
4. Orthogonal
5. Consistently closed
6. Convex
7. Simply connected.
To the extent that domains have these properties domain testing is easy as testing gets.
The bug frequency is lesser for nice domain than for ugly domains.
CH.Johnwesily| wesily013@gmail.com
Unit-3 Software Testing Methodologies 6
where fi is an arbitrary linear function, X is the input vector, ki and c are constants,
and g(i,c) is a decent function over i and c that yields a constant, such as k + ic.
The first example is a set of parallel lines, and the second example is a set of systematically
(e.g., equally) spaced parallel lines (such as the spokes of a wheel, if equally spaced in
angles, systematic).
If the boundaries are systematic and if you have one tied down and generate tests for it, the
tests for the rest of the boundaries in that set can be automatically generated.
4. ORTHOGONAL BOUNDARIES:
o Two boundary sets U and V (See Figure 4.3) are said to be orthogonal if every inequality in
V is perpendicular to every inequality in U.
o If two boundary sets are orthogonal, then they can be tested independently
o In Figure 4.3 we have six boundaries in U and four in V. We can confirm the boundary
properties in a number of tests proportional to 6 + 4 = 10 (O(n)). If we tilt the boundaries to
get Figure 4.5, we must now test the intersections. We've gone from a linear number of cases
to a quadratic: from O(n) to O(n2).
CH.Johnwesily| wesily013@gmail.com
Unit-3 Software Testing Methodologies 7
UGLY DOMAINS:
CH.Johnwesily| wesily013@gmail.com
Unit-3 Software Testing Methodologies 8
Some domains are born ugly and some are uglified by bad specifications.
o
Every simplification of ugly domains by programmers can be either good or bad.
o
Programmers in search of nice solutions will "simplify" essential complexity out of
o
existence. Testers in search of brilliant insights will be blind to essential complexity and
therefore miss important cases.
o If the ugliness results from bad specifications and the programmer's simplification is
harmless, then the programmer has made ugly good.
o But if the domain's complexity is essential (e.g., the income tax code), such "simplifications"
constitute bugs.
o Nonlinear boundaries are so rare in ordinary programming that there's no information on
how programmers might "correct" such boundaries if they're essential
AMBIGUITIES AND CONTRADICTIONS:
Domain ambiguities are holes in the input space.
The holes may lie with in the domains or in cracks between domains.
Two kinds of contradictions are possible: overlapped domain specifications and overlapped
closure specifications
Figure 4.7c shows overlapped domains and Figure 4.7d shows dual closure assignment.
CH.Johnwesily| wesily013@gmail.com
Unit-3 Software Testing Methodologies 9
CH.Johnwesily| wesily013@gmail.com
Unit-3 Software Testing Methodologies 10
3.DOMAIN TESTING:
DOMAIN TESTING STRATEGY: The domain-testing strategy is simple, although possibly
tedious (slow).
1. Domains are defined by their boundaries; therefore, domain testing concentrates test points
on or near boundaries.
2. Classify what can go wrong with boundaries, then define a test strategy for each case. Pick
enough points to test for all recognized kinds of boundary errors.
3. Because every boundary serves at least two different domains, test points used to check one
domain can also be used to check adjacent domains. Remove redundant test points.
4. Run the tests and by posttest analysis (the tedious part) determine if any boundaries are
faulty and if so, how.
5. Run enough tests to verify every boundary of every domain.
DOMAIN BUGS AND HOW TO TEST FOR THEM:
An interior point (Figure 4.10) is a point in the domain such that all points within an
arbitrarily small distance (called an epsilon neighborhood) are also in the domain.
A boundary point is one such that within an epsilon neighborhood there are points both in
the domain and not in the domain.
An extreme point is a point that does not lie between any two other arbitrary but distinct
points of a (convex) domain.
CH.Johnwesily| wesily013@gmail.com
Unit-3 Software Testing Methodologies 11
Figure 4.12 shows generic domain bugs: closure bug, shifted boundaries, tilted boundaries, extra
boundary, missing boundary.
CH.Johnwesily| wesily013@gmail.com
Unit-3 Software Testing Methodologies 12
In Figure 4.13a we assumed that the boundary was to be open for A. The bug we're looking
for is a closure error, which converts > to >= or < to <= (Figure 4.13b). One test (marked x)
on the boundary point detects this bug because processing for that point will go to domain A
rather than B.
In Figure 4.13c we've suffered a boundary shift to the left. The test point we used for closure
detects this bug because the bug forces the point from the B domain, where it should be, to A
processing. Note that we can't distinguish between a shift and a closure error, but we do
know that we have a bug.
Figure 4.13d shows a shift the other way. The on point doesn't tell us anything because the
boundary shift doesn't change the fact that the test point will be processed in B. To detect
this shift we need a point close to the boundary but within A. The boundary is open,
therefore by definition, the off point is in A (Open Off Inside).
The same open off point also suffices to detect a missing boundary because what should
have been processed in A is now processed in B.
To detect an extra boundary we have to look at two domain boundaries. In this context an
extra boundary means that A has been split in two. The two off points that we selected
before (one for each boundary) does the job. If point C had been a closed boundary, the on
test point at C would do it.
For closed domains look at Figure 4.14. As for the open boundary, a test point on the
boundary detects the closure bug. The rest of the cases are similar to the open boundary,
except now the strategy requires off points just outside the domain.
CH.Johnwesily| wesily013@gmail.com
Unit-3 Software Testing Methodologies 13
CH.Johnwesily| wesily013@gmail.com
Unit-3 Software Testing Methodologies 14
CH.Johnwesily| wesily013@gmail.com
Unit-3 Software Testing Methodologies 15
For a single variable, the domain span is the set of numbers between (and including) the
o
smallest value and the largest value. For every input variable we want (at least): compatible
domain spans and compatible closures (Compatible but need not be Equal).
DOMAINS AND RANGE:
o The set of output values produced by a function is called the range of the function, in
contrast with the domain, which is the set of input values over which the function is defined.
o For most testing, our aim has been to specify input values and to predict and/or confirm
output values that result from those inputs.
o Interface testing requires that we select the output values of the calling routine i.e. caller's
range must be compatible with the called routine's domain.
o An interface test consists of exploring the correctness of the following mappings:
caller domain --> caller range (caller unit test)
caller range --> called domain (integration test)
called domain --> called range (called unit test)
CLOSURE COMPATIBILITY:
o Assume that the caller's range and the called domain spans the same numbers - for example,
0 to 17.
o Figure 4.16 shows the four ways in which the caller's range closure and the called's domain
closure can agree.
o The thick line means closed and the thin line means open. Figure 4.16 shows the four cases
consisting of domains that are closed both on top (17) and bottom (0), open top and closed
bottom, closed top and open bottom, and open top and bottom.
SPAN COMPATIBILITY:
o Figure 4.18 shows three possibly harmless span incompatibilities.
CH.Johnwesily| wesily013@gmail.com
Unit-3 Software Testing Methodologies 16
Figure 4.18: Harmless Range / Domain Span incompatibility bug (Caller Span is smaller
than Called).
o In all cases, the caller's range is a subset of the called's domain. That's not necessarily a bug.
o The routine is used by many callers; some require values inside a range and some don't. This
kind of span incompatibility is a bug only if the caller expects the called routine to validate
the called number for the caller.
o Figure 4.19a shows the opposite situation, in which the called routine's domain has a smaller
span than the caller expects. All of these examples are buggy.
CH.Johnwesily| wesily013@gmail.com
Unit-3 Software Testing Methodologies 17
o Start with the called routine's domains and generate test points in accordance to the domain-
testing strategy used for that routine in component testing.
o Unless you're a mathematical whiz you won't be able to do this without tools for more than
one variable at a time.
CH.Johnwesily| wesily013@gmail.com
Unit-3 Software Testing Methodologies 18
CH.Johnwesily| wesily013@gmail.com
Unit-3 Software Testing Methodologies 19
If X and Y represent sets of paths or path expressions, their product represents the set of paths
o
that can be obtained by following every element of X by any element of Y in all possible
ways. For example,
o X = abc + def + ghi
Y = uvw + z
Then,
XY = abcuvw + defuvw + ghiuvw + abcz + defz + ghiz
If a link or segment name is repeated, that fact is denoted by an exponent. The exponent's
value denotes the number of repetitions:
a1 = a; a2 = aa; a3 = aaa; an = aaaa . . . n times.
Similarly, if
X = abcde
then
X1 = abcde
X2 = abcdeabcde = (abcde)2
X3 = abcdeabcdeabcde = (abcde)2abcde
= abcde(abcde)2 = (abcde)3
The path product is not commutative (that is XY!=YX).
The path product is Associative.
RULE 1: A(BC)=(AB)C=ABC
where A,B,C are path names, set of path names or path expressions.
The zeroth power of a link name, path product, or path expression is also needed for
completeness. It is denoted by the numeral "1" and denotes the "path" whose length is
zero - that is, the path that doesn't have any links.
a0 = 1
X0 = 1
PATH SUMS:
The "+" sign was used to denote the fact that path names were part of the same set of paths.
The "PATH SUM" denotes paths in parallel between nodes.
Links a and b in Figure 5.1a are parallel paths and are denoted by a + b. Similarly, links c
and d are parallel paths between the next two nodes and are denoted by c + d.
The set of all paths between nodes 1 and 2 can be thought of as a set of parallel paths and
denoted by eacf+eadf+ebcf+ebdf.
If X and Y are sets of paths that lie between the same pair of nodes, then X+Y denotes the
UNION of those set of paths.
For example, in Figure 5.2:
CH.Johnwesily| wesily013@gmail.com
Unit-3 Software Testing Methodologies 20
o The product and sum operations are distributive, and the ordinary rules of multiplication
apply; that is
RULE 4: A(B+C)=AB+AC and (B+C)D=BD+CD
o Applying these rules to the below Figure 5.1a yields
o e(a+b)(c+d)f=e(ac+ad+bc+bd)f = eacf+eadf+ebcf+ebdf
ABSORPTION RULE:
o If X and Y denote the same set of paths, then the union of these sets is unchanged;
consequently,
RULE 5: X+X=X (Absorption Rule)
o If a set consists of paths names and a member of that set is added to it, the "new" name,
which is already in that set of names, contributes nothing and can be ignored.
o For example,
o if X=a+aa+abc+abcd+def then
X+a = X+aa = X+abc = X+abcd = X+def = X
It follows that any arbitrary sum of identical path expressions reduces to the same
path expression
LOOPS:
Loops can be understood as an infinite set of parallel paths. Say that the loop consists of a
single link b. then the set of all paths through that loop point is
b0+b1+b2+b3+b4+b5+..............
CH.Johnwesily| wesily013@gmail.com
Unit-3 Software Testing Methodologies 21
6.REDUCTION PROCEDURE:
REDUCTION PROCEDURE ALGORITHM:
This section presents a reduction procedure for converting a flowgraph whose links are
labeled with names into a path expression that denotes the set of all entry/exit paths in that
flowgraph. The procedure is a node-by-node removal algorithm.
The steps in Reduction Algorithm are as follows:
1. Combine all serial links by multiplying their path expressions.
2. Combine all parallel links by adding their path expressions.
3. Remove all self-loops (from any node to itself) by replacing them with a link of the form
X*, where X is the path expression of the link in that loop.
STEPS 4 - 8 ARE IN THE ALGORIHTM'S LOOP:
4. Select any node for removal other than the initial or final node. Replace it with a set of
equivalent links whose path expressions correspond to all the ways you can form a
product of the set of inlinks with the set of outlinks of that node.
5. Combine any remaining serial links by multiplying their path expressions.
6. Combine all parallel links by adding their path expressions.
7. Remove all self-loops as in step 3.
8. Does the graph consist of a single link between the entry node and the exit node? If yes,
then the path expression for that link is a path expression for the original flowgraph;
otherwise, return to step 4.
A flowgraph can have many equivalent path expressions between a given pair of nodes; that
is, there are many different ways to generate the set of all paths between two nodes without
affecting the content of that set.
The appearance of the path expression depends, in general, on the order in which nodes are
removed.
CROSS-TERM STEP (STEP 4):
The cross - term step is the fundamental step of the reduction algorithm.
It removes a node, thereby reducing the number of nodes by one.
Successive applications of this step eventually get you down to one entry and one exit node.
The following diagram shows the situation at an arbitrary node that has been selected for
removal:
CH.Johnwesily| wesily013@gmail.com
Unit-3 Software Testing Methodologies 22
In the first way, we remove the self-loop and then multiply all outgoing links by Z*.
In the second way, we split the node into two equivalent nodes, call them A and A' and put
in a link between them whose path expression is Z*. Then we remove node A' using steps 4
and 5 to yield outgoing links whose path expressions are Z*X and Z*Y.
A REDUCTION PROCEDURE - EXAMPLE:
Let us see by applying this algorithm to the following graph where we remove several nodes
in order; that is
CH.Johnwesily| wesily013@gmail.com
Unit-3 Software Testing Methodologies 23
CH.Johnwesily| wesily013@gmail.com
Unit-3 Software Testing Methodologies 24
Removing the loop and then node 6 result in the following expression:
a(bgjf)*b(c+gkh)d((ilhd)*imf(bjgf)*b(c+gkh)d)*(ilhd)*e
You can practice by applying the algorithm on the following flowgraphs and generate their
respective path expressions:
CH.Johnwesily| wesily013@gmail.com
Unit-3 Software Testing Methodologies 25
7. APPLICATIONS:
o The purpose of the node removal algorithm is to present one very generalized concept- the
path expression and way of getting it.
o Every application follows this common pattern:
1. Convert the program or graph into a path expression.
2. Identify a property of interest and derive an appropriate set of "arithmetic" rules that
characterizes the property.
3. Replace the link names by the link weights for the property of interest. The path
expression has now been converted to an expression in some algebra, such as ordinary
algebra, regular expressions, or boolean algebra. This algebraic expression summarizes
the property of interest over the set of all paths.
4. Simplify or evaluate the resulting "algebraic" expression to answer the question you
asked.
HOW MANY PATHS IN A FLOWGRAPH ?
o The question is not simple. Here are some ways you could ask it:
1. What is the maximum number of different paths possible?
2. What is the fewest number of paths possible?
3. How many different paths are there really?
4. What is the average number of paths?
o Determining the actual number of different paths is an inherently difficult problem because
there could be unachievable paths resulting from correlated and dependent predicates.
o If we know both of these numbers (maximum and minimum number of possible paths) we
have a good idea of how complete our testing is.
CH.Johnwesily| wesily013@gmail.com
Unit-3 Software Testing Methodologies 26
This arithmetic is an ordinary algebra. The weight is the number of paths in each set.
o
EXAMPLE:
The following is a reasonably well-structured program.
Each link represents a single link and consequently is given a weight of "1" to start. Lets say
the outer loop will be taken exactly four times and inner Loop Can be taken zero or three
times Its path expression, with a little work, is:
Path expression: a(b+c)d{e(fi)*fgj(m+l)k}*e(fi)*fgh
A: The flow graph should be annotated by replacing the link name with the maximum of
paths through that link (1) and also note the number of times for looping.
B: Combine the first pair of parallel loops outside the loop and also the pair in the outer
loop.
C: Multiply the things out and remove nodes to clear the clutter.
CH.Johnwesily| wesily013@gmail.com
Unit-3 Software Testing Methodologies 27
Alternatively, you could have substituted a "1" for each link in the path expression and
then simplified, as follows:
a(b+c)d{e(fi)*fgj(m+l)k}*e(fi)*fgh
= 1(1 + 1)1(1(1 x 1)31 x 1 x 1(1 + 1)1)41(1 x 1)31 x 1 x 1
= 2(131 x (2))413
= 2(4 x 2)4 x 4
= 2 x 84 x 4 = 32,768
This is the same result we got graphically.
Actually, the outer loop should be taken exactly four times. That doesn't mean it will be
taken zero or four times. Consequently, there is a superfluous "4" on the outlink in the last
step. Therefore the maximum number of different paths is 8192 rather than 32,768.
STRUCTURED FLOWGRAPH:
Structured code can be defined in several different ways that do not involve ad-hoc rules
such as not using GOTOs.
A structured flowgraph is one that can be reduced to a single link by successive application
of the transformations of Figure 5.7.
CH.Johnwesily| wesily013@gmail.com
Unit-3 Software Testing Methodologies 28
The node-by-node reduction procedure can also be used as a test for structured code.
o Flow graphs that DO NOT contain one or more of the graphs shown below (Figure 5.8) as
subgraphs are structured.
Jumping into loops
Jumping out of loops
Branching into decisions
Branching out of decisions
CH.Johnwesily| wesily013@gmail.com
Unit-3 Software Testing Methodologies 29
o The values of the weights are the number of members in a set of paths.
o EXAMPLE:
Applying the arithmetic to the earlier example gives us the identical steps unitl step 3 (C)
as below:
CH.Johnwesily| wesily013@gmail.com
Unit-3 Software Testing Methodologies 30
If you observe the original graph, it takes at least two paths to cover and that it can be done
in two paths.
If you have fewer paths in your test plan than this minimum you probably haven't covered.
It's another check.
CALCULATING THE PROBABILITY:
o Path selection should be biased toward the low - rather than the high-probability paths.
o This raises an interesting question:
o What is the probability of being at a certain point in a routine
This question can be answered under suitable assumptions, primarily that all probabilities
involved are independent, which is to say that all decisions are independent and uncorrelated.
o We use the same algorithm as before : node-by-node removal of uninteresting nodes.
CH.Johnwesily| wesily013@gmail.com
Unit-3 Software Testing Methodologies 31
In this table, in case of a loop, P A is the probability of the link leaving the loop and P L is
the probability of looping.
The rules are those of ordinary probability theory.
1. If you can do something either from column A with a probability of P A or from column
B with a probability PB, then the probability that you do either is PA + PB.
2. For the series case, if you must do both things, and their probabilities are independent
(as assumed), then the probability that you do both is the product of their probabilities.
For example, a loop node has a looping probability of P L and a probability of not looping
of PA, which is obviously equal to I - PL.
Following the above rule, all we've done is replace the outgoing probability with 1 - so why
the complicated rule? After a few steps in which you've removed nodes, combined parallel
terms, removed loops and the like, you might find something like this:
CH.Johnwesily| wesily013@gmail.com
Unit-3 Software Testing Methodologies 32
which is what we've postulated for any decision. In other words, division by 1 -
PL renormalizes the outlink probabilities so that their sum equals unity after the loop is
removed.
o EXAMPLE:
Here is a complicated bit of logic. We want to know the probability associated with cases A,
B, and C.
Let us do this in three parts, starting with case A. Note that the sum of the probabilities at
each decision node is equal to 1. Start by throwing away anything that isn't on the way to case
A, and then apply the reduction procedure. To avoid clutter, we usually leave out
probabilities equal to 1.
CASE A:
CH.Johnwesily| wesily013@gmail.com
Unit-3 Software Testing Methodologies 33
Case B is simpler:
CH.Johnwesily| wesily013@gmail.com
Unit-3 Software Testing Methodologies 34
This checks. It's a good idea when doing this sort of thing to calculate all the probabilities and
to verify that the sum of the routine's exit probabilities does equal 1.
If it doesn't, then you've made calculation error or, more likely, you've left out some
branching probability.
How about path probabilities? That's easy. Just trace the path of interest and multiply the
probabilities as you go.
Alternatively, write down the path name and do the indicated arithmetic operation.
Say that a path consisted of links a, b, c, d, e, and the associated probabilities were .2, .5,
1., .01, and I respectively. Path abcbcbcdeabddea would have a probability of 5 x 10-10.
Long paths are usually improbable.
MEAN PROCESSING TIME OF A ROUTINE:
o Given the execution time of all statements or instructions for every link in a flowgraph
and the probability for each direction for all decisions are to find the mean processing
time for the routine as a whole.
o The model has two weights associated with every link: the processing time for that link,
denoted by T, and the probability of that link P.
o The arithmetic rules for calculating the mean time:
CH.Johnwesily| wesily013@gmail.com
Unit-3 Software Testing Methodologies 35
o EXAMPLE:
1. Start with the original flow graph annotated with probabilities and
processing time.
2. Combine the parallel links of the outer loop. The result is just the mean of the processing
times for the links because there aren't any other links leaving the first node. Also combine
the pair of links at the beginning of the flowgraph..
Use the cross-term step to eliminate a node and to create the inner self - loop.
Finally, you can get the mean processing time, by using the arithmetic rules as follows:
PUSH/POP, GET/RETURN:
o This model can be used to answer several different questions that can turn up in debugging.
CH.Johnwesily| wesily013@gmail.com
Unit-3 Software Testing Methodologies 36
The numeral 1 is used to indicate that nothing of interest (neither PUSH nor POP) occurs on a
given link.
"H" denotes PUSH and "P" denotes POP. The operations are commutative, associative, and
distributive.
CH.Johnwesily| wesily013@gmail.com
Unit-3 Software Testing Methodologies 37
Below Table 5.9 shows several combinations of values for the two looping terms - M1 is the
number of times the inner loop will be taken and M2 the number of times the outer loop will
be taken.
These expressions state that the stack will be popped only if the inner loop is not taken.
The stack will be left alone only if the inner loop is iterated once, but it may also be pushed.
For all other values of the inner loop, the stack will only be pushed.
EXAMPLE 2 (GET / RETURN):
Exactly the same arithmetic tables used for previous example are used for GET / RETURN a
buffer block or resource, or, in fact, for any pair of complementary operations in which the
total number of operations in either direction is cumulative.
The arithmetic tables for GET/RETURN are:
CH.Johnwesily| wesily013@gmail.com
Unit-3 Software Testing Methodologies 38
G(G + R)G(GR)*GGR*R
= G(G + R)G3R*R
= (G + R)G3R*
= (G4 + G2)R*
This expression specifies the conditions under which the resources will be balanced on
leaving the routine.
If the upper branch is taken at the first decision, the second loop must be taken four times.
If the lower branch is taken at the first decision, the second loop must be taken twice.
For any other values, the routine will not balance. Therefore, the first loop does not have to
be instrumented to verify this behavior because its impact should be nil.
LIMITATIONS AND SOLUTIONS:
o The main limitation to these applications is the problem of unachievable paths.
o The node-by-node reduction procedure, and most graph-theory-based algorithms work well
when all paths are possible, but may provide misleading results when some paths are
unachievable.
o The approach to handling unachievable paths (for any application) is to partition the graph
into subgraphs so that all paths in each of the subgraphs are achievable.
o The resulting subgraphs may overlap, because one path may be common to several different
subgraphs.
o Each predicate's truth-functional value potentially splits the graph into two subgraphs. For n
predicates, there could be as many as 2n subgraphs.
TOP
CH.Johnwesily| wesily013@gmail.com
Unit-3 Software Testing Methodologies 39
o Let the operations be SET and RESET, denoted by s and r respectively, and we want to
know if there is a SET followed immediately a SET or a RESET followed immediately by a
RESET (an ss or an rr sequence).
o Some more application examples:
1. A file can be opened (o), closed (c), read (r), or written (w). If the file is read or written to
after it's been closed, the sequence is nonsensical. Therefore, cr and cw are anomalous.
Similarly, if the file is read before it's been written, just after opening, we may have a
bug. Therefore, or is also anomalous. Furthermore, oo and cc, though not actual bugs, are
a waste of time and therefore should also be examined.
2. A tape transport can do a rewind (d), fast-forward (f), read (r), write (w), stop (p), and
skip (k). There are rules concerning the use of the transport; for example, you cannot go
from rewind to fast-forward without an intervening stop or from rewind or fast-forward to
read or write without an intervening stop. The following sequences are
anomalous: df, dr, dw, fd, and fr. Does the flowgraph lead to anomalous sequences on any
path? If so, what sequences and under what circumstances?
3. The data-flow anomalies discussed in Unit 4 requires us to detect the dd, dk, kk,
and ku sequences. Are there paths with anomalous data flows?
THE METHOD:
o Annotate each link in the graph with the appropriate operator or the null operator 1.
o Simplify things to the extent possible, using the fact that a + a = a and 12 = 1.
o You now have a regular expression that denotes all the possible sequences of operators in
that graph. You can now examine that regular expression for the sequences of interest.
o EXAMPLE: Let A, B, C, be nonempty sets of character sequences whose smallest string is
at least one character long. Let T be a two-character string of characters. Then if T is a
substring of (i.e., if T appears within) ABnC, then T will appear in AB2C. (HUANG's
Theorem)
o As an example, let
A = pp
B = srr
C = rp
T = ss
The theorem states that ss will appear in pp(srr)nrp if it appears in pp(srr)2rp.
o However, let
A = p + pp + ps
B = psr + ps(r + ps)
C = rp
T = P4
Is it obvious that there is a p4 sequence in ABnC? The theorem states that we have only to
look at
(p + pp + ps)[psr + ps(r + ps)]2rp
Multiplying out the expression and simplifying shows that there is no p4 sequence.
o Incidentally, the above observation is an informal proof of the wisdom of looping twice
discussed in Unit 2. Because data-flow anomalies are represented by two-character
sequences, it follows the above theorem that looping twice is what you need to do to find
such anomalies.
LIMITATIONS:
o Huang's theorem can be easily generalized to cover sequences of greater length than two
characters. Beyond three characters, though, things get complex and this method has
probably reached its utilitarian limit for manual application.
CH.Johnwesily| wesily013@gmail.com
Unit-3 Software Testing Methodologies 40
o There are some nice theorems for finding sequences that occur at the beginnings and ends of
strings but no nice algorithms for finding strings buried in an expression.
o Static flow analysis methods can't determine whether a path is or is not achievable. Unless
the flow analysis includes symbolic execution or similar techniques, the impact of
unachievable paths will not be included in the analysis.
o The flow-anomaly application, for example, doesn't tell us that there will be a flow anomaly
- it tells us that if the path is achievable, then there will be a flow anomaly. Such analytical
problems go away, of course, if you take the trouble to design routines for which all paths
are achievable.
CH.Johnwesily| wesily013@gmail.com