Software Testing Foundation

Fundamentals of Testing Concepts

09/26/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 1

Lesson Objectives

 Be summarized what, why and principles of software testing

 Have chance to discuss with experience testers

09/26/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 2

AGENDA

 Session 1: What is Software Testing?

 Session 2: Why is Testing necessary?
 Session 3: Testing Principles
 Session 4: Questions & Answers

09/26/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 3

Section 1
WHAT IS SOFTWARE TESTING

09/26/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 4

Quality Views
Product’s View
 User’s view: quality is fitness
for user’s needs
Software
 Fit for use
 Product view: quality is meet
attributes of a product

p
Ga
 Manufacturer view: quality is
meet the requirements
specification
User Requirements Requirements Specification

Manufacturer’s View
User’s View
Figure 5: The Quality Triangle

09/26/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 5

What is Software Testing?

 Software Testing: is the process of exercising or evaluating a

software system or system component by manual or automated
means to verify that it satisfies specified requirements (IEEE)

 Software Testing: the process consisting of all life cycle

activities, both static and dynamic, concerned with planning,
preparation and evaluation of software product and related
work products to determine that they satisfy specified
requirements, to demonstrate that they are fit for purpose and
to detect defects (ISTQB glossary)

09/26/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 6

Software Testing Objectives

 To evaluate work products such as requirements, user stories, design,

and code
 To verify whether all specified requirements have been fulfilled
 To validate whether the test object is complete and works as the users
and other stakeholders expect
 To build confidence in the level of quality of the test object
 To prevent defects

09/26/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 7

Software Testing Objectives

 To find failures and defects

 To provide sufficient information to stakeholders to allow them to make
informed decisions, especially regarding the level of quality of the test
object
 To reduce the level of risk of inadequate software quality
 To comply with contractual, legal, or regulatory requirements or
standards
 Continuously improve the testing process

09/26/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 8

Testing vs. Debugging

TESTING DEBUGGING

Detecting a defect Fixing that defect

Done by tester Done by developer
(testing team) (development team)
Intention is to find as many Intention is to remove
defects as possible those defects

09/26/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 9

Section 2
WHY IS TESTING NECESSARY?

09/26/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 10

Why is Testing necessary?

 Because software is likely to have defects

 Can help reduce the risk of failures occurring during

operation
 To learn about the reliability of the software
 To avoid being sued by customers

 To stay in business

09/26/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 11

Defect/ Bug in Software Projects

 Error (mistake): A human action that produces an incorrect

result

 Defect(fault/bug): An imperfection or deficiency in a work

product where it does not meet its requirements or
specifications. The result of an error.

 Failure: An event in which a component or system does not

perform a required function within specified limits

09/26/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 12

Relation of Failure, Defect & Error

A person makes
an error ...

… that creates
defect(s) in the
software ...

… that can cause

failure(s)
in operation
09/26/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 13
Section 2
TESTING PRINCIPLES

09/26/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 14

P1: Testing shows Presence of defects

 Testing can show that defects are present, presence of

defects but cannot prove that there are no defects.

 Testing reduces the probability of undiscovered defects

remaining in the software but, even if no defects are found,
it is not a proof of correctness

09/26/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 15

P2: Exhaustive testing is Impossible

 Exhaustive testing = testing everything (all combinations of

inputs and preconditions) is not impossible because TIME &
COSTS will rise exponentially
 Instead of exhaustive testing, we use risks and testing
techniques to focus testing efforts

09/26/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 16

P3: Early Testing

 Testing activities should start as early as possible in the

software or system development life cycle and should be
focused on defined objectives
 Early testing such as early test design and review activities,
finds defects early on when they are cheap to find and fix.

09/26/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 17

Cost of Defect

09/26/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 18

P4: Defect Clustering

 A small number of modules contain most of the defects

discovered during pre-release testing or show the most
operational failures

09/26/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 19

P5: Pesticide Paradox

 If the same tests are repeated over and over again,

eventually the same set of test cases will no longer find any
new bugs. To overcome this 'pesticide paradox', the test
cases need to be regularly reviewed and revised, and new
and different tests need to be written to exercise different
parts of the software or system to potentially find more
defects.

09/26/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 20

P6: Testing is context dependent

 Testing is done differently in different contexts.

For example: safety-critical software is tested differently from

an e-commerce site.

09/26/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 21

P7: Absence-of-errors fallacy

 Finding and fixing defects does not help if the system

built is unusable and does not fulfill the users' needs
and expectations

09/26/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 22

Section 4
QUESTIONS & ANSWERS

09/26/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 23

Questions

• Chất lượng của 1 sản phẩm phần mềm đối với các đối tượng khác nhau thì có cái nhìn khác
nhau như thế nào?
Để tạo ra chất lượng của 1 sản phẩm, cần có những nhân tố nào?
• Có thể có những GAPs gì có thể có khi phát triển Software Product từ Requirement
Specification
• Mục tiêu của kiểm thử là gì?

• Tại sao nói 1 trong những mục tiêu của kiểm thử phần mềm là "phòng chống lỗi - defect
prevention“?
• Sự khác nhau giữa 3 thuật ngữ Error, Fault, Failure như thế nào?
• Chi phí để sửa lỗi thay đổi như thế nào?

09/26/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 24

Which Principles?

A test team consistently finds between 90% and 95% of the defect
present in the system under test. While the test manager
understands that this is a good defect detection percentage for her
test team and industry, senior management and executives remain
disappointed in the test group saying that the test team misses too
many bugs. Given that the users are generally happy with the
system and that the failures which have occurred have generally
been low impact, which of the following testing principles is most
likely to help the test manager explain to these managers and
executives why some defects are likely to be missed

09/26/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 25

Which Principles?

System test execution on a project is planned for eight weeks.

After a week of testing, a tester suggests that the test
objective stated in the test plan of 'finding as many defects as
possible during system test' might be more closely met by
redirecting the test effort according to which test principle?

09/26/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 26

Which Principles?

One tester has tested software applications running on mobile

phone for 5 years. He has great deal of information for testing
the application and is able to test faster than anyone else.
However, he has not put sufficient efforts for deriving new test
cases and modifying them to find new defects any longer,
which lead to finding less and less defects. What is the basic
test principle that he has ignored?

09/26/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 27

Which Principles?

You are running a written test which other testers have run
previously. In addition, this test has found bugs previously, and
those bugs have been confirmed to be fixed. The test
manager has encouraged you to the specific way in which you
run the test, such as the order of certain actions,.. use of
mouse versus hot-keys, and the particular input values, based
on the way users will use in the system. Which of the following
is a testing principle that could explain the test manager’s
directive?

09/26/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 28

References
 https://www.istqb.org/ , Foundations of Software Testing,
Chapter 1

09/26/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 29

Lesson Summary

 Session 1: What is Software Testing?

 Session 2: Why is testing necessary?
 Session 3: Testing Principles
 Session 4: Questions & Answers

09/26/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 30

Thank you

09/26/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 31