Converting Your Systems Engineering Orga
Converting Your Systems Engineering Orga
Abstract. Quality control is evolving from only being Be assured, if you don't go for standardization, the
present during final inspection, into becoming an integral day will come when your customer will state "if you don't
part of the systems engineering process. This evolution is understand your systems engineering processes, I can't
being helped by the International Organization of trust you to develop my product in a cost effective
Standards (ISO) 9000 series of standards that provides a manner" (Kasser, 1995).
checklist for documenting processes and assessing their
performance. The standards do not apply to systems System engineering organizations can choose from
engineering at this time. They are however taking the several process standardization approaches, including:
place of similar Department of Defense (DoD) standards,
so there is an excellent probability that they or an C The International Council on Systems Engineering
equivalent standard will apply to systems engineering in (INCOSE) System Engineering Capability Maturity
the future. This paper describes one proposed way to Model (CMM) and other CMM=s (Sheard, 1997).
transform an organization toward compliance with the C The ISO 9001 Standard.
ISO 9001 Standard, and make an organization’s systems
engineering process more cost effective. This paper focuses on achieving certification as being
compliant with the ISO 9001 Standard. Such compliance
INTRODUCTION requires:
In today’s economic climate, the drive is toward cost
effectiveness and the focus is on reduction of waste. One C A documented process.
way of reducing waste is to perform tasks the same way C Proof that the process is performed as documented.
each time the task is implemented (Taylor, 1911). This
principle has since evolved into the concept of a The transition usually takes at least two years to
>standardized process=. Since systems engineering has complete (Hockman, Grenville, Jackson, 1994). This is
been defined as "an iterative process of top down because:
synthesis, development and operation of a real world
system that satisfies in a near optimal manner, the full C It takes time to plan and implement the changes.
range of requirements for the system@ (Eisner, 1988), the C The organization has to function in accordance with
concepts of standardized processes apply to organizations the new process for several months so that data can be
providing systems engineering services or performing collected to demonstrate compliance to the ISO 9001
systems engineering as part of a System Development Life Standard.
Cycle (SDLC). Thus, the underlying reasons for a systems
engineering organization to take the road to process In-house personnel headed by someone with authority
standardization are as follows: and credibility must implement transition. However, a
consultant is often brought in to assist with reengineering
C Reduce waste by standardizing processes within the the organization into an ISO 9001 Standard compliant
organization. mode. If such an external consultant is employed for this
C Develop and communicate an understanding of the function, the consultant must be used as a guide and
processes within the organization. mentor, not as the implementor.
th
Proceedings of the 8 Annual symposium of the INCOSE, 1998 Page 2
THE ISO 9000 SERIES OF STANDARDS provides guidance on quality management and quality
The ISO first published the 9000 Series Quality system elements.
System Standards in 1987 and subsequently published Each standard in the ISO 9000 series deals with
revised versions in 1994. These standards have been defining and documenting a product or service process.
adopted in the United States and issued as the American ISO 9001 and ISO 9002 are very similar; being
National Standards Institute/American Society for Quality contractual standards for use in a buyer-supplier
Control (ANSI/ASQC) Q9000 series standards. As the relationship.
ISO 9000 Standard states, the standards were developed
because: Advantages of ISO compliance. The advantages of
meeting the ISO 9000 Standards include (ISO 9000
ACustomer requirements are often incorporated Group, 1998) :
in >specifications=. However, specifications may
not in themselves guarantee that a customer's C Optimized company structure and operational
requirements will be met consistently, if there are integration.
any deficiencies in the organizational system to C Improved awareness of company objectives.
supply and support the product”. C Improved communications and quality of information.
C Responsibilities and authorities clearly defined.
There are five basic standards: C Improved traceability to 'root causes' of quality
problems.
C ISO 9000 (ANSI/ASQC Q9000-1-1994). Quality C Improved utilization of time and materials.
Management and Quality Assurance Standards C Formalized systems ensure consistent quality and
Guidelines. ISO 9000 explains the philosophy behind punctual delivery.
the standards and provides a road map for their C Documented systems provide useful references and
application. training tools.
C Fewer rejects, therefore, less repeated work and
C ISO 9001 (ANSI/ASQC Q9001-1994). Model for warranty costs.
Quality Assurance in Design and Development, C Errors rectified at the earliest stage and not repeated.
Production, Installation, and Servicing. ISO 9001 is C Improved relationships with customers and suppliers.
applicable when the contract specifically requires C Improved control during periods of change or growth.
design efforts and the product requirements are C Use of a recognized logo on stationery and
stated principally in performance terms or they advertisements.
need to be established. C Improved corporate quality image.
C Ability to bid for 'ISO 9000' contracts at home and
C ISO 9002 (ANSI/ASQC Q9002-1994). Model for abroad.
Quality Assurance in Production and Installation. ISO C Continuous quality assessment by experienced
9002 is applicable when the specified requirements professionals.
for a product are stated in terms of an established C Reduced number of customer audits.
design or specification. C Improved records in case of litigation.
C ISO 9003 (ANSI/ASQC Q9003-1994). Model for A study commissioned by Lloyd's Register Quality
Quality Assurance in Final Inspection and Test. ISO Assurance, a United Kingdom-based certification body
9003 is applicable in situations when the conformance that assesses quality management systems, indicated that
of the product to specifications can be shown with the benefits increase over time (Brecka, 1994). However,
adequate confidence providing that certain suppliers' the standards do not deal with the effectiveness of the
capabilities for inspection and tests conducted on process. The hope seems to be that when the process is
finished products can be satisfactorily demonstrated. documented, it will also be analyzed and improved.
C ISO 9004 (ANSI/ASQC Q9004-1-1994). Quality
Management and Quality System Elements. ISO 9004 THE ELEMENTS OF THE ISO 9001 STANDARD
presents the philosophy behind the quality program Section 4 of the ISO 9001 Standard contains 20
elements and provides guidance on how to implement Quality System Elements, which provide a checklist or
a quality program within an organization. ISO 9004 guide in the following areas:
th
Proceedings of the 8 Annual symposium of the INCOSE, 1998 Page 3
• the process for resolving the review item C Select sub-contractors on their basis to meet the
discrepancies and other outstanding issues. requirements of the sub-contract, and on their history
of past performance.
Design Control. To meet the requirements of this section, C Establish and maintain a list of acceptable sub-
the supplier must establish and maintain procedures to contractors.
control and verify the design of the product to ensure that C Ensure that every sub-contractor has a quality system.
the specified requirements are met. This section may be C Select Commercial-off-the-Shelf (COTS) component
met by developing a SEMP for the project that must suppliers on their basis to meet the need in a timely
describe: manner, and on their past performance.
C Ensure that the purchasing documentation is clear,
C Procedures to control and verify designs. concise, correct, and communicates the need in an
C The orderly transfer between stages in the SDLC. effective manner.
C Plans that identify the responsibility for the design C Ensure that the purchasing process contains a
and development activity. feedback mechanism so that purchase orders and sub-
C Activities and the resources allocated to them. contracts are reviewed before being placed.
C An Interface Control Document (ICD) between the C Verify the deliverables from a sub-contractor at
different departments in the company defining their source, namely an on-site acceptance test, prior to
organizational and technical interfaces. shipment.
C The methodology for verifying the system
requirements. Control of customer supplied product. To meet this
C The methodology for validating that the system meets section of the standard, the systems engineering contractor
the requirements. must have and follow procedures to verify, store, and
C The procedure for identification, and appropriate maintain customer supplied products for incorporation
review and approval of all changes and modifications. into the product. In government contracts, this section
deals with handling Government Furbished Equipment.
Document and Data Control. To meet the requirements These procedures must apply to software and hardware
of this section, the supplier must establish, document and elements (i.e., integrated circuits, sub-assemblies and
maintain procedures to control all documents and data that workstations).
relate to the requirements of the standard. Complying with
this section means having a documented process to: Product Identification and Traceability. To meet this
section of the standard, the systems engineering contractor
C Ensure up-to-date SDLC documents are accessible as must where appropriate, have and follow procedures to:
needed and where needed.
C Destroy obsolete SDLC documents and replace them C Identify and trace requirements from applicable
by current versions, and notify all personnel of that authorized sources.
fact. C Set up and use a configuration control system.
C Review and approve SDLC documents. C Retain manufacturing and test records.
C Incorporate the reason for changes in the SDLC
documents. These capabilities allow speedy assessment of the:
C Circulate a master list of SDLC documents, with
current revision status. C Effect of proposed changes to requirements.
C Reissue SDLC documents after a number of changes C Scope of rework or other damage control techniques
have been made, as appropriate, instead of attaching in the event of problems occurring down schedule.
change pages to the original.
Process Control. To meet this section of the standard, the
Purchasing. To meet this section of the standard, the systems engineering contractor must where appropriate,
systems engineering contractor must establish, maintain, have and follow procedures to deliver the product in a
and follow documented procedures to: cost-effective manner, under controlled conditions,
including:
th
Proceedings of the 8 Annual symposium of the INCOSE, 1998 Page 5
C Monitoring and controlling to ensure the performance C Issue a Discrepancy Report (DR) when a problem is
and appropriate tailoring of the SDLC methodology. noted at a checkpoint in the SDLC.
C Minimizing latent defects in the system. Latent C Maintain records to identify the person who approved
defects in systems engineering tend to show up as a product at a checkpoint in the SDLC.
bugs in the software, interface problems, and
performance gaps after the system has been accepted Control of Nonconforming Products. To meet this
and placed into operation. section of the standard, the systems engineering contractor
must have and follow configuration control procedures to:
Inspection and Testing. To meet this section of the
standard, the systems engineering contractor must have C Separate nonconforming products from conforming
and follow procedures to: products.
C Track DRs and their resolution.
C Inspect purchased COTS products prior to integration
in the system. This applies to software as well as Corrective and Preventative Action. To meet this
microcomputers, disk drives and other hardware section of the standard, the systems engineering contractor
elements. must have and follow procedures to:
C Be able to process a waiver of receipt inspection in
the event of urgent need. C Investigate the root cause of a DR and determine the
C Develop a test plan for the product under corrective action to be taken to prevent recurrence.
development. C Detect and eliminate potential causes of non-
C Perform in-process inspection and testing at various conformance in the process and product.
checkpoints in the SDLC. C Review the effectiveness of the proposed corrective
C Perform final acceptance test prior to handover to the action.
customer. C Maintain records of DRs and corrective actions.
C Determine the disposition in the event of non-
conformance to a test. Handling, Storage, Packaging, Preservation and
C Maintain and make use of inspection and test records. Delivery. To meet this section of the standard, the
systems engineering contractor must have and follow (as
Inspection, Measuring and Test equipment. To meet appropriate) procedures to:
this section of the standard, the systems engineering
contractor must have and follow procedures to: C Handle, store and ship the system to the customer's
location.
C Verify all hardware test equipment have the C Maintain the quality of the product after on-site
appropriate resolution to make the necessary inspection through the delivery and installation
measurements. process at the customer's location.
C Calibrate all test equipment used in measuring the C Restrict access to the product to authorized personnel
performance of the system. during the SDLC.
C Periodically check the calibration of the test
equipment. Control of Quality Records. To meet this section of the
C Test software tools to verify they have the capability standard, the systems engineering contractor must have
to make the measurement. and follow procedures to collect, maintain, and provide
C Place the software tools used to test the system under access to quality records. This requirement may be met by
configuration control. a configuration control system database.
C Maintain and make use of inspection and test records.
Internal Quality Audits. To meet this section of the
Inspection and Test Status. To meet this section of the standard, the systems engineering contractor must have
standard, the systems engineering contractor must have and follow procedures to verify the quality process,
and follow procedures to: namely:
C Maintain configuration control over the product in C A methodology for the conduction of internal audits
each stage in the SDLC. to verify conformance to the ISO 9001 Standard.
th
Proceedings of the 8 Annual symposium of the INCOSE, 1998 Page 6
C An independent evaluation of the audit results. C Appoint a project manager who is an experienced
C A review of the audit results with the personnel systems engineer with knowledge of the ISO
responsible for the activity audited. standards and certification process.
C Verification that the recommendations of the audit are C Allocate suitable resources in terms of knowledgeable
carried out. The recommendations of one audit personnel and equipment.
become additional metrics for a subsequent audit. C Ensure the project personnel have a stake in the
successful outcome of the project.
Training. To meet this section of the standard, the
systems engineering contractor must have and follow The ISO project implementation team will probably
procedures to: be working part time on this effort. This is not as bad as it
seems, because the expanded time factor will assist in
C Identify training needs. overcoming any potential resistance to the change.
C Provide appropriate training.
C Identify appropriate qualifications for the personnel This road contains a number of phases leading to
who will perform the training. intermediate milestones. The discussion that follows is a
C Maintain records of which personnel received which simplified description of one process an organization can
training courses, and when the training took place. follow to become ISO 9001 compliant.
Servicing. To meet this section of the standard, the In the spirit of applying lessons learned, statistics
systems engineering contractor must have (as appropriate) show (Hodlin, 1993):
and follow procedures to:
C Seventy percent of all companies fail the assessment
C Resolve post-delivery problems including latent the first time around.
defects. C Sixty percent of the problems are associated with the
C Maintain records of post-delivery activities. following five clauses of the standard:
C Document control.
Statistical Techniques. To meet this section of the C Design control.
standard, the systems engineering contractor must have C Purchasing.
and follow procedures to: C Inspection and test.
C Process control.
C Identify adequate statistical techniques for verifying
the acceptability of the process and product. Thus, the areas listed above represent the areas to
C Use statistical techniques for verifying the concentrate on during the performance of the ISO 9001
acceptability of the process and product. Compliance Transition Project.
C Compares the processes to the requirements in the more than just the systems engineering and test
Quality Manual to ensure that the system itself departments because of the procurement and materials
complies with its requirements. management aspects. This paper has suggested one
approach to transitioning an organization to compliance
The format of this test typically is: with the ISO 9001 Standard.