Aviation Instrument Flight Procedure Design Services
Aviation Instrument Flight Procedure Design Services
Manual of Standards
For Instrument Flight Procedure
Design Services
First Edition
March 2022
Published by:
Civil Aviation Authority of the
Philippines
UNCONTROLLED COPY
UNCONTROLLED COPY
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
Amendments
Number Date applicable Subject(s) Entered by
Corrigenda
Number Date applicable Subject(s) Entered by
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
TABLE OF CONTENTS
PAGE
FOREWORD…………………………………………………………………………..…… i
RECORD OF AMENDMENTS AND CORRIGENDA………….…………….…........... iii
LIST OF EFFECTIVE PAGES …………………………………………………………… v
DEFINITIONS ……………………………………………………………………………… xi
ABBREVIATIONS ………………………………………………………………………… xxi
CHAPTER 1 INTRODUCTION ……………………………………...……….…..……… 1-1
1.1 General …………………………………………………………………. 1-1
1.2 National Regulations for IFPDS ……………………………………… 1-1
1.3 Approval and Responsibilities for IFPs ……………………………… 1-2
1.4 Design Criteria …………………………………………………………. 1-2
1.5 CAAP Safety Oversight ……………………………………………….. 1-2
1.6 Safety Risk Assessment ………………………………………………. 1-3
1.7 Quality Management System ………………………………………… 1-3
1.8 Continuous Maintenance and Periodic Review …………………….. 1-3
1.9 Target Audience of the MOS for IFPDS …………………………….. 1-3
1.10 Structure of the Manual ……………………………………………….. 1-4
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
APPENDICES
APPENDIX 1 THIRD-PARTY PDSP AUTHORIZATION PROCESS …………….. APP1-1
APPENDIX 2 IFP QUALITY ASSURANCE CHECKLIST …………………………. APP2-1
APPENDIX 3 SAMPLE PDSP AUDIT PROTOCOL QUESTIONNAIRE ………… APP3-1
APPENDIX 4 SAMPLE PRE-IMPLEMENTATION CHECKLISTS FOR
PREPARATION OF IFP IMPLEMENTATION SAFETY
ASSESSMENT ………………………………………………………… APP4-1
APPENDIX 5 FLIGHT VALIDATION PILOT TRAINING AND EVALUATION….. APP5-1
APPENDIX 6 VALIDATION TEMPLATES FOR FIXED WING AIRCRAFT …….. APP6-1
APPENDIX 7 VALIDATION TEMPLATES FOR HELICOPTERS ………………… APP7-1
APPENDIX 8 HUMAN FACTORS ……………………………………………………. APP8-1
APPENDIX 9 OBSTACLE ASSESSMENT …………………………………………. APP9-1
APPENDIX 10 SAMPLE VALIDATION DOCUMENTATION ………………………. APP10-1
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
DEFINITIONS
When the following terms are used in this manual, they have the following meanings:
Accuracy. The degree of conformance between the estimated or measured value and
its true value.
Aerodrome. A defined area on land or water (including any buildings, installations and
equipment) intended to be used either wholly or in part for the arrival, departure and
surface movement of aircraft.
Aeronautical data. Data relating to aeronautical facts, such as, inter alia, airspace
structure, airspace classifications (controlled, uncontrolled, Class A, B, C... F, G),
name of controlling agency, communication frequencies, airways/air routes, altimeter
transition altitudes/flight levels, collocated instrument procedure (and its airspace as
assessed by design criteria), area of magnetic unreliability, magnetic variation.
Air traffic management (ATM). The dynamic, integrated management of air traffic
and airspace including air traffic services, airspace management and air traffic flow
management — safely, economically and efficiently — through the provision of
facilities and seamless services in collaboration with all parties and involving airborne
and ground-based functions.
Air traffic services (ATS). A generic term meaning, variously, flight information
service, alerting service, air traffic advisory service and air traffic control service (area
control service, approach control service or aerodrome control service).
Basic element. The lowest level object identified within a specific function.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
Cartographic map. A representation of a portion of the Earth, its culture and relief,
with properly referenced terrain, hydrographic, hypsometric and cultural data depicted
on a sheet of paper.
Competency element. An action that constitutes a task that has a triggering event
and a terminating event that clearly defines its limits, and has an observable outcome.
Datum. Any quantity or set of quantities that may serve as a reference or basis for the
calculation of other quantities (ISO 19104).
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
Note 1. - Decision altitude (DA) is referenced to mean sea level and decision height
(DH) is referenced to the threshold elevation.
Note 2. - The required visual reference means that section of the visual aids or of the
approach area which should have been in view for sufficient time for the pilot to have
made an assessment of the aircraft position and rate of change of position, in relation
to the desired flight path. In Category III operations with a decision height the required
visual reference is that specified for the particular procedure and operation.
Note 3. - For convenience where both expressions are used, they may be written in
the form “decision altitude/height” and abbreviated “DA/H”.
Designer. A person adequately trained who performs the design of an instrument flight
procedure.
Digital elevation model (DEM). The representation of a portion of the Earth’s surface
by continuous elevation values at all intersections of a defined grid, referenced to
common datum.
Elevation. The vertical distance of a point or a level, on or affixed to the surface of the
earth, measured from mean sea level.
Evidence and assessment guide. A guide that provides detailed information (e.g.
tolerances) in the form of evidence that an instructor or an evaluator can use to
determine if a candidate meets the requirements of the competency standard.
Flight inspection. The operation of a suitable equipped aircraft for the purpose of
calibrating ground based NAVAIDS or monitoring/evaluating the performance of the
Global Navigation Satellite System (GNSS).
Flight procedure design (FPD). The complete package that includes all the
considerations that went into the development of an instrument flight procedure.
Flight procedure designer. A person responsible for flight procedure design who
meets the competency requirements as laid down by CAAP.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
Flight procedure design process. The process which is specific to the design of
instrument flight procedures leading to the creation or modification of an instrument
flight procedure.
Flight validation pilot (FVP). A person performing flight validation who meets the
competency requirements as laid down by CAAP.
Flight validation service provider (FVSP). A body that provides flight validation
services.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
Instrument flight procedure design service (IFPDS). A service established for the
design, documentation, validation, continuous maintenance and periodic review of
instrument flight procedures necessary for the safety, regularity and efficiency of air
navigation.
Instrument flight procedure process. The overarching process from data origination
to the publication of an instrument flight procedure.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
Mastery test. A test that evaluates a trainee’s ability to perform a terminal objective.
A mastery test should match as closely as possible the conditions, behaviors and
standards of terminal objectives.
Minimum obstacle clearance altitude (MOCA). The minimum altitude for a defined
segment that provides the required obstacle clearance.
Navaid data. Data relating to both ground-based and space-based navigational aids
including service volume, frequency, identification, transmission power and limitations
of operation
Obstacle. All fixed (whether temporary or permanent) and mobile objects, or parts
thereof, that are located on an area intended for the surface movement of aircraft or
that extend above a defined surface intended to protect aircraft in flight.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
more than 2 m (7 ft) below the aerodrome elevation. An obstacle clearance height for
a circling approach operation is referenced to the aerodrome elevation.
Note 2. — For convenience when both expressions are used, they may be written in
the form “obstacle clearance altitude/height” and abbreviated “OCA/H”.
Note 3.— See Part I, Section 4, Chapter 5, 5.4 for specific applications of this definition.
Obstacle data. Any man-made fixed or temporary object which has vertical
significance in relation to adjacent and surrounding features and which is considered
as a potential hazard to the safe passage of aircraft, or man-made fixed or temporary
objects that extend above a defined surface intended to protect aircraft in flight.
Obstacle/terrain data collection surface. A defined surface intended for the purpose
of collecting obstacle/terrain data.
Procedure design tool. Automation system that provides calculations and/or designs
and layouts in the field of procedure design.
Procedure owner. refers to the organization (airport authority, ATS, air operator, etc.)
indorsing procedure design work to a PDSP.
Procedure. A specified way to carry out an activity or a process (see ISO 9000:2000
Quality management systems – Fundamentals and vocabulary, section 3.4.5).
Progress test. A test that measures a trainee’s ability to meet key enabling objectives.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
Quality record. Objective evidence which shows how well a quality requirement is
being met, or how well a quality process is performing. Quality records normally are
audited in the quality evaluation process.
Range of variables (conditions). The conditions under which the competency units
must be performed.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
Standard terminal arrival (STAR). A designated instrument flight rule (IFR) arrival
route linking a significant point, normally on an ATS route, with a point from which a
published instrument approach procedure can be commenced.
Terminal arrival altitude (TAA). The lowest altitude that will provide a minimum
clearance of 300 m (1 000 ft) above all objects located in an arc of a circle defined by
a 46 km (25 NM) radius centered on the initial approach fix (IAF), or where there is no
IAF on the intermediate approach fix (IF), delimited by straight lines joining the
extremity of the arc to the IF. The combined TAAs associated with an approach
procedure shall account for an area of 360 degrees around the IF.
Terrain data. Data pertaining to the natural surface of the Earth excluding man-made
obstacles, and can be represented as a cartographic map, an electronic raster map,
an electronic vector data map or an electronic Digital Elevation Model (DEM).
Traceability. The degree that a system or a data product can provide a record of the
changes made to that product and thereby enable an audit trail to be followed from the
end-user to the data originator.
Training objective. A clear statement that is comprised of three parts, i.e. the desired
performance or what the trainee is expected to be able to do at the end of particular
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
stages of training, the performance standard that must be attained to confirm the
trainee’s level of competence and the conditions under which the trainee will
demonstrate competence.
Training provider. In the context of this MOS, a body that provides procedure
designer training.
Vector data. The digitized version of graphic or rasterized data, usually having three-
dimensional attributes.
Visual maneuvering (circling) area. The area in which obstacle clearance should be
taken into consideration for aircraft carrying out a circling approach.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
ABBREVIATIONS
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
PA Precision Approach
PANS-OPS Procedures for Air Navigation Services – Aircraft Operations
PBN Performance-Based Navigation
PCAR Philippine Civil Air Regulations
PDF Portable Document Format
PDG Procedure Design Gradient
PDOP Position Dilution of Precision
PDSP Procedure Design Service Provider
PinS Point-in-Space
PV Pre-flight Validation
QM Quality Manual
QMS Quality Management System
RNAV Area Navigation
RNP Required Navigation Performance
RNP AR Required Navigation Performance Authorization Required
RPAS Remotely Piloted Aircraft System
RT Radiotelephony
RTCA RTCA (formerly Radio Technical Commission for Aeronautics)
RVSM Reduced Vertical Separation Minimum
SAR Search and Rescue
SARPS Standards and Recommended Practices
SBAS Satellite-Based Augmentation System
SI International System of Units (Système International)
SID Standard Instrument Departure
SKA Skills, Knowledge and Attitude
SMS Safety Management System
SOP Standard Operating Procedure
STAR Standard Instrument Arrival
TAA Terminal Arrival Altitude
TAWS Terrain Awareness Warning System
TLS Target Level of Safety
TMA Terminal Area
TOEFL Test of English as a Foreign Language
TR Training Record
UTC Universal Time Constant
UTM Universal Transverse Mercator
VASIS Visual Approach Slope Indicator System
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 1 - INTRODUCTION
CHAPTER 1
INTRODUCTION
1.1 GENERAL
1.1.2 This MOS also lays down the requirements and guidelines for the
Procedure Design Service Providers (PDSPs) in the following aspects
of IFPDS:
a) developing their work procedures and operations manual;
b) qualifications, training and competency for designers and flight
validation pilots;
c) process flow for the design, maintenance and implementation of
instrument flight procedures;
d) quality assurance in the elements of procedure design, such as
procedure design documentation, verification and validation
methods to ensure safety, flyability and design accuracy, including
strategies on the acquisition/processing of source information/data;
e) authorization of PDSP organizations engaged or intending to
engage in design works within Manila FIR;
f) approval of IFP design;
g) validation process of IFP design; and
h) FPD software validation.
1.1.3 It should be noted that CAAP oversight and the procedure design
service provision are two separate components which should work in
collaboration to ensure the safe development and maintenance of IFPs.
1.2.1 CAR-ANS Part 11 — Air Traffic Services, Chapter 11.2, 11.2.34, and
Appendix 11.7 contains the provisions concerning CAAP’s safety
oversight function in the area of IFPDS.
1.2.2 Appendix 11.7 of CAR-ANS Part 11 stipulates that CAAP may choose
to implement IFPDS in the following manner:
a) provide an instrument flight procedure design service; and/or
b) agree with one or more other Contracting State(s) to provide a joint
service; and/or
c) delegate the provision of the service to external agency(ies) or 3rd
Party PDSPs.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 1 - INTRODUCTION
1.2.3 CAR-ANS Part 16 – provides for the general rules and regulations that
apply to person or organization who wants to become, or are,
authorized designers of instrument flight procedures. It also sets out
certain rules that apply to CAAP in administering procedure design
certificate of authorizations.
1.3.1 In all cases in paragraph 1.2.2 above, CAAP approves and remains
responsible for all instrument flight procedures for aerodromes and
airspace under the responsibility of CAAP. It should be noted that cases
1.2.2 b) and c) are not about the delegation of responsibility, but the
delegation of the IFPDS function.
1.3.2 CAAP remains responsible for all IFPs to be implemented within the
Manila FIR. The process by which CAAP meets its obligation to approve
IFPs is also introduced in this MOS and described more in details in
Chapter 4.
1.3.3 There may be IFPs that are only available to operators or are airline
specific. The concerned operator should first request for special
authorization from CAAP prior to use of such IFPs.
1.3.4 CAAP remains responsible for all IFPs (including those mentioned in
1.3.3) and reserves the right to approve, disapprove, suspend or
recommend modifications to such procedures and publish such
procedures as necessary in the interest of safety of all the users of the
aerodromes and airspace concerned.
1.4.1 For global standardization, visual and instrument flight procedures must
be designed in accordance with the design criteria stipulated in PANS-
OPS, ICAO Doc 8168, Volume II (Procedures for Air Navigation
Services — Aircraft Operations, — Construction of Visual and
Instrument Flight Procedures) and any applicable standards set out or
referred to in ICAO approved documents and materials (e.g. ICAO Doc
9905 – RNP AR Procedure Design Manual) applying the latest
amendments thereto.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 1 - INTRODUCTION
as described in 3.2) intending to design instrument flight procedures for
aerodromes or airspace under the responsibility of CAAP meet(s) the
requirements in accordance with CAAP regulatory framework.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 1 - INTRODUCTION
1.9.1 This MOS is intended but not limited to be used by:
a) The PANS-OPS Safety Inspectorate unit responsible for the safety
oversight of an IFPDS;
b) PDSPs engaged or are intending to engage in design works to be
implemented within aerodromes or airspace under the
responsibility of CAAP;
c) Flight validation service providers and flight validation pilots
engaged in validation of flight procedure design;
d) Training organizations intending to provide flight procedure and
flight validation trainings;
e) FPD software developer intending to develop flight procedure
design tools;
f) FPD software validator intending to validate a flight procedure
design tool; and
g) Organizations or stakeholders, whose involvement in the
development and maintenance of IFPs, as referred to in this MOS,
are indispensable.
Note. - A PDSP can utilize this MOS as a parameter in establishing its
organization, procedures and operations manual. Chapter 3 of this
manual provides information intended to be used by PDSPs. In
addition, Chapter 2 can be utilized by the service provider for
preparation of an application for authorization from CAAP or an audit
by AANSOO. Practices and procedures are to be developed in
accordance with the established regulatory framework contained
herein. For this reason, it is essential that CAAP has knowledge of the
practices and procedures used by service providers.
1.10.2.1 Chapter 1, Introduction – provides the purpose of the MOS, the manner
in which to read the MOS and the description of the contents of the
MOS.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 1 - INTRODUCTION
1.10.2.3 Chapter 3, Procedure Design Service Provider Function – provides the
standard requirements and recommendatory practices for an
instrument flight procedure design service provider. This chapter
describes the process and procedures to be developed by a service
provider, including guidance on the expected contents and structure of
a PDSP’s operations manual. This chapter also includes a basic
description of the work items of service providers. More detailed
information on the work processes involved in FPD is contained in
Chapters 4 and 5.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 1 - INTRODUCTION
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 2 – CAAP SAFETY OVERSIGHT FUNCTION
CHAPTER 2
2.1.1.1 Republic Act 9497 – “An Act Creating the Civil Aviation Authority of the
Philippines”, Chapter VII, Section 35 under the Powers and Functions
of the Director General, establishes the responsibility of CAAP for the
safety of instrument flight procedures, referred thereto as “airways” or
“air routes”, to be inspected, and to determine suitability in the interest
of safety for the aerodromes and airspace under its authority.
2.1.2.1 CAAP’s specific operating regulations for IFPDS are contained in the
following publications;
a) CAR-ANS Part 16, governing Procedure Design Services (PANS-
OPS), contains the general requirements for PDSPs intending to
engage in design works within Manila FIR,
b) CAAP Citizens Charter issued pursuant to Republic Act 11032 –
“Anti-Red Tape Act of the Philippines”, referring to the “Issuance of
Authorization for Third (3rd) Party Procedure Design
Organizations”
c) This MOS for:
i) 3rd-Party authorization process (Appendix 1);
ii) design criteria as specified in 1.4.;
iii) qualification and competencies of PDSPs’ technical
personnel in 3.6;
iv) Visual and IFP approvals (4.4.11 and Appendix 2);
v) Visual and IFP design process in Chapters 4 and 5;
vi) quality assurance of IFPs in Chapters 4 and 5;
vii) requirements and guidelines for periodic reviews and
continuous maintenance of IFPs in 3.4.2 and Chapter 4;
viii) requirements and guidelines for ground and flight validations
of IFPs in 4.4.8, 4.4.9 and Chapter 5;
d) general regulatory criteria to develop procedures for the
establishment of aerodrome operating minima, if applicable;
e) ATMSID Inspectors Handbook for qualification and competencies
of PANS-OPS safety inspectors; and
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 2 – CAAP SAFETY OVERSIGHT FUNCTION
f) other relevant CAAP Memorandum Circulars (MC 49-13).
Note 1. - CAAP surveillance processes (planning inspections, audits,
and monitoring activities) of PDSPs are also contained in the Air Traffic
Management Safety Inspectorate Division (ATMSID) Handbook.
Note 2. - The term “regulations” is used in a generic sense and includes,
but is not limited to, instructions, rules, edicts, directives, sets of laws,
requirements, policies and orders.
Note 3. - CAAP is not required to establish State minima. However,
once CAAP minima are established, the minima must be published in
the AIP Philippines in accordance with CAR-ANS Part 15, 15.6.2.1 and
MOS-AIS Appendix 2.
2.1.3.1.1 The Air Traffic Service under CAAP has established as one of its units,
the Airspace and Flight Procedure Design Division (AFPDD). 3rd-Party
PDSPs may also provide IFPDS to CAAP provided they hold the proper
authorization issued by CAAP or belonging to categories (b) and (c) as
stated in 16.4.1 of CAR-ANS Part 16. Further, CAAP may agree with
one or more other ICAO Contracting State(s) to provide a joint service
in accordance to established agreements. These authorities,
organizations or agencies, as appropriate, must be supported by
sufficient and qualified personnel and provided with adequate financial
resources for the management of safety in flight operations. CAAP
ensures these through the conduct of oversight activities over these
PDSPs.
2.1.3.1.3 It should be noted that CAAP oversight and the procedure design
service provision are two separate components with different specific
functions and should work in collaboration to ensure the safe
development and maintenance of IFPs.
2.1.3.2.1 The PANS-OPS Safety Inspectorate shall have the following functions
and responsibilities;
a) develop and amend national regulations governing the
development and maintenance of visual and instrument flight
procedures subject to approval of the DG;
b) oversee the process of development and maintenance of visual
and instrument flight procedures;
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 2 – CAAP SAFETY OVERSIGHT FUNCTION
c) verify the validity of application made by 3rd Party PDSPs in
accordance with regulations embodied in CAR-ANS Part 16, and
make appropriate recommendations for the approval/
disapproval, amendment, suspension or revocation of
Certificates of Authorization of 3rd Party PDSPs;
d) carry out safety inspections and audits to determine compliance
with the requirements prescribed in applicable national
regulations;
e) ensure continuous maintenance of the procedure are performed
by concerned stakeholders concerned such as ADMS, ATS,
CNS, AIS, Aerodrome Operators, etc., to ensure that significant
changes to obstacles, aerodrome, aeronautical and navigational
aid data are assessed for their impact on the IFP;
f) conduct ground validation of IFP to verify validation reports
submitted by the PDSP as part of the approval process of IFPs,
g) ensure establishment and implementation of a quality system for
the entire flight procedure process. AANSOO shall collect all
pertinent documents and evidences of each stage in the IFP
process prior to endorsement for approval by the Director General
of CAAP,
h) may participate in different activities involved in the process such
as ground and flight validation, safety assessment and pertinent
reviews of the procedures, as appropriate or as necessary,
i) perform such other tasks as may be assigned by the Director
General or the Chief of the AANSOO and ATMSID.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 2 – CAAP SAFETY OVERSIGHT FUNCTION
2.1.3.3.1 CAAP shall ensure that funds, in the amount as may be justified by
AANSOO, must be readily available to enable the PANS-OPS
Inspectorate to effectively fulfill its functions and responsibilities
including, trainings to ensure competencies of the PANS-OPS
inspectors as well as for obligations imposed by other legislation such
as those that may involve industry visits.
Note. - In some States, the cost for the activities of the FPI is
compensated from fees paid by the service providers for certifications,
surveillance activities, etc.
2.1.4.3 The ATMSID Inspectors Training Manual contains the training program
and training plan for PANS-OPS Safety Inspectors within an
established period (usually 5 years). The training includes initial
(introduction, basic specialization), on-the-job training (OJT),
continuation (recurrent, refresher, advance specialized courses),
requalification and advanced training for senior inspectors.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 2 – CAAP SAFETY OVERSIGHT FUNCTION
b) expertise in instrument flight procedure design to optimize the
quality of the safety oversight duties for PDSPs; and
c) safety inspectors’ attributes or behavior.
2.1.5.2 CAAP also provides technical guidance to the aviation industry on the
implementation of relevant regulations thru forums or symposiums and
thru the issuance of guidance materials that may be in the form of
Advisory Circulars (ACs).
2.1.6.2 CAAP, prior to allowing a PDSP to engage in design works ensures that
the service provider complies with the regulatory requirements in force.
The PDSP organization is then subject to continuing surveillance to
ensure that the requirements continue to be met.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 2 – CAAP SAFETY OVERSIGHT FUNCTION
authorization. In the case of deficiencies or weaknesses, an opportunity
is provided for the applicant to correct the problem, and the applicant is
given an opportunity to reapply or implement corrective actions to
address the deficiencies. The processes involved in audit/inspection
including the elimination of findings are detailed in the ATMSID
Inspectors Handbook.
2.1.6.4 As part of this process, CAAP established standards for the required
competency level for technical personnel in charge of flight procedure
design, flight validation, and others (see 3.6).
2.1.6.5 CAAP ensures that PDSPs develop a job description, training program,
training plan, and a system of maintaining training records for their
designers and flight validation pilots.
Note. - See ICAO Doc 9906, Volume 2 for guidance on flight procedure
designer training, and Volume 6 for guidance on flight validation pilot
training.
2.1.7.4 As part of the surveillance activities for PDSPs, the PANS-OPS Safety
Inspectorate develops periodic surveillance plans as described in the
ATMSID Inspectors Handbook.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 2 – CAAP SAFETY OVERSIGHT FUNCTION
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 2 – CAAP SAFETY OVERSIGHT FUNCTION
monitors and records progress, including actions taken by the PDSPs
in resolving such issues.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 3 – PROCEDURE DESIGN SERVICE PROVIDER
FUNCTION
CHAPTER 3
3.1 GENERAL
3.2.2.1 A PDSP may offer to design any or all of the following type of visual and
instrument procedure, whether conventional or Performance-Based
Navigation;
a) En-route,
b) Standard Terminal Arrival Route,
c) Standard Instrument Departure,
d) Instrument Approach Procedures (see definition for further
classification),
e) Visual Approach Procedures including Visual with Prescribed
Track, and
f) Helicopter Point-in-Space (PinS).
Note: Holding, Circling and Missed Approach procedures are
incorporated in the above procedures.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 3 – PROCEDURE DESIGN SERVICE PROVIDER
FUNCTION
3.2.3 Validation Services
3.2.3.1 A PDSP may offer any or all of the following services for the purpose of
FPD validation:
a) validation of newly designed flight procedures;
b) periodic validation (with its interval for each type of flight
procedure);
c) validation upon amendment of flight procedures; and
d) other validation conducted for special needs.
Validation services may cover ground validation, flight validation or
both.
The service provider shall establish its own process and procedures in
accordance with this MOS. If a process and procedure is not covered
by this MOS, the PDSPs’ process and procedures should be
established in accordance with the latest versions of applicable ICAO
SARPs and PANS documents.
3.3.1.2 CAAP understands that PDSPs providing services for others States
may have to comply with the regulatory framework of their respective
States.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 3 – PROCEDURE DESIGN SERVICE PROVIDER
FUNCTION
Table 3-1. Sample contents of an operations manual for a service provider
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 3 – PROCEDURE DESIGN SERVICE PROVIDER
FUNCTION
● Describe how to demonstrate the compliance
Chapter: Operational ● Define the methodology to provide operational
instructions instructions to staff members such as:
circular
information bulletin
amendment to existing document
(including notification of changes in design criteria)
Chapter: Services to be ● Define the services (and/or product) to be provided by
provided the organization such as those listed under 3.2.1
● Define the types of flight procedure to be provided by the
organization such as those listed under 3.2.2
● Define the types of flight validation to be provided by the
organization such as those listed under 3.2.3
● Describe the criteria needed to determine the necessity
of these types of service
● Describe the criteria needed to determine the necessity
of simulator evaluation
Contingency measures ● Define plans in the event of part or total system failure
for which the PDSP provides a service
Security arrangements ● Define a security plan to ensure that pertinent data,
documents, equipment are protected from theft and
other malicious intent
PART: Flight procedure design process
Chapter: Design process ● Define the process to be followed
Chapter: Acquisition of data/ ● Define
information types of data/information required for the design
of instrument flight procedures
how to acquire such data/information
from whom/where to acquire such
data/information
Chapter: Consultation with ● Identify stakeholders
stakeholders ● Describe
on which matters consultation with stakeholders is
needed
with whom
when
how
Chapter: Environmental ● Describe what should be considered in the design of flight
consideration procedures
Chapter: Documentation ● Describe
how to record the activities
how to maintain documents
● Define the period of maintenance of records
Chapter: Format ● Provide the format (template) for design documents to
record:
rationale for the design
controlling obstacle
summary of calculation process
● Provide the format (template) for flight validation report
(for flight validators)
Chapter: Validation ● Describe:
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 3 – PROCEDURE DESIGN SERVICE PROVIDER
FUNCTION
who validates the procedures
how the procedures are validated
● Define the process to be followed
● Define the items (charts, aeronautical data, obstacle,
flyability, Navaid/lighting) to be validated for each type of
validation
● Define tolerance
● Define the type of result (pass, pass on condition, fail)
what are the actions to be taken for failed
procedure
Chapter: Preparation of ● Define the types of material to be submitted to AIS
publication (depending on the protocol with AIS)
● Define the timing of submission
PART: Safety and Quality
Chapter: SMS and QA system ● Define how to be involved in the SMS (e.g. the SMS of an
entire
ANSP)
● Provide a reference to the organization’s quality manual
● Define policy and procedures for fault and defect
reporting
● Provide a statement on the resolution of safety/quality-
related issues
Chapter: Oversight by ● Describe how to manage the oversight activities
regulator
3.3.2.1 Organizations with a QMS will have their own quality manual (QM). In
this case, the procedure design process is also subject to this QM.
Chapter 4 provides basic guidelines to establish a quality assurance
system for IFPDS.
3.4.1.1 IFPs must be designed in accordance with the design criteria specified
in 1.4, as adopted by CAAP. If deviation from the criteria is required,
consultation with the regulator for approval is needed.
3.4.1.2 The PDSP should establish its own work process and describe it in its
operations manual (see Table 3-1), in accordance with CAAP
regulations. For details on the FPD process, see Chapter 4.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 3 – PROCEDURE DESIGN SERVICE PROVIDER
FUNCTION
3.4.1.3 In accordance with CAR-ANS Part 11, any significant safety-related
change to the air traffic services (ATS) system, including the
implementation of a reduced separation minimum or a new procedure,
must be put in effect only after a safety assessment has demonstrated
that an acceptable level of safety will be met and users have been
consulted. When appropriate, the PANS-OPS Safety Inspectorate may
require the PDSP to conduct post implementation monitoring to verify
that the defined level of safety continues to be met. Depending on the
organizational arrangements, either a PDSP or the organization that
requested a procedure design (ANSP, aerodrome, air operator, etc.)
may be responsible for a safety assessment that would be submitted to
AANSOO to support the approval of the IFP for publication.
3.4.2.1 All published IFPs must be subject to a periodic review. Upon periodic
review, the following tasks are to be conducted:
a) Assessment of the impact of all changes to obstacle data. This may
be conducted by applying amended obstacle data to the design
data (design document, design file, etc.) of the published IFP. For
example, if the minimum obstacle clearance (MOC) is not ensured
due to a newly developed obstacle, amendment to the existing IFP
is required.
b) Assessment of the impact of all changes to aerodrome,
aeronautical and navaid data. In most cases, changes to this data
will require amendment to the existing IFP.
c) Assessment of the impact of all criteria amendments and changes
to depiction standards. It is intended that all IFPs be maintained to
current design criteria and depiction standards in accordance with
CAAP’s regulatory framework time frame. CAAP depiction
standards are described in CAR-ANS Part 4 and MOS-
Aeronautical Charts. The existing IFP can be maintained even
upon the amendment of design criteria and/or depiction standards
if it is determined that these amendments are not safety-related
issues. However, even if the resulting IFP depiction is unchanged,
the design file may be amended and updated to current criteria to
facilitate IFP maintenance.
d) Assessment of the impact of all changes to user requirements.
Such changes to user requirements include, but are not limited to:
i) fleet type (performance)
ii) scheduled service route
iii) ATM procedures
iv) airspace.
Even if the user requirements are not a safety-related issue, IFP
amendments and/or new IFPs may be needed to satisfy current user
requirements.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 3 – PROCEDURE DESIGN SERVICE PROVIDER
FUNCTION
3.4.2.3 If it is determined that any action is required, such as amendment to the
existing IFP, due to new obstacle and/or changes in design criteria
which have a safety impact, return to the “initiation” step (Step no. 1 in
the FPD process, see Chapter 4) to reinitiate the FPD process.
A PDSP must establish and comply with its own scheme for training
and qualification of its procedure designers and its flight validators in
accordance with this MOS. ICAO Doc 9906, Volumes 2 and 6 provide
guidance for establishing a training scheme for both flight procedure
designers and flight validation pilots which also served as a basis of
CAAP in the development of CAAP’s regulatory framework aligned with
the aim to promote a reasonable degree of standardization in IFPDS.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 3 – PROCEDURE DESIGN SERVICE PROVIDER
FUNCTION
criticality of tasks, and the inventory of skills, knowledge and
attitudes;
c) the identification of the characteristics of the trainee population;
d) the derivation of training objectives from the task analysis and their
formulation in an observable and measurable fashion;
e) the development of criterion-referenced, valid, reliable and
performance-oriented tests;
f) the development of a curriculum based on adult learning principles,
with a view to achieving an optimal path to the attainment of
competencies;
g) the development of material-dependent training; and h) the use of
a continuous evaluation process to ensure the effectiveness of
training and its relevance to line operations.
h) the use of a continuous evaluation process to ensure the
effectiveness of training and its relevance to line operations.
3.6.2.4 The performance criteria make use of action verbs. For example:
a) Apply criteria. Applying criteria is the action of defining and
assessing areas of airspace intended for use as an aircraft flight
path, length of segment, angle of turn, etc., in accordance with
CAAP-approved instrument procedure design criteria.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 3 – PROCEDURE DESIGN SERVICE PROVIDER
FUNCTION
b) Collect. The action of bringing together, collating, assembling,
editing and formatting from recognized sources data required for
the development of an instrument procedure design.
c) Incorporate. As in to incorporate electronic and/or paper data
into a procedure design file, to create congruency with other design
data.
d) Plot. The action of determining, positioning and drawing over top
of terrain, aeronautical, aerodrome and obstacle data the optimal
flight path of a procedure design, its associated fixes, assessment
airspace, assessment surfaces and minimum safe altitudes.
e) Promulgate. The action of submitting to CAAP, an instrument
procedure design package for distribution to the international
aviation community via CAAP-published Aeronautical Information
Regulation and Control (AIRAC) document.
f) Originate. The process of creating a data element or amending
the value of an existing data element.
Note: Refer to Table 2-1. “Competency framework of flight procedure
designer” of ICAO Doc. 9906 Vol. 2 – “Flight Procedure Designer
Training” for evidence and assessment guide for applicable
competency elements.
3.6.3.1.1 Before conducting initial training, the skills and knowledge of the
trainees are assessed. Procedure designers can be recruited from
different domains (ATM, AIS, engineer, technician, pilots, just to name
a few) therefore their skills and knowledge vary, and ab initio training
may be necessary to meet the entry level required in the different
domains to be able to successfully complete initial training (see
3.6.3.2). Ab initio training will not cover any procedure design technique
or criteria, but basic skills and knowledge that need to be mastered prior
to commencing initial training. The purpose of ab initio training is to
harmonize trainees’ entry skills and knowledge before they start initial
training. The program for this phase of training should not be developed
from the competency framework.
3.6.3.2.1 Initial training is the first phase of training where actual procedure
design topics and criteria are covered. The purpose of initial training is
to provide basic skills and knowledge to procedure designers who have
been recently recruited or transferred from another job. The curriculum
of initial training is derived from the competency framework. The
associated duration and mastery test are relevant to the program.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 3 – PROCEDURE DESIGN SERVICE PROVIDER
FUNCTION
3.6.3.3 On-the-job training (OJT) for procedure designers
3.6.4.1 Flight validation pilots should at least have a commercial pilot license
with instrument rating, or an equivalent authorization from CAAP
meeting the PCAR Part 2 knowledge and skill requirements for
issuance of the commercial pilot license and instrument rating, in the
aircraft category (e.g. airplane or helicopter) appropriate for the
procedure to be validated. If the flight validation pilot is not the pilot-in-
command of the flight validation aircraft, then the provisions of this
paragraph also apply to the pilot-in-command of the flight validation
aircraft.
3.6.4.2 In order to achieve the safety and quality assurance objectives of the
flight validation, CAAP through oversight activities, shall ensure that
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 3 – PROCEDURE DESIGN SERVICE PROVIDER
FUNCTION
flight validation pilots have acquired and maintain the required
competency level through training and supervised on-the-job training.
Note 1. - Recommended qualifications and training, as well as guidance
concerning the skills, knowledge and attitudes to be addressed in the
training and evaluation of flight validation pilots can be found in
Appendix 5 of this MOS.
Note 2. - Additional detailed information and guidance concerning flight
inspection, as well as qualifications and certification of flight inspectors,
can be found in the ICAO Manual on Testing of Radio Navigation Aids,
Volumes I, II, and III (ICAO Doc 8071).
3.6.5.3 In general, work involved in flight validation (see Figure 5-1 of ICAO
Doc. 9906 Vol. 5 —“Validation of Instrument Flight Procedures”)
correspond to some competency elements in the competency
framework. However, they are not identical. For instance, one single
competency element is applicable to multiple work stages.
3.6.5.4 The table in 2.4 “Competency framework for flight validation pilots
(FVP)” of ICAO Doc. 9906 Vol. 5 — “Validation of Instrument Flight
Procedures” provides evidence and assessment guide for applicable
competency elements.
3.6.6.1.1 Initial training is the first phase of training where actual procedure
design topics and criteria are covered. The purpose of initial training is
to provide basic skills and knowledge to flight validation pilot trainees.
The curriculum of initial training is derived from the competency
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 3 – PROCEDURE DESIGN SERVICE PROVIDER
FUNCTION
framework. The associated duration and mastery test are relevant to
the program.
3.7.1 The ATS provider’s interfaces with IFPDS can make a significant
contribution to the safety of its products or services. Therefore, the SMS
aspects of IFPDS products would be normally Included as part of an
ATS provider’s SMS.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 4 – FLIGHT PROCEDURE QUALITY ASSURANCE
SYSTEM
CHAPTER 4
4.1 GENERAL
4.1.2 Although not always specifically mentioned in this MOS, all process
steps are followed by a verification and validation step in order to
guarantee the quality of the resulting elements of each step.
4.1.3 This chapter describes the measures CAAP endorses to assure the
quality of the process used to apply procedure design criteria (Also see
4.4.11 and Appendix 2 - “IFP Quality Assurance Checklist”). These
measures ensure the quality and safety of the procedure design
product through a more focused review, verification, coordination and
validation by the concerned PDSP (final validation of FPD by PDSP
must be conducted by a designer not involved in the specific design
project) at appropriate points in the process, so that corrections can be
made at the earliest opportunity. Quality records or evidence that
quality control was conducted following each process steps must be
submitted to AANSOO as part of the IFP technical package.
4.2.1 With the advent of new navigation systems, the IFP process and its
products have become key enablers of the worldwide air traffic
management (ATM) system. They must therefore be managed
effectively to ensure that quality assured procedures are provided in
support of ATM operations.
4.2.2 The quality of an IFP is flight critical. The en-route structure, departure,
arrival, holding and approach procedures are derived from an IFP
process which covers various steps from collection of user
requirements to AIP publication to the integration into airborne systems.
In consequence, the FPD and the resulting IFP, from data origination
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 4 – FLIGHT PROCEDURE QUALITY ASSURANCE
SYSTEM
SYSTEM through publication to incorporation into an end-user system, must be
quality assured.
Note - This chain involves various organizations which should apply
quality assurance processes as stated in the existing applicable
Standards, notably CAR-ANS Part 15, for the origination of data and
MOS AIS for the processing and release of aeronautical data (see
Figure 4.1).
4.2.3 The development of an IFP follows a series of steps from the origination
of data through survey to the final publication of the procedure and
subsequent coding of it for use in an airborne navigation database (refer
to Figures 4.2 and 4.3). There should be quality control procedures in
place at each step to ensure that the necessary levels of accuracy and
integrity are achieved and maintained. The process involved in the
overall IFP implementation is illustrated in Figure 4.3.
4.2.4 Checks must be carried out throughout the whole chain by each
“participant” (organization) to ensure that the final procedure meets
quality requirements. In particular, the accuracy, resolution and integrity
of data elements, together with any changes to the data, need to be
addressed. The preferred method for the transmission of the data
elements is by electronic means, as this preserves the integrity of the
data.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 4 – FLIGHT PROCEDURE QUALITY ASSURANCE
SYSTEM
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 4 – FLIGHT PROCEDURE QUALITY ASSURANCE
SYSTEM
SYSTEM
4.3.1 Overview
4.3.1.3 The process covers the entire lifespan of an IFP, from the initial
development up to the withdrawal, recognizing that some of the process
steps, such as AIP publication and procedure regulation, might belong
to other organizations.
4.3.1.5 This process if properly applied, should provide consistent results with
an appropriate level of quality.
4.3.2.1 Although the process covers the entire life cycle of an IFP, from the
original requirement to final withdrawal, the aim of the process is not
the decommissioning of IFPs.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 4 – FLIGHT PROCEDURE QUALITY ASSURANCE
SYSTEM
4.3.2.2 The decommissioning of the IFP is the termination of the quality
process (except for the archiving requirements).
4.3.2.3 Throughout the life cycle of the procedure, several outputs are
generated and evolve to a next level in the “production line”.
4.3.2.4 Listed below from the beginning of the process are the main outputs:
a) A formal written approval to proceed with the development of the
IFP design;
b) An approved conceptual design, including planned implementation
dates, and resources needed to achieve the task;
c) The FPD, including the procedure layout, the relevant technical
report containing calculation outputs, data used in the design,
coordinates of points including obstacles identified, coding tables
(if applicable), textual description of the intended procedure and
the determined level of safety impact and/or a safety
documentation;
d) Validation and verification reports for the IFP;
e) Approval of the procedure by the Director General of CAAP;
f) Documentation throughout the various stages from the input
through the publication process; and
g) The released AIP publication (charts, texts, coordinates, path
terminators and any other pertinent information relevant to the
procedure).
4.3.2.5 At the end of the life cycle, a decision to withdraw the procedure will be
issued (and documented). All changes permitting the withdrawal will be
included in the quality documentation but will also be part of the
replacement procedures' (if any) documentation.
Step 1 - INITIATION
At the starting point a “pre-design” request is made for a new FPD or a
“modification” request to an existing FPD resulting from feedback,
continuous maintenance or periodic review (see steps Nos. 12 to 14).
Description
Justification for the FPD must be clearly stated and must be in accordance
with the airspace concept and CAAP navigation strategy. It is a managerial
responsibility to make a decision at this point to “go” or “no go”.
Request from a stakeholder for a new or a modified procedure.
Review of an existing procedure.
Input Navigation strategy considerations.
Resource planning.
Feedback on Existing procedure.
Managerial decision to set up the procedure design process or to
Output
discontinue the activity.
Parties Stakeholders.
involved
Quality A formal written approval/ service order/ signed contract to proceed with
Records the development of the IFP design.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 4 – FLIGHT PROCEDURE QUALITY ASSURANCE
SYSTEM
SYSTEM Pertinent documents, studies, assessments, implementation plans
supporting the decision made.
ISO 9001:2000: section 7.2.1 “Determination of requirements related to the
product”; section 7.2.2 “Review of requirements related to the product”;
References
section 7.3.1 “Design and development planning”; and section 7.3.2
“Design and development inputs”.
Step 2 - COLLECT AND VALIDATE ALL DATA
Specific ATS stakeholders’ requirements: local traffic patterns (altitude,
direction, airspeed), feeder/transitions, arrival/departures, preferred
routes, ATS routes, communication facilities, time, restrictions and any
ATS needs, restrictions or problems.
The designer is to collect from recognized sources, validate for resolution,
integrity, reference geodetic datum and effective dates, and incorporate
the following data into a design file:
Terrain data: electronic raster and/or vector data or paper
cartographic maps.
Obstacle data: man-made and natural (tower/tree/vegetation
height).
Aerodrome/heliport data: ARP/HRP, runway, lighting, magnetic
Description variation and rate of change, weather statistics, altimetry source.
Aeronautical data: airspace structure, classifications (controlled,
uncontrolled, Class A, B, C, D, E, F, G, name of controlling agency),
airways/air routes, altimeter transition altitudes/flight levels, other
instrument procedure assessed airspace, area of magnetic
unreliability.
Navaid data: coordinates, elevation, service volume, frequency,
identifier, magnetic variation.
Existent waypoints significant to the planned navigation.
Data collected by the PDSP which do not coincide with data published in
the AIP must be coordinated immediately to the data owner who will in-
turn coordinate with the AIS for amendment of published information in
accordance to CAR-ANS Part 15 and MOS AIS.
All stakeholder requirements
Previous designs
Input Data from sources recognized by CAAP (e.g. AIP, ADMS Survey Airfield
Update Report, Obstacle Survey from aerodromes not operated by CAAP)
All other data.
Preliminary work file containing summary of stakeholder requirements,
Output
summary of all data.
Designer
ATM
AIS
Parties
involved
Stakeholders
Airport Authorities
Data sources (e.g. CNS, ADMS, surveyors, charting agencies, MET offices,
etc.)
Summary of stakeholder requirements that can be verified thru minutes
Quality
of meetings, emails and other forms of correspondence.
Records
Duly signed obstacle surveys.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 4 – FLIGHT PROCEDURE QUALITY ASSURANCE
SYSTEM
Summary of collected data stating the source document and the person/
organization that validated the data and the method thru which data was
validated (e.g. ground validation and simulation/ flight validation).
Safety Management Manual (ICAO Doc 9859).
This MOS
MOS AIS
MOS for Charting
Quality Assurance Manual for Flight Procedure Design (ICAO Doc 9906).
References
ISO 9001:2000.
CAR-ANS 11, 15 and CAR Aerodromes.
World Geodetic System-1984 (WGS-84) Manual (ICAO Doc 9674).
Guidelines for electronic terrain, obstacle and aerodrome mapping
information (ICAO Doc 9881).
Step 3 - CREATE CONCEPTUAL DESIGN
A conceptual design is drafted with the key elements considering the
Description
overall strategy.
Input Preliminary work file.
Output Conceptual design (textual description and proposed procedure layout).
Parties Designer.
involved
Proposed procedure layout of the conceptual design.
Quality Textual description of the conceptual design.
Records Summary of stakeholder requirements that can be verified thru minutes
of meetings, emails and other forms of correspondence.
ICAO Doc 8168 (or applicable criteria).
Required Navigation Performance Authorization Required (RNP AR)
References
Procedure Design Manual (Doc 9905) (or applicable criteria).
ISO 9001:2000: section 7.3.1 “Design and development planning”.
Step 4 - REVIEW BY STAKEHOLDERS
Formal agreement and approval of the conceptual design is sought at this
stage. If agreement and approval are not possible then either the designer
Description
must redesign the conceptual design or the stakeholders must reconsider
their requirements.
Work program to serve as basis for decision, including the scope of the
Input activity to be performed.
Conceptual design.
Formally approved conceptual design or formal decision to discontinue,
updated with any consequential changes, if applicable.
Output
Planned implementation AIRAC date, based on available resources and
any other technical/ operational/ training constraints.
PDSP.
Concerned stakeholders (Air Operator, Airport Operator, ATS).
Parties
Designer and management.
involved
AIS for planned publication date with reference to AIRAC calendar.
AANSOO for any regulatory clarifications that may be raised (optional).
Formally approved conceptual design or formal decision to discontinue,
updated with any consequential changes, if applicable. (stakeholders-
Quality
approved proposed procedure layout annotating any amendments from
Records
the original proposal or the textual description of the procedure with
affixed signatures of stakeholders is acceptable)
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 4 – FLIGHT PROCEDURE QUALITY ASSURANCE
SYSTEM
SYSTEM ISO 9001:2000: section 7.3.1 “Design and development planning”; and
References
section 7.3.4 “Design and development review”.
Step 5 - APPLY CRITERIA
Description Using the stakeholder-approved conceptual design, apply criteria.
Preliminary work file.
Formally approved conceptual design.
Input
Planned implementation AIRAC date.
Resource allocation for the design and planning for publication.
FPD.
Draft procedure layout.
Report.
Output
Calculation outputs
Coordinates.
Textual description of the procedure.
Parties Designer.
involved
Quality None
Records
ICAO Doc 8168 (or applicable criteria).
References ICAO Doc 9905 (or applicable criteria).
ISO 9001:2000: section 7.3 “Design and development”.
Step 6 - DOCUMENT AND STORE
For traceability, complete necessary submission / calculation forms in
paper and / or electronic formats.
Create a draft instrument procedure graphical depiction (same as the
output in Step 5).
Provide a summary of the logic and decisions used in the step-by-step
Description design of the procedure.
Gather all information used and created in the design of the procedure
and assemble into a submission package.
Obtain traceability of consensus from stakeholders via signatures.
Store submission package in a secure format and area, easily accessible
for future considerations.
FPD.
Draft procedure layout.
Report.
Input
Calculation outputs.
Coordinates.
Textual description of the procedure.
Data store FPD containing:
all calculations;
all forms and reports, including consensus from stakeholders;
Output all charts/maps AIRAC textual description (used in the design and not
necessarily created for the design);
path terminators (if applicable);
and procedure plate (draft graphical depiction).
Parties Designer.
involved
Quality PDSP Operations Manual detailing procedure for data storage.
Records Implementation to be verified and documented during industry visits.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 4 – FLIGHT PROCEDURE QUALITY ASSURANCE
SYSTEM
ICAO Doc 8168 (or applicable criteria).
ICAO Doc 9905 (or applicable criteria).
References CAR-ANS Parts 4 and 15.
ICAO Doc 9906.
This MOS.
Step 7 - CONDUCT SAFETY ACTIVITIES
Determine Level of Safety Impact
Perform an assessment of the magnitude of change to determine the
amplitude needed for the safety case.
Develop Safety Documentation
Description
Safety documentation to be provided for the implementation of a
new procedure should be agreed at this stage. Normally the Safety
Management System to be used is defined for the ANSP affected by
the change or by CAAP in case the PDSP falls under 1.2.2 (b).
FPD containing draft procedure layout, report, calculation outputs,
Input
coordinates, textual description of the procedure.
Formal statement on the significance of change, allowing to determine the
Output
amplitude of the safety case that needs to be performed.
Parties Quality and safety officer, affected stakeholders, supported by designers.
involved
Pre-Implementation Checklists for Preparation of IFP Implementation
Quality Safety Assessment (Appendix 4).
Records Safety Assessment or hazard identification and safety risk assessment
form (See Appendix 4)
ICAO Doc 9859.
ISO 9001:2000.
References CAR Safety Management.
AC AN/ATM-SRM-01-14 – “Guidelines for Preparing Safety Arguments
Covering CAR-ANS Part 11(ATS).
Step 8 - CONDUCT GROUND VALIDATION AND CRITERIA VERIFICATION
Validate all data used in the procedure design (i.e. data resolution and
format).
Description Validate the “intended use” of FPD as defined by stakeholders and
described in the conceptual design.
Verify that the criteria have been properly and accurately applied.
FPD package.
Input
Safety case.
Output Ground validated and Criteria verified IFP.
Designer.
Parties
involved
Validation team or another designer not involved in the particular design
project.
Results of ground validation (Ground Validation Report signed by
Quality validator).
Records Results of criteria verification (Criteria Verification Report signed by
verifier).
ICAO Doc 8168 (or applicable criteria).
References ICAO Doc 9905 (or applicable criteria).
CAR-ANS Parts 4 and 15.
Step 9 - CONDUCT FLIGHT VALIDATION AND DATA VERIFICATION
Description To be performed as necessary (see 4.4.8)
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 4 – FLIGHT PROCEDURE QUALITY ASSURANCE
SYSTEM
SYSTEM Verify for accuracy of terrain data, obstacle data, aerodrome data,
aeronautical data, navaid data.
Validate the “intended use” of FPD as defined by stakeholders and
described in the conceptual design.
Validate flyability and/or human factors.
Validate safety case.
Ground validated/ Criteria verified IFP.
Input
Safety documentation.
Output Validated IFP.
Designer.
Parties All concerned stakeholders.
involved Flight validation organization.
Flight inspection organization.
Quality Results of flight validation (Flight Validation Report signed by FVP).
Records Results of flight inspection (when performed).
ICAO Doc 8168 (or applicable criteria).
References Manual on Testing of Radio Navigation Aids (ICAO Doc 8071).
This MOS.
Step 10 - CONSULT WITH STAKEHOLDERS
Present all pertinent information to all relevant stakeholders for
Description
consultation.
Input Validated IFP.
Output Stakeholder endorsement/ approval.
Designer.
Parties
Relevant stakeholders.
involved
AANSOO for any regulatory clarifications that may be raised (optional).
Stakeholder endorsement/ approval.
Quality
Records
A written statement from those entities, or other proof of concurrence
(duly signed minutes of meetings by those entities, emails, etc.).
References This MOS.
Step 11 – Approve IFP
Submit IFP documentation to AANSOO for validation of the
Description “completeness” of the IFP implementation process prior to the approval
of the DG.
IFP Technical Package
Validated IFP.
Input Procedure lay-out.
Stakeholder endorsement.
Other relevant quality records.
Approved IFP to be forwarded by AANSOO to owner of the procedure or
the PDSP, whoever submitted the FPD Package for approval.
Output
Endorsement from procedure owner for the AIS to create draft chart/s of
approved IFP/s.
Parties Designer.
involved AANSOO.
Quality Assurance Report.
Quality
Records
Formal approval of the FPD for new procedures (or for relevant changes
on existing procedures).
References This MOS.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 4 – FLIGHT PROCEDURE QUALITY ASSURANCE
SYSTEM
Step 12 - CREATE DRAFT PUBLICATION
Provide FPD package, including a graphical depiction, to the AIS to create a
Description
draft publication.
Approved IFP for publication, including the procedure layout from PDSP
Input
and coding tables (if applicable).
Output Draft publication.
Parties Designer.
involved AIS.
Quality None
Records
CAR-ANS Parts 4 and 15.
MOS AIS
References MOS-Aeronautical Charts
ISO 9001:2000 section 4.2 “Documentation requirements” section 7.3.5
“Design and development verification”.
Step 13 - VERIFY DRAFT PUBLICATION
Description Verify the draft publication for completeness and consistency.
Draft publication.
Input
Validated FPD.
Cross-checked draft publication.
Output
Decision for publication release.
Designer.
Procedure owners.
AANSOO for any regulatory clarifications that may be raised (optional)
Parties
involved AIS.
Note: “Aviation Authority” referred to in Step 13 under ICAO Doc 9906
Vol.1 applies only when the publication is delegated to another entity
aside from the AIS operated by the state authority.
Quality Coordination/ communication/ correspondence between designer and
Records AIS.
Regional regulation/ agreement.
This MOS.
MOS AIS.
References ICAO Doc 8168 Volumes I and II (or applicable criteria).
All applicable CAR-ANS, ICAO Annexes and Docs.
ISO 9001:2000 section 7.3.5 “Design and development verification”; and
section 7.3.6 “Design and development validation”.
Step 14 - PUBLISH IFP
Description AIS initiates the AIRAC process.
Cross-checked draft publication.
Input
Decision for publication release.
Output AIP chart, documentation.
Parties AIS.
involved
Quality Published charts.
Records
References CAR-ANS Parts 4 and 15.
Step 15 - OBTAIN FEEDBACK FROM STAKEHOLDERS
Request and analyze feedback from stakeholders on the acceptability of
Description
the work performed.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 4 – FLIGHT PROCEDURE QUALITY ASSURANCE
SYSTEM
SYSTEM Cross-check the AIP chart, documentation.
AIP chart, documentation.
Input
Reports from stakeholders.
Output Decision for ongoing activities.
AIS
Parties Manager of the PDSP.
involved Stakeholders.
AANSOO for any regulatory clarifications that may be raised (optional).
Quality Formal order/ decision for the ongoing activities.
Records
References MOS AIS
Step 16 - CONDUCT CONTINUOUS MAINTENANCE
On a continuous basis ensure that:
significant changes to obstacles, aerodrome, aeronautical and navaid
data are assessed.
Description significant changes to criteria and design specification that affect
procedure design are assessed to determine if action is required
prior to the periodic review.
If action is required, return to Step No. 1 to reinitiate process.
Significant changes in the FPD environment or design criteria changes that
Input
are safety related.
Output Revision as required.
AIS.
Designer.
Parties AANSOO.
involved Procedure owner.
Airport authorities, if the procedure owner is another organization.
Pilots (when applicable and possible).
Quality
If modifications or amendments, the reason(s) for the change(s).
Records
ICAO Doc 8168 (or applicable criteria).
ICAO Doc 9905 (or applicable criteria).
References CAR-ANS Parts 4 and 15.
CAR Safety Management.
This MOS.
Step 17 - CONDUCT PERIODIC REVIEW
On a periodic basis (every 5 years) ensure:
that all changes to obstacles, aerodrome, aeronautical and navaid
data are assessed; and
Description
that all changes to criteria, user requirements and depiction
standards are assessed.
If action is required, return to Step No. 1 to reinitiate process.
Input All changes in the FPD environment, design criteria or depiction standards.
Output Revisions as required.
Designer.
AANSOO (as oversight)
Parties AIS.
involved Note: “Aviation Authority” referred to in Step 13 under ICAO Doc 9906
Vol.1 applies only when the publication is delegated to another entity
aside from the AIS.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 4 – FLIGHT PROCEDURE QUALITY ASSURANCE
SYSTEM
Quality Results of the periodic review.
Records If modifications or amendments, the reason(s) for the change(s).
ICAO Doc 8168 (or applicable criteria) or ICAO Doc 9905 (or applicable
criteria).
References CAR-ANS Parts 4 and 15.
CAR - SM
This MOS.
The FPD and the IFP processes should not be considered as stand-
alone processes. It is important to consider the supporting processes
(mostly activities that are performed once, such as the software
validation, or on a regular schedule, such as training) and the upstream
and downstream processes that trigger or are triggered by the FPD and
IFP processes.
4.3.4.1.1.3 The user requirements (e.g. type of functions, coverage of the tool in
reference to the applicable criteria, adequacy of human-machine
interface (HMI) should be captured and taken into consideration during
the selection of the software solution. This selection should consider
the needs of the end user and should be based on the volume,
complexity and type of flight procedure(s) to be designed or maintained
by the flight procedures design unit.
4.3.4.1.1.4 To address specific issues that might appear later during the
operational use of the software, a close relationship between the user
and the software provider is encouraged.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 4 – FLIGHT PROCEDURE QUALITY ASSURANCE
SYSTEM
SYSTEM dangerous flight procedures. When automation is used during the
procedure design process, CAAP requires that automation functions
have been validated to ascertain compliance of the final results with
applicable criteria. Chapter 6 of this MOS — Flight Procedure Design
Software Validation provides guidance on such validation processes
and details one method that may be employed for validation of
procedure design tools.
4.3.4.1.2 Training
4.3.4.2.1.1 Quality assurance for the IFP process starts at the point of data
origination. Data origination addresses the functions performed by
requesting authorities and originating authorities, surveyors and any
other third-party organizations supplying aeronautical data to procedure
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 4 – FLIGHT PROCEDURE QUALITY ASSURANCE
SYSTEM
designers. Such functions include, for example, surveying coordinates
of the runway end or of navigation aids.
4.3.4.2.1.2 The data origination phase is one of the most critical stages of the data
chain, as some errors cannot be easily detected in the subsequent
steps of the process.
4.3.4.2.2.1 The FPD process is closely linked to the AIS process, since one of the
objectives of the design is to have the procedure published in the AIP.
For this purpose, the procedure design process includes a phase
related to the preparation of the elements to be published. These may
include basic elements being provided to the AIS office in the
preparation of a detailed (draft) procedure chart to be subsequently
processed by AIS. The AIS office is responsible for the integration of
the designed procedure in the official CAAP publication (AIP),
according to the regulations laid down in CAR-ANS Part 4 and
CARANS Part 15.
4.3.4.2.2.2 The AIS office may have to process the elements forwarded by the
procedure designer, including the procedure layout of the design, in
order to make them compliant with the applicable regulations and
consistent with the national publication standards, as appropriate. The
outcome from this process may be different from the original
submission of the procedure designer. It is therefore essential that the
procedure designer review the outcome of the AIS process prior to
publication. This review must include a check of completeness and of
consistency of the publication with the result of the FPD.
4.3.4.2.2.3 The processes between the procedure design office and the AIS office
shall be defined and formalized, for example, through a quality process
or through a service level agreement.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 4 – FLIGHT PROCEDURE QUALITY ASSURANCE
SYSTEM
SYSTEM IFP according to the ARINC 424 Navigation System Database
Standard which is the international industry standard. When the IFP is
loaded by each database supplier, numerous edit checks are
performed to ensure that when flown in airborne navigation units the
procedure will function as designed by the procedure designer. These
edit checks, however, do not check for information such as altitudes,
compliance with PANS-OPS or procedure design
4.3.4.2.3.3 There are three significant layers of standards in the ARINC 424
document. The first is the standardization of the fields that contain
various items of aeronautical information. The next level is the
standardization of what attributes are assigned to each type of
information, e.g., VORs include frequency, coordinates, class of navaid.
The next level is the standardization of each record of information, e.g.,
VOR records include in column one whether the navaid is standard or
tailored, and columns two through four include the geographical area of
the world.
4.3.4.2.4.1 When the database supplier completes the coding of the database and
the ARINC 424 compliant database is created for the next AIRAC cycle,
the next step of the process is to create the airborne database for the
specific avionics system, specific airline, specific geographical
coverage and various other parameters. This process of converting
ARINC 424 data into airborne databases is typically known as the
packing process. The packing process is sometimes performed by the
avionics manufacturers and sometimes by the database supplier using
software created and maintained by the avionics manufacturer.
4.3.4.2.4.2 There is typically an earlier information cut-off date for the database
suppliers since the creation of the ARINC 424 compliant database must
be followed by the packing process and then sent to the airlines. Most
airlines need at least seven days to ensure that all their airplanes get to
a location where the next data cycle can be loaded before the effective
date.
4.3.4.2.4.3 Because avionics systems using databases have been in use since the
early 1970s, there are many differences in the capability of the systems
in operation today.
4.3.4.2.4.4 It is important to note that some of the packing processes will make
modifications to the ARINC 424 compliant database to ensure it will
work in the target avionics system.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 4 – FLIGHT PROCEDURE QUALITY ASSURANCE
SYSTEM
The following subsections reflect all the steps of the process flow in
Figure 4.2 and provide additional comments and explanations. All of the
steps relate to the same number of the process (for example, 4.4.1
Initiation relates to process Step 1 — Initiation).
4.4.1.2 A formal written approval/ service order/ signed contract to proceed with
the development of the IFP design and a copy of the formal request
from stakeholders (if such is the reason for initiation) stands as the
quality record valid for submission as evidence that Step 1 has been
appropriately implemented.
4.4.1.3 The necessity for a change can also ensue from the need to review
existing procedures. Published procedures must be subjected to a
periodic review to ensure that they continue to comply with changing
criteria and meet user requirements. The interval for this review is five
years.
4.4.1.4 The main reasons for the request must be stated, e.g., safety
enhancement, efficiency of operations, environmental considerations.
The request may be tied to a change in the aerodrome infrastructure or
airspace structure.
4.4.1.6 As far as possible, indicators associated with the key objectives should
be provided (Example: reduction of the minima by [xx] ft).
4.4.1.7 Stakeholders
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 4 – FLIGHT PROCEDURE QUALITY ASSURANCE
SYSTEM
SYSTEM
4.4.1.7.2 If the request for the initiation of an IFP is submitted with a
predetermined solution that might not fit into the global picture,
discussions with the involved stakeholders should take place. The final
request should be an agreed consensus, as far as possible, between
the stakeholders including the procedure designer.
4.4.1.9.2 The review process should also ensure that the proposed change:
a) fulfils the expected operational requirements;
b) meets the needs of the airspace users;
c) complies with the requirements of relevant government
departments (such as Transport and Environment);
d) is achieved within the proposed timescale;
e) is adequately resourced; and
f) does not conflict with any other airspace plans.
4.4.1.10 Documentation
The IFP request and the results of the formal review, including reasons
for approval or rejection, should be fully documented. Copies of the
document should be retained by the reviewing organization, the
originator and within the IFP work file. An overall plan for all outstanding
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 4 – FLIGHT PROCEDURE QUALITY ASSURANCE
SYSTEM
requests and ongoing IFP projects with assigned priorities should also
be maintained and made available to all stakeholders.
4.4.2.1 The procedure designer must ensure that specific ATS requirements
related to local traffic patterns (altitude, direction and airspeed),
feeder/transitions, arrival/departures, preferred routes, ATS routes,
communication facilities, time, restrictions and any ATS needs,
restrictions or problems are available from the ATS provider.
4.4.2.2 The designer must collect the following data from recognized sources,
validate for accuracy, resolution, integrity, reference geodetic datum
and effective dates, and incorporate them into the design
documentation:
a) terrain data: electronic raster and/or vector data or paper
cartographic maps;
b) obstacle data: man-made and natural with their coordinates and
elevation;
c) aerodrome/heliport data, e.g. ARP/HRP and runway(s) with their
coordinates and elevation, lighting, magnetic variation and rate of
change, weather statistics, altimeter source;
d) aeronautical data: airspace structure, classifications (controlled,
uncontrolled, Class A, B, C, D, E, F, G, name of controlling
agency), airways/air routes, altimeter transition altitudes/flight
levels, neighboring instrument procedures, area(s) of magnetic
unreliability;
e) navaid data: coordinates, elevation, service volume, frequency,
identifier, magnetic variation; and
f) existing significant points to local navigation.
Compatibility of the IFP with existing ATS procedures for the elected
location and for the immediate surroundings if several aerodromes
operate IFPs.
4.4.2.3.2 Users
a) Need to shorten trajectories;
b) Enhanced guidance;
c) Availability of vertical guidance;
d) Lower minima; and
e) Enhanced flyability.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 4 – FLIGHT PROCEDURE QUALITY ASSURANCE
SYSTEM
SYSTEM
4.4.2.3.3 Airspace design
a) Constraints given by existing airspaces;
b) Requirements for additional / restructured airspace; and
c) Danger / restricted and prohibited areas.
4.4.2.3.5 Schedule
The term metadata refers to information “about” the data rather than the
data themselves. For example, the quality characteristics associated
with a data value are metadata. As an example: an accuracy definition
of plus or minus one meter for runway length is metadata about the
actual value of the runway length. The use of the term “data” below
addresses both actual data values and metadata.
4.4.2.5.1 Defined data quality requirements for inputs to the FPD process are key
elements to ensure proper safety margins required by procedure design
criteria. For example, appropriate obstacle clearance altitude/heights
can only be determined if the accuracy of the input data is known.
4.4.2.5.2 Accuracy, resolution and integrity are the key quality requirements
related to the data inputs to the FPD process as defined in CAR-ANS
Part 11 – “Air Traffic Services”, CAR Aerodromes, CAR-ANS Part 15 –
“AIS” and MO- AIS.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 4 – FLIGHT PROCEDURE QUALITY ASSURANCE
SYSTEM
b) Aerodrome operator/ Land surveyors – as data originators for
aerodrome and obstacle data should ensure that the data in the
publication is valid and updated;
c) CNS Office - as data originators for navaid data should ensure that
the data in the publication is valid and updated;
d) Other Stakeholders (i.e. ATS and Air Operator) – provides user
requirements and other concerns that should be valid and
justifiable; and
e) Other data owners include MET service provider for MET
information, ATS for data on the airspace environment, etc.
4.4.2.5.5 The “validation” of the data collected from the list above, is the
responsibility of the IFP designer in such a way that he/she gains
sufficient confidence of the quality (integrity, accuracy and resolution),
of data necessary for IFP design. Data collected by the IFP designer
which do not coincide with data published in the AIP must be
coordinated immediately to the data owner who will in-turn coordinate
with the AIS for amendment of published information in accordance to
CAR-ANS Part 15 and MOS AIS.
4.4.2.5.6 The vector or the mechanism used to transmit the data is critical to
maintain data integrity. PDSPs should as much as practicable minimize
manual human intervention in transmitting/ encoding data.
The acquisition of data for the FPD process must ensure that the
acquired data’s quality characteristics are known and adequate, or that,
in the case where the data’s quality characteristics are unknown or
inadequate (invalid), that appropriate data verification (see verification,
section 4.4.2.8) occurs prior to use.
4.4.2.7.1 All data sources must be identified. The status of the suppliers of critical
and essential data elements should be established and reviewed on a
regular basis.
4.4.2.7.3 The AIP Philippines, being required to have undergone a QMS process
for publication is endorsed by CAAP, as a reliable source of quality
data.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 4 – FLIGHT PROCEDURE QUALITY ASSURANCE
SYSTEM
SYSTEM
4.4.2.8 Incoming data verification and validation
4.4.2.8.1 All data received from a supplier that will be used in the FPD process
must be validated against the data quality requirements. If the data are
validated as having met the data quality requirements, then the data
may be used without additional verification.
4.4.2.9 Documentation
4.4.3.4 The procedure designer may, as an input for this activity, draw on
earlier designs if available and use the outputs of the previous steps
such as presentation notes containing design objectives and indicators
as well as the requirements and constraints and the verified data
collated in the previous steps.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 4 – FLIGHT PROCEDURE QUALITY ASSURANCE
SYSTEM
4.4.3.5 The intention would then be to develop a design strategy for the
procedure based on PANSOPS (ICAO Doc 8168) and/or other
applicable criteria (e.g. ICAO Doc 9906 for RNP AR) as well as the key
inputs stated above.
4.4.4.2 At least two (2) AIRAC cycles from the cut-off date shall be considered
for the planned effective date.
Example: For an IFP with a target date of effectivity on December 31,
2020, the complete data shall be submitted to the AIS before the cut-
off date, August 21, 2020.
Once the relevant data have been collected and the conceptual IFP has
been approved, the design activity can commence. An individual
designer should be nominated as the responsible designer. Continued
coordination with interested/affected stakeholders should be
maintained throughout the design phase.
4.4.5.1 Criteria
4.4.5.1.1 CAAP adopts the international procedure design criteria detailed in the
current applicable version of PANS-OPS (ICAO Doc 8168), Volume II.
Procedure design criteria for Required Navigation Performance
Authorization Required (RNP AR) IFPs can be found in the RNP AR
Procedure Design Manual (ICAO Doc 9905). ICAO regularly reviews
and amends these criteria.
4.4.5.1.3 Whenever changes to the criteria are published, the procedure design
organization should review these to determine an appropriate
implementation plan. If the change in the criteria is deemed to be a
safety-critical element, it should be carried out immediately.
4.4.5.1.4 CAAP may also elect to define national procedure design criteria for
use with existing PANSOPS criteria as applicable in the interest of
aviation safety. Such additional or alternate design criteria should never
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 4 – FLIGHT PROCEDURE QUALITY ASSURANCE
SYSTEM
SYSTEM be used together with PANS-OPS criteria unless they have been
developed specifically for that purpose.
4.4.5.2.1 In order to make sure that a procedure design tool is appropriate for the
FPD concept, it must be subjected to both a validation process (for
compliance with applicable criteria) and an assessment of compliance
with user requirements (concerning available functions, HMI and
documentation).
4.4.5.2.2 The design methods employed during the FPD process should be
thoroughly validated and clearly documented. Procedure designers
should receive adequate training in applying the approved methods.
Care should be taken that only the approved methods are applied
during the FPD process.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 4 – FLIGHT PROCEDURE QUALITY ASSURANCE
SYSTEM
4.4.5.3.2 To enhance the integrity throughout the design process, the use of
automated or semi-automated tools is recommended.
4.4.5.4 Documentation
4.4.5.4.1 On the basis of these activities, the resulting FPD usually comprises
one or several draft procedure layouts, a textual description of the
procedures as well as calculations and coordinates. These documents
are then used as a basis for the design verification and are the input for
the determination of the “level-of-safety” impact of the design.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 4 – FLIGHT PROCEDURE QUALITY ASSURANCE
SYSTEM
SYSTEM
4.4.5.4.3 The documentation should include a clear statement of compliance with
CAAP-approved criteria together with detailed notes on any deviations
and evidence of approval for each deviation. There should also be a
record of each design review and sign-off.
4.4.6.1 Traceability is the key element in the design of a new IFP. All
assumptions made and methods used in the implementation of a new
or modified FPD should be documented in a uniform manner and kept
available at least during the lifetime of the IFP.
4.4.6.5 The minimum period of time during which this documentation must
remain available after a full re documentation following a review of the
procedure or a withdrawal of the existing procedure shall be no less
than five (5) years from the official date of review or withdrawal.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 4 – FLIGHT PROCEDURE QUALITY ASSURANCE
SYSTEM
This section provides a minimum of information on safety activities. For
more detailed information please refer to the CAR - SM or Safety
Management Manual (ICAO Doc 9859).
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 4 – FLIGHT PROCEDURE QUALITY ASSURANCE
SYSTEM
SYSTEM A “safety assessment of changes” must be systematically and formally
conducted each time an element is changed or newly introduced in the
ATM system lying within the Air Traffic Service Provider's managerial
control. However, existing elements not being affected by modifications
may also be questioned in respect to safety. In such cases, the trigger
is different but a “safety assessment of safety issues” may be
conducted based on the usage and application of similar tools and
principles.
4.4.7.1.7.2 It is important to assess the level of the safety impact. Determining this
may be accomplished by measuring the impact in various domains,
such as:
a) operational consequences of the change;
b) operational consequences for external partners;
c) level of new functionality introduced in contrast to the existing
systems;
d) number of technical systems affected by the change;
e) amount of training or amount of additional staffing needed; and
f) complexity of the transition from the existing system.
4.4.7.2.2 Safety assessments for the FPD should therefore focus on two main
elements. These are:
a) application of methods for the design of a flight procedure, looking
at the methods from the reception of the requests, the application
of the criteria, the handling of data throughout the process, the
design aspects, including cross-checking, the publication process,
etc.; and
b) the implementation of a procedure, looking at the interface with
other procedures available in that location, the complexity and the
workload imposed on ATC, cockpit workload, flyability, etc.
4.4.7.2.3 The overall aim should be to address the following five (5) safety
assurance goals:
a) show that the underlying concept of the whole procedure is
intrinsically safe — i.e. that it is capable of satisfying the safety
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 4 – FLIGHT PROCEDURE QUALITY ASSURANCE
SYSTEM
criteria, assuming that a suitable design could be produced — and
what the key parameters are that make it so;
b) show that everything necessary to achieve a safe implementation
of the procedure — related to equipment, people and airspace
design issues — has been specified;
c) the design is correct — meaning, for example, that:
i) the design is internally coherent — It is consistent in
functionality (in equipment, procedures and human tasks),
and in use of data, throughout the system;
ii) all reasonably foreseeable normal operational conditions
have been identified, including such elements as adjacent
procedures and airspace; and
iii) the design is capable of meeting the safety criteria under all
reasonably foreseeable normal operational conditions/range
of inputs (in the absence of failure);
d) show that the design is robust — meaning that:
i) the system can react safely to all reasonably foreseeable
external failures; and
ii) the system can react safely to all other reasonably
foreseeable abnormal conditions in its environment;
e) show that the risks due to internal failure have been mitigated
sufficiently such that, overall, the safety criteria are still satisfied.
This typically needs to show that:
i) all reasonably foreseeable hazards not directly linked to the
safety case but possibly impacting the safety case have been
identified (e.g. loss of communication, loss of navigational
capabilities);
ii) the severity of the effects from each hazard has been
correctly assessed, taking account of any mitigations that
may be available / could be provided external to the system;
iii) safety objectives have been set for each hazard such that the
corresponding aggregate risk is within the specified safety
criteria;
iv) all reasonably foreseeable causes of each hazard have been
identified;
v) safety requirements have been specified (or assumptions
stated) for the causes of each hazard, taking account of any
mitigations that are/could be available internal to the system,
such that the safety objectives are satisfied; and
vi) those safety requirements are realistic — i.e. they are
capable of being satisfied in a typical implementation of
aircraft and ground equipment, people and procedures.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 4 – FLIGHT PROCEDURE QUALITY ASSURANCE
SYSTEM
SYSTEM and its implementation in the existing ATM environment might trigger
safety issues. These safety issues should be considered and
adequately mitigated prior to the operational use.
4.4.8.4 The “verifier” designer should endorse the IFP design technical report.
4.4.8.5 Validation is the necessary final quality assurance step in the procedure
design process (FPD), prior to publication. The purpose of validation is
to verify all obstacle and navigation data, and assess the flyability of the
procedure. Validation normally consists of ground validation and flight
validation. Ground validation must always be undertaken as arranged
by the designer. When CAAP can verify, by ground validation, the
accuracy and completeness of all obstacle and navigation data
considered in the procedure design, and any other factors normally
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 4 – FLIGHT PROCEDURE QUALITY ASSURANCE
SYSTEM
considered in the flight validation, then the flight validation requirement
may be dispensed with.
Note. - Obstacle and navigation data verified by CAAP may be in the
form of recently updated AIP and duly signed Airfield Update Reports
as attested by data owners (i.e. aerodrome operator, ADMS Survey
Team, CNS service provider) thoroughly reviewed and endorsed by
AANSOO for publication.
4.4.8.7 The ground validation will also determine if flight validation is needed
for modifications and amendments to previously published procedures.
The ground validation should also:
a) Review IFP design outputs:
i) Obstacle data,
ii) Navigation data to be published / airport infrastructure,
iii) ARINC 424 data and coding proposal,
iv) Flyability of the trajectories,
v) Charting information,
vi) Operational characteristics and minima (wind, speed, bank
angles, gradients…), and
vii) Crew training or aircraft equipment requirements;
b) compare the intended use of the IFP to the initial stakeholder
expectations and to the conceptual design; and
c) consider the outcome of the safety activities in regards to correct
application.
4.4.8.8 Ground validation may include the use of desktop simulation tools
and/or require the use of flight simulators. For RNP AR designs, the use
of flight simulator prior to the actual flight validation is a must.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 4 – FLIGHT PROCEDURE QUALITY ASSURANCE
SYSTEM
SYSTEM f) the IFP is Helicopter PinS; and
g) required by CAAP (see 4.4.11).
4.4.8.11 The results of the validation can trigger changes to the initial design.
The changes can be communicated to the original designer for review
and incorporation, or, the verifier may make the changes and submit
them to the designer for verification. It is important that any changes
made are clearly documented and traceable.
4.4.9.1.1 For the purposes of quality assurance in the procedure design process,
flight inspection and flight validation are separate activities that, if
required, may or may not be accomplished by the same entity. Flight
inspection is conducted with the purpose of confirming the ability of the
navigation aid(s) upon which the procedure is based to support the
procedure in accordance with the standards in CAR-ANS Part 10 —
Aeronautical Telecommunications and guidance in the Manual on the
Testing of Radio Navigation Aids (ICAO Doc 8071). Flight validation is
concerned with factors, other than the performance of the navigation
aid, that may affect the suitability of the procedure for publication.
4.4.9.1.2 The PDSP does not normally have the expertise necessary to
determine under which conditions flight inspection and/or flight
validation may be necessary. CAAP is responsible for the overall
performance of the procedure, as well as for the quality and suitability
of the procedure for publication. For this reason, CAAP, may require a
review of the procedure by the FICG or other flight inspection and flight
validation organizations as part of the procedure design approval
process. This function can also be accomplished during the ground
validation if the personnel performing the ground validation are suitably
qualified to make determinations concerning flight inspection and/or
flight validation requirements. FVPs may participate in the conduct of
ground validation as much as IFP designer can participate to the flight
validation/inspection activities.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 4 – FLIGHT PROCEDURE QUALITY ASSURANCE
SYSTEM
4.4.9.1.4 Personnel performing flight inspection duties should be qualified and
certified in accordance with applicable ICAO Doc 8071, Volume I,
Testing of Ground-Based Radio Navigation Systems. 3.6 of this MOS
contains the prescribed minimum qualifications, competency and
training requirements for flight validation pilots, including those flight
inspection pilots that perform flight validation of IFPs. 3.6 of this MOS
also contains the establish standards for the required competency for
flight validation pilots. Appendix 5 contains qualifications and training,
as well as guidance concerning the skills, knowledge and attitudes
(SKA) to be addressed in training and evaluation of flight validation
pilots.
4.4.9.2.2 This liaison should provide the datahouses with additional advance
notice of the proposed changes and should allow them to review the
proposed procedures, clarify any outstanding questions and advise
CAAP of any technical issues that may be identified.
4.4.10.2 At this stage, those areas of specific competency that the PDSP does
not possess should be validated by the stakeholders competent in that
domain. A written statement from those entities, or other proof of
concurrence (duly signed minutes of meetings by those entities, emails,
etc.) will serve for the approval process of the IFP.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 4 – FLIGHT PROCEDURE QUALITY ASSURANCE
SYSTEM
SYSTEM
4.4.11.2 The IFP must be approved by CAAP, prior to publication and use. The
approval process is meant to ensure that all the appropriate steps within
the IFP process have been completed, documented and signed off by
the competent authority.
4.4.11.3 Approval of the IFP is a formal decision of CAAP that endorses not just
the overall implementation process but also the following “control steps”
contained within the process ensuring that performance does not
deviate from standards:
a) set standards;
b) measure performance;
c) compare performance to standards;
d) determine the reasons for deviations; and then
e) take corrective action as needed.
4.4.11.7 The PANS-OPS safety inspectors may participate in any or all activities
in the process as deemed necessary by AANSOO, or as requested by
a stakeholder. Further, the PANS-OPS safety inspectors may conduct
its own criteria verification, ground validation and/or employ the
services of an FVSP to verify validation reports submitted by the PDSP
as part of their tasks related to CAAP approval obligations.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 4 – FLIGHT PROCEDURE QUALITY ASSURANCE
SYSTEM
4.4.12.1 This step commences when the IFP is approved by the DG or an
endorsement from AANSOO is received to proceed with the creation of
draft publication.
4.4.12.2 At this stage of the process, all the elements for the draft publication
are available.
4.4.12.3 IFP designer forwards the following items produced during the design:
a) A procedure lay-out or draft of the chart to be published or
b) at least the data to be published;
i) Drawing of the IFP,
ii) Obstacle/terrain,
iii) Navaids/Comms,
iv) Textual information,
v) Coding tables (if applicable),
vi) List of points (waypoints/ reporting points) and coordinates,
vii) Restrictions/ requirements and additional ATC procedures,
and
viii) Other pertinent data to be published.
4.4.12.4 The AIS or charting group develops the chart taking into account all
relevant requirements for the safe operation of the procedure.
4.4.13.1 The draft of the new chart developed by the AIS should also be
submitted to all stakeholders, particularly the designer and the
procedure owner. Once all corrections, comments and suggestions
solicited from the stakeholders, the designer and the procedure owner
are aggregated, the drafting of the final chart for publication can
proceed in consideration of the corrections, comments and
suggestions.
4.4.13.2 The designer has to cross-check the final draft of the instrument flight
procedure chart must be verified as to completeness and correctness.
It is recognized that this may be considered an AIS responsibility also.
Note. - AANSOO may participate in this activity for any regulatory
clarifications that may be raised.
4.4.14.1 The stakeholders should also receive a copy of the draft publication at
this stage to facilitate the data integration and packing while the AIRAC
publication process is being implemented.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 4 – FLIGHT PROCEDURE QUALITY ASSURANCE
SYSTEM
SYSTEM
4.4.14.2 Publication will be in accordance to applicable exiting national
regulations.
4.4.15.3 CAAP appreciates any feedback from these stakeholders and shall
treat it as particularly relevant.
4.4.15.4 CAAP also enjoins the PDSPs to conduct regular meetings and/or
consultation (questionnaires) with stakeholders for the purpose of
soliciting feedbacks regarding use of an IFP. Feedbacks solicited thru
these means shall be forwarded to CAAP in the same manner
described in 4.4.15.1.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 4 – FLIGHT PROCEDURE QUALITY ASSURANCE
SYSTEM
4.4.15.7 Any decision/action by the PDSP management brought about by the
feedback from stakeholders shall be documented and advised to
AANSOO.
4.4.16.3 Criteria changes are assessed only if required or during the next
periodic review. Criteria changes may also be considered in cases
where there would be a significant advantage to the user.
4.4.16.6 The review of IFP during this step focuses only on a relevant particular
part of the IFP.
4.4.16.7 Maintenance differs from the periodic review as it has no specific time
for implementation, but rather is triggered for specific reason, such as
but not limited to:
a) Feedback from users/stakeholders (see 4.4.15);
b) ATS wants modified trajectories for flow segregation and other
ATC concerns;
c) Pilots not satisfied with final approach gradient;
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 4 – FLIGHT PROCEDURE QUALITY ASSURANCE
SYSTEM
SYSTEM d) Design criteria update/modification that is safety critical and there
is significant advantage to the user;
e) Change in input data with safety critical impact;
f) Change in length of runway;
g) Change in PAPI slope; and
h) Others.
4.4.17.1 In accordance to 1.8, the PDSPs should review the IFPs they
developed and are tasked to maintain. The PDSPs should ensure that
all changes to obstacles, aerodrome, aeronautical and navaid data,
changes to criteria, user requirements and depiction standards are
assessed. If action is required, return to Step 1 to reinitiate the process.
4.4.17.3 It is important to note that the IFP process, as such, does not have an
“end” box. The quality process extends over the entire life cycle of the
procedure. When the procedure is decommissioned, specific activities
are needed to allow the withdrawal of an active procedure.
4.4.17.6 CAAP through AANSOO’s oversight activities will verify that this step is
being implemented.
Note. – See also 3.4.2.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 5 – VALIDATION OF INSTRUMENT FLIGHT
PROCEDURES
CHAPTER 5
5.2.1 The full validation process includes ground validation and flight
validation.
5.2.4 When CAAP can verify, by ground validation, the accuracy and
completeness of all obstacle and navigation data considered in the
procedure design, and any other factors normally considered in the
flight validation, then the flight validation requirement may be
dispensed with.
Note. - Obstacle and navigation data verified by CAAP may be in the
form of recently updated AIP and duly signed Airfield Update Reports
as attested by data owners (i.e. aerodrome operator, ADMS Survey
Team, CNS service provider) thoroughly reviewed and endorsed by
AANSOO for publication.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 5 – VALIDATION OF INSTRUMENT FLIGHT
PROCEDURES
FUNCTION c) the accuracy and/or integrity of obstacle and terrain data cannot
be determined by other means;
d) the new IFP differs significantly from existing IFPs;
e) the IFP is RNP AR;
f) the IFP is Helicopter PinS; and
g) required by CAAP (see 4.4.11).
5.2.6 The validation process flow diagram in the context of the flight
procedure design process is as follows:
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 5 – VALIDATION OF INSTRUMENT FLIGHT
PROCEDURES
b) date,
c) activities performed,
d) type of simulator or aircraft,
e) any findings and flight validation pilot comments and operational
recommendations.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 5 – VALIDATION OF INSTRUMENT FLIGHT
PROCEDURES
FUNCTION design from a flight operational perspective. The necessary
further steps in the validation process are determined.
Inventory and review IFP package
Evaluate ARINC 424 data and coding
Review special operational and training requirements
Coordinate operational issues
Determine required further steps in the validation
process
Input IFP package including:
IFP graphical depiction
Submission forms
Charts/ maps
Flight inspection records for navaids/sensors used in
the development of IFP
Safety assessment report as applicable
Output Approval to proceed with the validation process. If
correction is required, return IFP to designer to
reinitiate validation process after correction.
Determination of further steps in the validation
process
Crew and required aircraft scheduling
Determination of required weather minima and
navaids to proceed to FV
Determination of FI requirements in conjunction to FV
Determination of simulator evaluation requirements
Input to final safety assessment report as applicable
Parties FVP
Involved Flight procedure designer
Any other appropriate stakeholder, such as:
ATC
Airports
Flight inspection/validation service provider
Quality PV report
Records
References CAR-ANS Parts 4, 10, 11, 15, CAR Aerodromes
PCAR Part 8
ICAO Doc 8071
ICAO Doc 8168, Volumes I and II
Quality Assurance Manual for Flight Procedure Design
(ICAO Doc 9906)
ARINC 424
Applicable CAAP regulations
CAAP forms (see appendices)
Phase STEP 3 Conduct Simulator Evaluation
Flight Description Recommended step for complex procedures or procedures
Validation requiring waiver/mitigation for deviations from design criteria.
Verify chart depictions and details
Assess flyability and Human Factors
Conduct associated validation tasks
Record flight validation
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 5 – VALIDATION OF INSTRUMENT FLIGHT
PROCEDURES
Document the results
Input IFP graphical depiction
ARINC 424 IFP database
Output Flyability validation
Input to final safety assessment report as applicable
Recorded data
Findings and operational mitigations
Parties FVP
Involved Flight procedure designer as appropriate
Quality Flight simulator evaluation report
Records Findings and operational mitigations
References Quality Assurance Manual for Flight Procedure Design
(ICAO Doc 9906)
This MOS
Phase STEP 4 Conduct Flight Evaluation
Flight Description Perform flight evaluation in order to:
Validation Verify data
Verify chart depictions and details
Assess obstacle infrastructure
Assess airport infrastructure
Assess flyability and Human Factors
Conduct associated validation tasks
Record flight validation
Input FV package
SIM evaluation report (if available)
Output Validated IFP
Findings and operational mitigations
Input to final safety assessment report as applicable
Recorded data
Parties FVP
Involved Flight procedure designer as appropriate
Quality Findings and operational mitigations
Records Recorded data
References Manual on Testing of Radio Navigation Aids (ICAO Doc
8071)
Quality Assurance Manual for Flight Procedure Design
(ICAO Doc 9906)
CAR-ANS Part 4 and MOS-Aeronautical Charts
ICAO Doc 8168, Volume II
Phase STEP 5 Produce Validation Report
Ground Description This final step is to assure proper completeness of all forms
Validation and reports to validate the entire FPD package. The validation
report should consist of individual reports of all steps
performed in the validation process.
Input Findings and operational mitigations
Recorded data
Output Validation report
Flight Inspection report (when performed)
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 5 – VALIDATION OF INSTRUMENT FLIGHT
PROCEDURES
FUNCTION
Parties FVP and/or
Involved Flight procedure designer
Quality GV report
Records FV report
Flight inspection report (when performed)
References Quality Assurance Manual for Flight Procedure Design
(ICAO Doc 9906)
CAAP forms (see appendices)
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 5 – VALIDATION OF INSTRUMENT FLIGHT
PROCEDURES
program detailed in ICAO Doc 8071 and CAR-ANS Part 10. Flight
inspection must be performed by a qualified flight inspector using a
suitably equipped aircraft.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 5 – VALIDATION OF INSTRUMENT FLIGHT
PROCEDURES
FUNCTION
A flight procedure designer other than the one who designed the
procedure must perform this step. The designer can be assisted by
specialists in other fields of expertise as necessary.
The origin of any data (airport data, navigation aids data, waypoints
data, obstacles data, terrain data) should be known. Using data from
a known source usually allows the accuracy and the integrity of the
data to be determined. If data from unknown sources is used or if data
accuracy and/or integrity cannot be adequately determined, the data
should be validated. This can be done through flight validation or
through CAAP-approved ground-based methods (see 5.6.1.6).
Note: - Obstacle and navigation data verified by CAAP may be in the
form of recently updated AIP and duly signed Airfield Update Reports
as attested by data owners (i.e. aerodrome operator, ADMS Survey
Team, CNS service provider) and thoroughly reviewed and endorsed
by AANSOO for publication.
5.6.1.5 Confirm correct FMS behavior using desktop software simulation tools
(if required)
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 5 – VALIDATION OF INSTRUMENT FLIGHT
PROCEDURES
5.6.1.6.1 For cases where obstacle and/or terrain data accuracy and/or integrity
cannot be guaranteed, ground-based obstacle assessment methods
can provide an alternative to an assessment with an aircraft. Ground-
based methods acceptable to CAAP includes on-site obstacle survey
using industrial-grade handheld GPS and range finders with vertical
accuracy of at least ± 3meters and lateral accuracy of at least ± 3meter
under ideal conditions. The use of drones is encouraged, provided,
the drone operation is conducted in accordance to CAAP regulations
on the use of RPAS. The ground validation report should include, the
individual/ group who conducted the on-site survey, their signatures,
the findings of the activity, a description of the methodology employed
with the accuracy specifications of the equipment used.
The person(s) performing the pre-flight validation must ensure that the
IFP documentation is complete and all necessary charts, data and
forms are available. As a minimum, the following tasks must be
performed:
a) Ensure completeness of package (all forms, files and data
included) as described in 5.5.1 of this MOS.
b) Ensure charts and maps are available in sufficient detail for
assessment of the IFP during the FV.
c) Familiarize with target population of the procedure (e.g. aircraft
categories, type of operation).
d) Discuss the procedure package with the procedure designer, as
necessary.
e) Verify procedure graphics and data match.
f) Compare the IFP design, coding and relevant charting
information against the navigation database used for flight
validation.
g) Verify that controlling obstacles and obstacles otherwise
influencing the design of the procedure are properly identified.
h) Review airport infrastructure and special airport regulations.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 5 – VALIDATION OF INSTRUMENT FLIGHT
PROCEDURES
FUNCTION i) Review the navigation infrastructure used by the procedure.
j) Review pertinent flight inspection documentation, if required.
5.6.2.2.1 For an IFP based on area navigation, the true course to next waypoint,
distances, and altitudes that reflect the flight procedure design must
be verified. Leg segment data accuracy must be evaluated by
comparison of the procedural waypoint data to the flight plan waypoint
data.
5.6.2.2.2 When evaluating CF legs or holding legs (HM, HF, HA), aircraft
navigation performance with the instrument procedure design must be
compared. Any tolerance to course-to-fix values cannot be applied.
Confirmation of proper ARINC coding must be accomplished with
either an appropriately equipped aircraft, or by a desktop evaluation
of the current navigation database.
5.6.2.2.6 Where the flight procedure design involves a complex new procedure
or a significant change to existing procedures/routes in a complex
airspace, CAAP shall liaise with the major commercial navigation data
houses prior to promulgation. This liaison should provide the data
houses with additional advance notice of the proposed changes and
should allow them to review the proposed procedures, clarify any
outstanding questions and advise CAAP of any technical issues that
may be identified. Advance notification of procedures should contain
the following elements:
a) graphical layout of the procedure;
b) textual description of the procedure;
c) coding advice, when applicable; and
d) coordinates of fixes used in the procedure.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 5 – VALIDATION OF INSTRUMENT FLIGHT
PROCEDURES
a) Review deviations from criteria and equivalent level of safety
provided by waivers/mitigations.
b) Review safety case supporting the waiver/mitigation.
c) Assess restricted procedures for special training and equipment
requirements.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 5 – VALIDATION OF INSTRUMENT FLIGHT
PROCEDURES
FUNCTION ii) IFP to newly constructed runways or to runways lengthened
or shortened;
iii) addition or reconfiguration of lights to an existing system
already approved for IFR operations; and
iv) circling procedures intended for night use.
f) Coordinate with ATS and other stakeholders, in accordance with
the instrument flight procedure process.
5.6.3.3 The simulator used, should be suitable for the validation tasks to be
performed. For complex or special procedures where simulator
evaluation is desired, the evaluation should be flown in a simulator,
which matches the procedure requirements. When the procedure is
designed for a specific aircraft model or series and specific FMS and
software, the simulator evaluation should be flown in a simulator with
the same configuration used by the operator in daily operations.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 5 – VALIDATION OF INSTRUMENT FLIGHT
PROCEDURES
i) Assess whether the IFP is ready for further processing in
the validation process.
ii) Provide a detailed written report of the results of the
simulator evaluation.
5.6.3.6.1 To assess the flyability and human factor issues, at least one on-
course/on-path of the proposed procedure in an appropriate aircraft
capable of conducting the procedure should be flown. If different
minima are provided for the same final segment (e.g. LNAV,
LNAV/VNAV, LPV), the evaluation of the final segment must be
accomplished on separate runs. See Appendix 8 for more detailed
Human Factors information.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 5 – VALIDATION OF INSTRUMENT FLIGHT
PROCEDURES
FUNCTION Terrain Awareness Warning System (TAWS) active. Flyability should
be evaluated with the simulator/aircraft coupled to the autopilot (to the
extent allowed by the aircraft flight manual or SOP(s)) and may require
additional evaluation by hand flying.
5.6.4.2 The objectives of a flight evaluation are to validate the intended use
of IFP as defined by stakeholders and described in the conceptual
design and to evaluate other operational factors, such as charting,
required infrastructure, visibility, intended aircraft category, etc.
5.6.4.3 The FVP must occupy a seat in the cockpit with visibility adequate to
conduct the flight validation, and additional crew members must be
briefed on FV requirements. Only task related persons should
normally be allowed on such flights.
5.6.4.4 Ground track path error performance varies with mode of flight
guidance system coupling. New procedures should be evaluated
coupled to the flight director and autopilot (when not prohibited).
Lateral and vertical disconnects from the autopilot/flight director
should be evaluated.
5.6.4.6 The procedure must be flown in the navigation mode using the correct
sensor, or with navigation equipment that permits the flight to be
conducted at an equivalent level of performance, as required by the
design. For example, for IFP based on GNSS, it needs to be ensured
that only the GNSS sensor is utilized during the FV. All following
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 5 – VALIDATION OF INSTRUMENT FLIGHT
PROCEDURES
required steps should be adapted to the specifics of each design and
IFP:
a) Conduct an assessment of flyability to determine that the
procedure can be safely flown.
b) Provide the final assurance that adequate terrain and obstacle
clearance has been provided.
c) Verify that the navigation data to be published is correct.
d) Verify that all required infrastructure, such as runway markings,
lighting, and communications and navigation sources are in place
and operative.
e) Ensure the documentation of navigation systems confirms the
applicable navigation system(s) (navigation aid/sensor, GNSS,
radar, etc.) supports the procedure.
f) Evaluate other operational factors, such as charting, required
infrastructure, visibility, intended aircraft category, etc.
g) Verify that waivers/mitigation for deviations from design criteria
do not compromise safety.
Note. - Where applicable, credit for the results of a simulator
evaluation can be given.
5.6.4.7 For complex procedures including Helicopter PinS and RNP AR,
additional flyability checks are required in the proponent’s aircraft or
simulator.
5.6.4.9 Verification of the spatial data contained in the final approach segment
definition is required. Any error in the coded data with respect to the
proper reference datum may result in improper final approach
guidance to the pilot. The FAS data evaluation system must be
capable of performing the necessary analysis in a documented,
quantitative process as described in paragraph 5.6.4.10.2.
Note. - For GBAS, additional inspection requirements are specified in
the ICAO Manual on Testing of Radio Navigation Aids (ICAO Doc
8071, Volume II; Chapter 4).
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 5 – VALIDATION OF INSTRUMENT FLIGHT
PROCEDURES
FUNCTION should be recorded with a collection/recording device that archives
the procedure and aircraft positioning data (see paragraph 5.6.4.15,
record flight validation). The procedure development package, charts,
and airport data must match. It is recommended that PBN procedures
are packed and loaded electronically into the FMS or suitable
navigation system without manually coding the ARINC 424
path/terminator data. Integrity measures such as cyclic redundancy
check (CRC) should be used to assure that data are not corrupted.
This allows evaluation of the data as designed, without manipulation.
If the procedure waypoint data is manually entered into the FMS, it
must be independently compared to the procedure data to ensure they
match.
a) Ensure the data from the flight validation database matches that
used in the procedure design.
b) Ensure the data produces the desired flight track.
c) Ensure that the final approach course glide path deliver the
aircraft to the desired point in space.
5.6.4.10.2.1 For SBAS and GBAS FAS data, the LTP/FTP latitude and longitude,
the LTP/FTP ellipsoid height and the FPAP latitude and longitude
contribute directly to the final approach alignment and angle.
Corrupted data may skew lateral, vertical, and along track alignment
from the intended design. A direct assessment should be made of the
LTP latitude/longitude, LTP ellipsoid height, and FPAP
latitude/longitude coordinates used in the procedure design. This may
be accomplished using a survey grade GNSS receiver on the runway
threshold while making a comparison with the actual final approach
segment data to be published. Another indirect method is to evaluate
the following IFP characteristics as a means of validating the FAS
data.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 5 – VALIDATION OF INSTRUMENT FLIGHT
PROCEDURES
positioned in a manner that provides a good view of the obstacle
environment that is under consideration. This may require flying the
lateral limits of the procedure protection areas in order to detect if
unaccounted obstacles exist. The controlling obstacle should be
verified for each segment of the IFP. Should unaccounted obstacles
be observed, further investigation by the FVP is required.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 5 – VALIDATION OF INSTRUMENT FLIGHT
PROCEDURES
FUNCTION a) Check to ensure the chart has sufficient detail to safely navigate
and identify significant terrain or obstacles.
b) Ensure all required notes are included (e.g. DME required, do not
confuse RWY 14 with RWY 16, non-standard approach angle
etc.)
c) Ensure that the chart accurately portrays the procedure in both
plan and profile view and is easily interpreted. Ensure flight track
matches chart and takes aircraft to designed point.
d) Verify true and magnetic course to next waypoint indicated on the
FMS or GNSS receiver accurately reflects the procedure design.
(Magnetic courses displayed by the FMS/GNSS navigator may
be dependent upon the manufacturer’s software processing of
magnetic variation.)
e) Verify segment distances indicated by the aircraft navigation
system accurately reflect the procedure design.
f) Verify the flight path angle (FPA) indicated on the FMS or GNSS
receiver accurately reflects the procedure design.
g) Check that waypoint spacing and segment length are sufficient to
allow the aircraft to decelerate or change altitude on each leg
without bypassing.
5.6.4.15.1 A recording device should be used that is capable of the following: IFP
storage, time and 3-dimensional position in space with an acceptable
sampling rate (not less than 1 Hz), and ability to post-process
recorded data.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 5 – VALIDATION OF INSTRUMENT FLIGHT
PROCEDURES
Note. - The recording of HDOP, PDOP, VDOP, HPL and VPL are a
collection of data in a limited timeframe and their purpose is to
document the actual situation at the time of the validation flight.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 5 – VALIDATION OF INSTRUMENT FLIGHT
PROCEDURES
FUNCTION
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 6 – FLIGHT PROCEDURE DESIGN SIFTWARE
VALIDATION
CHAPTER 6
6.1 INTRODUCTION
The term “procedure design tool” stands for any numerical automation
system that provides calculations and/or designs and layouts in the field
of procedure design. This encompasses products ranging from
automated formulas included in spreadsheets to dedicated software
packages.
Procedure design tools include devices which facilitate the work of the
designer during the whole process of procedure design, from data
management to the final output (preparation of the publication).
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 6 – FLIGHT PROCEDURE DESIGN SIFTWARE
VALIDATION
contain errors, or if procedure design criteria compliance is not ensured
through all the Functions provided by such tools. Thus, there is a
significant need to define a validation process for procedure design
tools. Additionally, the validation is a means for users to gain confidence
in a tool.
6.1.2.2 Functional validation falls outside of the scope of this manual. However,
it may be considered by users in addition to the guidelines provided in
this MOS.
6.2.1 The validation process must be recorded in a report that clearly states
the criteria that were considered as reference (with dates and reference
to the last considered amendment), and the extent of coverage of the
software tool with respect to these criteria.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 6 – FLIGHT PROCEDURE DESIGN SIFTWARE
VALIDATION
6.2.2 The report must precisely mention all the items that were tested (with
detailed results) and the items that were excluded from the validation
process. Any limitation to a given function (e.g. altitude restriction for
holding patterns) must be recorded.
6.2.3 The validation report must mention the characteristics of the tests
(dates, name of individuals that have conducted the tests, etc.). The
version of the tool, of the software environment (GIS, CAD, database
management system, etc.), and of the operating system that were used
must be recorded in the report.
6.2.4 Notes and comments from the final users about the compliance with
criteria should be recorded in the validation report.
6.3.1 Whenever the applicable procedure design criteria are updated, the
impact on the procedure design tool must be identified by the procedure
design software developer/provider and evaluated. Should the changes
have an impact on procedure design tool functions, the corresponding
functions of the tool must be revalidated.
6.3.2 Whenever a new version of the software tool is issued, the changes
with reference to the previous version must be identified and their
consequences must be evaluated. Should the new version include new
functions or amendments to previous functions, the tool must be
revalidated.
This chapter provides practical guidance for preparing and carrying out
an actual validation program applied to procedure design tools. It is
applicable to initial validation as well as revalidation for new functions
and/or updates to the procedure design tool and/or to the system
environment.
6.4.1 Preparation
6.4.1.1 The procedure design tool validation requires time and effort. It needs
to be prepared early enough to ensure proper implementation.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 6 – FLIGHT PROCEDURE DESIGN SIFTWARE
VALIDATION
6.4.1.2 For this purpose, it is recommended to develop a work plan defining:
6.4.3.3 The validation should take into account the tests that the procedure
design software developer may have performed. Whenever possible
any evaluations previously performed by the developer should be
repeated at the user site. The developer may be able to furnish the user
with some of the test data sets to be used for this purpose.
6.4.3.4 The tool testing should follow a predefined written plan with a formal
summary of testing and a record of formal acceptance. The tests should
cover the full range of operating conditions so that the system can
encounter a wide spectrum of conditions and events (detection of any
latent faults not apparent during more normal activities).
6.4.3.5 Tool tests should be carried out at the user location, at least for part of
the validation program. User site testing should be accomplished in the
actual working environment that will be part of the installed system
configuration. The testing should be accomplished through use of the
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 6 – FLIGHT PROCEDURE DESIGN SIFTWARE
VALIDATION
tool within the context in which it is intended to function. During user
site testing, records should be maintained of both proper system
performance and any system failures that are encountered. The
revision of the system to compensate for faults detected during this user
site testing should follow the same procedures and controls as for any
other procedure design tool change.
6.4.5.2 For the purpose of continuous improvement of the software, the user is
encouraged to make the validation documentation available to the
procedure design software developer/provider.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
CHAPTER 6 – FLIGHT PROCEDURE DESIGN SIFTWARE
VALIDATION
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
APPENDIX 1 – THIRD-PARTY AUTHORIZATION PROCESS
APPENDIX 1
1.1 Introduction
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
APPENDIX 1 – THIRD-PARTY AUTHORIZATION PROCESS
CAAP is yet to fix a fee for the application and renewal of the 3 rd-Party
PDSP Authorization. However, the cost for the oversight activities
(audits and inspections) of the PANS-OPS Inspectorate (travel and
lodging expenses) will be shouldered by the concerned service
providers.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
APPENDIX 1 – THIRD-PARTY AUTHORIZATION PROCESS
Step 3. The PANS-OPS Inspectorate of the CAAP regulatory body
for ANS reviews and assess the submitted documents for
verification and validation. If not authenticated copies or
certified true copies of documents were submitted, the
authenticity of the documents provided may be verified by
contacting the individual or organization issuing the
document (e.g. the training center indicated in the training
certificate, or the approving CEO for the operations manual
and business information incorporated therein).
Step 4. If there are findings of non-compliance, CAAP regulatory
body for ANS will communicate it with the applicant
immediately. Else, proceed to Step 7.
Step 5. Applicant submits corrective action plans or additional
evidence to address the finding.
Step 6. Repeat Step 3 until all requirements are satisfied.
Step 7. CAAP regulatory body for ANS prepares the Technical
Report and Endorsement for approval/ disapproval for
signature of the DG.
Step 8. Once signed by the DG, the certificate of authorization is
issued to the applicant with a letter enumerating the
conditions to be observed as a holder of authorization.
1.8.2 The validity period of the authorization will be indicated in the issued
certificate and the letter of approval. Authorizations for first time
applicants with less or no record of relevant experience in procedure
design works may be valid for one or two years, after which, they may
opt for renewal. While applicants that demonstrated satisfactory
performance in the field of procedure design may be given
authorizations valid for longer periods not exceeding 5 years.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
APPENDIX 1 – THIRD-PARTY AUTHORIZATION PROCESS
authorization if there are reasonable grounds in accordance to CAR-
ANS Part 16, 16.17.
2. Evidence of Authorization
Satisfactory
issued by other states
Unsatisfactory
preferably another ICAO
Not applicable
member State (if available)
3. Evidence of compliance
Satisfactory
with ICAO Doc. 9906 Vol I -
Unsatisfactory
Quality Assurance Manual
Not applicable
for IFP
Satisfactory
4. PANS-OPS/ IFP Design
Unsatisfactory
Training Certificates
Not applicable
Satisfactory
5. Practical application of
Unsatisfactory
theoretical knowledge
Not applicable
Satisfactory
6. Aviation Experience Unsatisfactory
Not applicable
Satisfactory
7. Quality Record of Practical
Unsatisfactory
Application
Not applicable
8. Receipts for appropriate Satisfactory
fees and charges imposed Unsatisfactory
by the CAAP Not applicable
9. PDSP Manual of
Operations which contains
the following:
a) personnel Satisfactory
requirements and the
Unsatisfactory
responsibilities of
personnel; Not applicable
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
APPENDIX 1 – THIRD-PARTY AUTHORIZATION PROCESS
Satisfactory
b) training and checking
Unsatisfactory
of staff and how that
information is tracked; Not applicable
Satisfactory
c) quality
Unsatisfactory
assurance/safety
management system; Not applicable
Satisfactory
f) fault and defect Unsatisfactory
reporting; Not applicable
Satisfactory
g) maintenance of
Unsatisfactory
documents and
records; and Not applicable
Satisfactory
h) any other information
Unsatisfactory
requested by the CAAP
Regulatory Authority. Not applicable
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
APPENDIX 1 – THIRD-PARTY AUTHORIZATION PROCESS
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
APPENDIX 2 – IFP QUALITY ASSURANCE CHECKLIST
APPENDIX 2
This evaluation is based on Manual of Standards for IFPDS which specifies the step-
by-step process in IFP and the requirements for the approval of the Instrument Flight
Procedures (IFP).
Purposes:
a) To ensure that the Instrument Flight Procedure Design package has met the
necessary documentation of the Quality Assurance Process for Instrument
Flight Procedures.
b) To ensure that the instrument flight procedures can be safely flown and can
be safely integrated in the ATM environment in accordance to 3.7 of the
MOS for IFPDS.
c) To determine the viability of the Instrument Flight Procedure as submitted to
the PANS-OPS Inspectorate Section of ATMSID-AANSOO for proper
endorsement to the Director General of the CAAP for approval.
The following list of instrument flight procedures are evaluated for quality assurance:
Note: The list of documents and evidences should be in place prior to the
endorsement for the approval by the Director General of the CAAP.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
APPENDIX 2 – IFP QUALITY ASSURANCE CHECKLIST
2.2 THE IFP PROCESS FLOW CHART
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
APPENDIX 2 – IFP QUALITY ASSURANCE CHECKLIST
Note:
The FPD and the resulting
IFP, must be quality assured.
STEP 8 states:
Procedure Assessment:
CONCLUSION:
This appendix to MOS IFPDS provides an idea of the scope of an audit and a guide to the requirements to be met by a PDSP.
Only a sample is provided, the actual protocol questions may vary during the actual audit. ATMSID normally provides the auditee with a copy
of the checklists together with the audit notification. Any modification to the checklist shall be forwarded to the auditee at least two weeks before
the first day of audit or during the entry meeting and takes measures to protect any working documents that involve confidential or proprietary
information.
CAR ANS PDSP 004 – Does the □ Yes Review mechanism to determine □ Satisfactory
Part 16 PDSP employ a sufficient □ No number of personnel required □ Not
16.6.1.7.1 number of personnel to Check personnel turn-over rate Satisfactory
enable Check actual number of qualified □ Not Applicable
the designer to carry on personnel involved in design works
design work of instrument
flight procedures?
CAR ANS PDSP 005 – Are minimum □ Yes Review qualifications required for □ Satisfactory
Part 16 qualification requirements □ No new procedures design staff. □ Not
16.6.1.7.1 met by specialists who are Review personnel records. Satisfactory
a) □ Not Applicable
CAR ANS PDSP 006 – Has the PDSP □ Yes Review documented terms of □ Satisfactory
Part 10B developed job description □ No reference and confirm consistent □ Not
10.8.5.2 for its PANS-OPS technical application. Satisfactory
staff? □ Not Applicable
Doc 9734
Part A, C3
CAR ANS PDSP 007 – Does the □ Yes Review training programme and □ Satisfactory
Part 16 PDSP provide a training □ No ensure that it includes □ Not
16.6.1.8 and checking program to competency on new equipment, Satisfactory
ensure that the employees and procedures. □ Not Applicable
CAR-ANS of the designer maintain Verify if it includes, as
Part 10B their competence and are applicable, initial,
10.8.4.4 provided with ongoing recurrent/refresher and
training appropriate to their specialized trainings.
duties? Review personnel training
records
Review evidence of completed
training.
CAR-ANS PDSP 008 – Does the □ Yes Verify personnel training records □ Satisfactory
Part 10B PDSP maintain training □ No □ Not
10.8.5.2 records for PANS-OPS Satisfactory
technical staff? □ Not Applicable
CAR ANS PDSP 010 – Are PANS- □ Yes Review PDSP policy/ contract □ Satisfactory
Part 16 OPS published procedure □ No stipulating the period of validity for a □ Not
16.22 designs by service procedure design Satisfactory
providers reviewed Review PDSP plan/ timelines □ Not Applicable
periodically to ensure that Review implementation
they continue to comply with
changing criteria and meet
user requirements?
The preliminary findings indicated herein and the processes involved in the audit process were explained thoroughly by the
inspector/s and the undersigned is amenable with the preliminary results.
4.1 Introduction
Sample application:
Example 1
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
APPENDIX 4 – SAMPLE PRE-IMPLEMENTATION CHECKLIST FOR
PREPARATION OF IFP IMPLEMENTATION SAFETY ASSESSMENT
4 Did relevant ATC facilities review the new and/or amended
IFP based on the Letter of Agreement (LOA) between
facilities? Is the amended LOA published and in effect?
Comments: (Describe the current situation)
Follow Steps 3-8: conduct safety activity in IFP Design, a PDSP may use a different
hazard identification and safety risk assessment form.
Safety Report
Identification No. Safety Review
XX-APCH RWY 06 Safety
Assessment
Safety Audit
Source
Safety
Observation
Assessment Date:
YYYY/MM/DD Safety Survey
Sampling Survey
Others
Assessment Items (Procedure Name / SID/ STAR/ ATS Route/ IAPCH)
Human Equipment Operational Environment
Category of Hazard Factors
Subject: (LOA to be amended, Training yet to be implemented)
Identification of Details (includes a review of safety incidents of the existing
Hazards procedure(s), if any):
The amendment of LOA is in progress and training for ATCs will
commence after amendment …(list down hazards and its
corresponding consequence)
Probabili 4
Risk 1 2 3 5
ty
Analysi
s Severity A B C D E
Unacceptable
Resulting Risk Acceptable based on risk
(in this example) 3D
Index mitigation
Acceptable
Unacceptable
Risk Index after Acceptable based on risk
(in this example) 2E
Mitigation mitigation
Acceptable
Comments by
Safety Assessment LOA amendment and ATC training should be
Team completed by YYYY.MM.DD
(if necessary)
Steps 8: In case the Risk Index after Mitigation falls under “Acceptable based on risk
mitigation”, management decision may be based on the comments by the Safety
Assessment Team.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
APPENDIX 4 – SAMPLE PRE-IMPLEMENTATION CHECKLIST FOR
PREPARATION OF IFP IMPLEMENTATION SAFETY ASSESSMENT
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
APPENDIX 4 – SAMPLE PRE-IMPLEMENTATION CHECKLIST FOR
PREPARATION OF IFP IMPLEMENTATION SAFETY ASSESSMENT
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
APPENDIX 4 – SAMPLE PRE-IMPLEMENTATION CHECKLIST FOR
PREPARATION OF IFP IMPLEMENTATION SAFETY ASSESSMENT
Comments:
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
APPENDIX 4 – SAMPLE PRE-IMPLEMENTATION CHECKLIST FOR
PREPARATION OF IFP IMPLEMENTATION SAFETY ASSESSMENT
For LNAV/VNAV Procedure: Is the published minimum
temperature reasonable for the application of the Baro-
18 VNAV procedure?
Comments:
Are there any criteria applied for the RNP APCH design
using the minimum or maximum value in ICAO PANS-OPS
20 (Doc 8168)? If so, are they documented properly?
Comments:
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
APPENDIX 4 – SAMPLE PRE-IMPLEMENTATION CHECKLIST FOR
PREPARATION OF IFP IMPLEMENTATION SAFETY ASSESSMENT
between facilities? Is the amended LOA published and
effective?
Comments:
Are the locations of waypoints and restrictions (speed,
altitude, etc.) appropriate for the aircraft types expected to
5 use these procedures?
List aircraft categories considered:
Comments:
Are there any expected difficulties or possibilities of
phonetic confusion in the names used for reporting points/
waypoints and procedure? It is recommended that
6
proximity check for like-sounding codes be done within
250NM for TMA waypoints using ICARD system.
Comments:
Are there any elements that may lead to misinterpretation
or other difficulties while using the proposed procedures
(e.g. textual description of the chart, local wind condition or
7
temperature causing difficulties while climbing/descending,
etc.)?
Comments:
In case of procedure amendment, was a review of safety
incidents/accidents concerning the existing procedure
8
conducted, with the view of mitigating them?
Comments:
Referring to ICAO Annex 4, 15 and Doc 8697, are there any
errors on the chart(s)?
(Items to focus on: Magnetic Bearings/True Headings,
9 Distances, Climb/Descent Gradients, TAA/MSA, Magnetic
Variation, Topography, Location of Obstacles, Coordinates,
Restrictions, etc.)
Comments:
Were all obstacles evaluated when calculating OCA/H in the
10 proposed procedures properly documented?
Comments:
Were coverage and limitations of available avionics, ground
navigational aids and GNSS considered while designing and
11
validating the proposed procedures?
Comments:
Were traffic flows in the terminal area considered while
12 designing the proposed procedures?
Comments:
Are climb/descent rates of the proposed procedures
appropriate to enabling the climb/descent within the
13
airspace?
Comments:
Does the separation applied between instrument flight
procedures of neighboring airport(s), airspaces including
special use airspaces (SUAs) and the proposed procedures
14
satisfy separation criteria specified in ICAO PANS-ATM (Doc
4444)/ MOS - ATS?
Comments:
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
APPENDIX 4 – SAMPLE PRE-IMPLEMENTATION CHECKLIST FOR
PREPARATION OF IFP IMPLEMENTATION SAFETY ASSESSMENT
Do the proposed procedures consider separation between
aircraft using PBN procedures and aircraft using other
15 procedures specified in ICAO PANS-ATM (Doc 4444)/ MOS-
ATS?
Comments:
Did the proposed procedures consider current and
16 expected future airspace capacity?
Comments:
Are there any alternative methods when an aircraft
conducting a proposed procedure is unable to conduct the
17 procedure because of ground/satellite/airborne system
failures, technical problems or other difficulties?
Comments:
Is there any training plan for air traffic controllers on the
18 proposed procedures? Has the training been conducted?
Comments:
Are there any criteria applied for the SID/STAR design using
the minimum or maximum value in ICAO PANS-OPS (Doc
19
8168)? If so, are they documented properly?
Comments:
Are there any items requiring special authorization in the
proposed procedures? If any, were sufficient reviews on
20 criteria conducted and was rationale for requiring special
authorization reasonable?
Comments:
Are there any other safety considerations regarding the
21 procedure(s)?
Comments:
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
APPENDIX 4 – SAMPLE PRE-IMPLEMENTATION CHECKLIST FOR
PREPARATION OF IFP IMPLEMENTATION SAFETY ASSESSMENT
Did related ATC facilities review new and/or amended
procedures based on the Letter of Agreement (LOA)
4 between facilities? Is the amended LOA published and
effective?
Comments:
Are the locations of waypoints and restrictions (speed,
altitude, etc.) appropriate for the aircraft types expected to
5 use these procedures?
List aircraft categories considered:
Comments:
Are there any expected difficulties or the possibility of
confusion on the name of waypoints phonetically? It is
recommended that proximity check for like-sounding codes
6
should be done within 500NM for en-route waypoints using
ICARD system.
Comments:
Is the designator of ATS route appropriate for its
application, i.e. domestic or international? Is the duplicity
7
of the name confirmed with neighboring States?
Comments:
Are there any parts that may lead to mistakes or difficulties
while using the proposed ATS routes (e.g. separation from
other ATS routes and/or airspace including military
8 controlled airspace, coordination with other facilities
including military, identification of navigation specification,
difference of turn performance, introduction of FRT, etc.)?
Comments:
In case of procedure amendment, was a review of safety
incidents/accidents concerning the existing procedure
9
conducted, with the view of mitigating them?
Comments:
Referring to CARANS Parts 4 and 15, MOS Aeronautical
Charts and ICAO Doc 8697, are there any errors on the AIP
publication?
10
(check items: magnetic bearing/true heading, distance,
coordinates, restrictions, directions, etc.)
Comments:
Were all obstacles evaluated in the proposed ATS route and
11 properly documented?
Comments:
Were coverage and limitations of available avionics, ground
navigational aids and GNSS considered while designing and
12
validating the proposed procedures?
Comments:
Does the separation applied between instrument flight
procedures of neighboring airport(s), airspaces including
special use airspaces (SUAs), neighboring ATS routes and
13 the proposed ATS route satisfy separation criteria specified
in ICAO PANS-ATM (Doc 4444)/ MOS ATS and PANS-OPS
(Doc 8168)?
Comments:
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
APPENDIX 4 – SAMPLE PRE-IMPLEMENTATION CHECKLIST FOR
PREPARATION OF IFP IMPLEMENTATION SAFETY ASSESSMENT
Does the separation applied between instrument flight
procedures of neighboring airport(s), airspaces including
special use airspaces (SUAs) and the proposed procedures
14
satisfy separation criteria specified in ICAO PANS-ATM (Doc
4444)/ MOS - ATS?
Comments:
Did the proposed ATS route consider current and expected
15 future airspace capacity?
Comments:
Are there any alternative methods when an aircraft flying
the proposed ATS route is unable to maintain the
requirement of the route because of
16
ground/satellite/airborne system failures, technical
problems or other difficulties?
Comments:
Is there any training plan for air traffic controllers on the
17 proposed ATS route? Has the training been conducted?
Comments:
Are there any items requiring special authorization on the
use of the proposed ATS route, e.g. reduction of lateral
separation between ATS routes? If any, were sufficient
18
reviews on criteria conducted and was rationale for
requiring special authorization reasonable?
Comments:
Are there any other safety considerations regarding the
proposed route(s)?
19
Comments:
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
APPENDIX 5 – FLIGHT VALIDATION PILOT TRAINING AND
EVALUATION
APPENDIX 5
Flight validation pilots must acquire and maintain the competency level required by
CAAP stated herein through initial training and supervised on-the-job training (OJT).
This is in order to achieve the safety and quality assurance objectives of the flight
validation and to ensure that the quality assurance in the procedure design process
and its output, including the quality of aeronautical information/data, meets the
requirements of CARANS Part 15 and MOS AIS.
Training for flight validation pilots should at least include initial training and recurrent
training at periodic intervals.
Initial training must ensure that the flight validation pilot is able to demonstrate a basic
level of competency that includes at least the following elements:
a) knowledge of the information contained in PANS-OPS, Volumes I and II, and
other related ICAO provisions relevant to the CAAP; and
b) knowledge of and skills in ground and flight validation of procedures.
Recurrent training must ensure that the flight validation pilot is able to demonstrate a
basic level of competency that includes at least the following elements:
a) knowledge about updates in ICAO provisions and other provisions pertaining
to procedure design and flight validation of procedures; and
b) maintenance and enhancement of knowledge and skills on ground and flight
validation of procedures.
Flight validation pilots must undergo an adequate OJT under close supervision of a
senior officer prior to being assigned to a task.
Competency of the flight validation pilot will be evaluated by the CAAP during audit
(usually conducted every 2 years).
The following paragraphs address the SKAs that must be acquired and evaluated for
a flight validation pilot to be competent to perform flight validation of IFPs. Flight
inspection pilots may also perform the flight validation of procedures. Flight inspection
pilots authorized by the CAAP to conduct flight validation of procedures must also meet
these requirements.
These competencies are not exhaustive. They represent the minimum knowledge
required to achieve the quality assurance objectives of the FPD process.
INITIAL TRAINING
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
APPENDIX 5 – FLIGHT VALIDATION PILOT TRAINING AND
EVALUATION
ii) charting requirements;
iii) environmental considerations;
iv) quality assurance requirements;
b) Procedure design criteria for each type of procedure to be validated:
i) obstacle protected areas;
ii) required obstacle clearance for any given segment of a
procedure;
iii) climb and descent gradients;
iv) ARINC coding;
– Required Navigation Performance — Authorization Required Manual (if
applicable);
– Quality Assurance Manual for Flight Procedure Design;
– Annex 14.
Note. - Substantial portions of the required knowledge in PANS-OPS can be obtained
in a PANS-OPS procedure design course.
2. Knowledge and skills in ground and flight validation of procedure
a) Ground training in flight and ground validation duties:
i) Manual on Testing of Radio Navigation Aids (Doc 8071);
ii) flight inspection requirements;
iii) procedure package contents;
iv) procedure package review;
v) requirements, techniques and considerations for verifying that the
navigation data to be published, as well as that used in the design
of the procedure, are correct;
vi) techniques and considerations for ground validation of obstacle
data;
vii) requirements, techniques and considerations for obstacle
assessment in flight;
viii) techniques and considerations in the application of PANS-OPS
procedures design criteria in the ground and flight validation of
procedures;
ix) airport infrastructure assessment;
x) communications coverage;
xi) flyability/Human Factors assessment;
xii) charting considerations;
xiii) operational factors;
xiv) criteria to be met for waiving the requirement for a flight validation;
b) Flight training in flight validation duties:
i) flight inspection requirements;
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
APPENDIX 5 – FLIGHT VALIDATION PILOT TRAINING AND
EVALUATION
ii) obstacle assessment requirements, techniques and
considerations;
iii) techniques and considerations in the applications of PANS-OPS
procedure design criteria in the flight validation of procedures;
iv) requirements, techniques and considerations for verifying that the
navigation data to be published, as well as that used in the design
of the procedure, are correct;
v) airport infrastructure assessment;
vi) communications coverage;
vii) flyability/Human Factors;
viii) charting considerations; and
ix) operational factors;
c) Supervised OJT adequate to achieve the required level of competency
in flight and ground validation knowledge and skills;
d) Initial ground and flight evaluation.
RECURRENT TRAINING
The competency of the flight validation pilot will be evaluated by the CAAP at least
once every two years (during audits). The skills, knowledge and attitudes to be
addressed in the evaluation will at least include those areas that pose the greatest
risk, if not accomplished correctly, to the overall quality of the CAAP’s procedure
design process.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
APPENDIX 5 – FLIGHT VALIDATION PILOT TRAINING AND
EVALUATION
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
APPENDIX 6 – VALIDATION TEMPLATES FOR FIXED WING
AIRCRAFT
APPENDIX 6
The following sample checklist and report templates contain minimum suggested data
and information required to be recorded during the validation process. If certain items
are not applicable to the intended IAP, identify the boxes in the form by strikethrough
or the term “n/a”. Such forms must be signed.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
APPENDIX 6 – VALIDATION TEMPLATES FOR FIXED WING
AIRCRAFT
6.2 Simulator Evaluation Checklist — Fixed Wing
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
APPENDIX 6 – VALIDATION TEMPLATES FOR FIXED WING
AIRCRAFT
6.3 Flight Evaluation Checklist — Fixed Wing
FLYABILITY
PASS FAIL
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
APPENDIX 6 – VALIDATION TEMPLATES FOR FIXED WING
AIRCRAFT
Comparison of FMS navigation database and source documents,
including proper ARINC 424 coding.
Note. - If manual entry used N/A, but a note in the remarks section is
required to alert the CAAP of the procedure that a table top review of the
coded procedure, or an operational assessment by a company pilot,
should be completed prior to operational approval granted.
Human Factors and general workload satisfactory.
Was there any loss of RAIM.
Was there any loss of required RNP navigation performance (when RNP
pertains).
Missed approach procedure.
Descent/climb gradients.
Use of autopilot satisfactory.
Segment length, turns and bank angles, speed restrictions and
deceleration
allowance.
TAWS.
INSTRUMENT APPROACH PROCEDURE
PASS FAIL
Segment lengths, headings/tracks, and waypoint locations match
procedure
design.
Final segment vertical glide path angle (if applicable).
Threshold crossing height (LTP or FTP), if applicable.
Course alignment.
Along track alignment.
FAS datablock.
REMARKS
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
APPENDIX 6 – VALIDATION TEMPLATES FOR FIXED WING
AIRCRAFT
6.4 Validation Report Checklist — Fixed Wing
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
APPENDIX 6 – VALIDATION TEMPLATES FOR FIXED WING
AIRCRAFT
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
APPENDIX 7 – VALIDATION TEMPLATES FOR HELICOPTERS
APPENDIX 7
The following sample checklist and report templates contain minimum suggested data
and information required to be recorded during the flight validation process of an RNAV
IAP including SBAS. If certain items are not applicable to the intended IAP, identify the
boxes in the form by strikethrough or the term “n/a”. Such forms must be signed.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
APPENDIX 7 – VALIDATION TEMPLATES FOR HELICOPTERS
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
APPENDIX 7 – VALIDATION TEMPLATES FOR HELICOPTERS
7.3 Flight Evaluation Checklist — Helicopters
PRE-FLIGHT
COMPLETED
Review pre-flight validation assessment.
Review simulator evaluation assessment (if applicable).
Obstacle assessment planning: areas of concern; ability to identify and
fly lateral
limits of obstacle assessment area (if required).
Verify source of IFP data for aircraft GPS/GNSS/FMS (electronic or
manual creation).
Evaluate navigation system status at time of flight (NOTAM, RAIM,
outages).
Weather requirements.
Night evaluation requirement (if applicable).
Required navigation (NAVAID) support (if applicable).
Combination of multiple IFP evaluations.
Estimated flight time.
Coordination (as required) with: ATS, designer, airport authority.
Necessary equipment and media for electronic record of validation flight.
GENERAL
PASS FAIL
IFP graphic (chart) is complete and correct.
Check for Interference: document all details related to detected RFI.
Satisfactory radio communication.
Required RADAR coverage is satisfactory (if RADAR required).
Verify proper heliport markings, lighting and VASIS (if installed).
Altimeter source(s).
OBSTACLE ASSESSMENT
PASS FAIL
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
APPENDIX 7 – VALIDATION TEMPLATES FOR HELICOPTERS
Verified controlling obstacle in each segment (including as appropriate:
VFR, direct visual segment, or maneuvering visual segment area/s,
missed
approach); if any obstacles are missing or any new obstacles are
observed,
record the lat/long and elevation of obstacles observed.
Where necessary, flown at lateral limits of the obstacle assessment area;
most appropriate for procedures designed in challenging terrain, or
when there are questionable obstacles.
Note. - Extra consideration should be given to non-surveyed areas.
FLYABILITY
PASS FAIL
Comparison of GPS/GNSS/FMS navigation database and source
documents, including proper ARINC 424 coding.
Note. - If manual entry used N/A, but a note in the remarks section is
required to alert the CAAP of the procedure that a table top review of the
coded procedure, or an operational assessment by a company pilot,
should be completed prior to operational approval granted.
Human Factors and general workload satisfactory.
Was there any loss of RAIM.
Was there any loss of required RNP navigation performance (when RNP
pertains).
Missed approach procedure.
Descent/climb gradients.
Use of autopilot satisfactory.
Segment length, turns and bank angles, speed restrictions and
deceleration
allowance.
TAWS.
INSTRUMENT APPROACH PROCEDURE
PASS FAIL
Segment lengths, headings/tracks, and waypoint locations match
procedure
design.
Final segment vertical glide path angle (if applicable).
Heliport crossing height (HRP), if applicable.
Course alignment.
Along track alignment.
FAS datablock (for SBAS APV procedures).
REMARKS
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
APPENDIX 7 – VALIDATION TEMPLATES FOR HELICOPTERS
7.4 Validation Report Checklist — Helicopters
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
APPENDIX 7 – VALIDATION TEMPLATES FOR HELICOPTERS
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
APPENDIX 8 – HUMAN FACTORS
APPENDIX 8
HUMAN FACTORS
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
APPENDIX 8– HUMAN FACTORS
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
APPENDIX 9 – OBSTACLE ASSESSMENT
APPENDIX 9
OBSTACLE ASSESSMENT
9.1.1 Controlling obstacles in each segment must be confirmed during the initial
certification and cyclic review of flight procedures. If unable to confirm that the
declared controlling obstacle of the respective segment is correctly identified,
the flight validation pilot then lists the following information that the designer
needs to consider:
a) location;
b) Type; and
c) approximate elevation of the obstacles.
9.1.2 The flight validation pilot will place special emphasis on newly discovered
obstacles. If the controlling obstacle is listed as terrain/trees or adverse
assumption obstacle (e.g. vegetation tolerance, ships, tolerance for potential
unreported structures as defined by the CAAP), it is not necessary to verify
the actual height of the controlling obstacle, only that no higher obstacle is
present in the protected airspace. If the flight validation pilot observes that the
documented controlling obstacle is not present, the flight validation pilot must
indicate this information in the report.
9.2.3 Obstacle heights measured in-flight are not considered accurate and should
not be used unless the actual height of the obstacle cannot be determined by
other means. GNSS is the preferred measurement tool; however, if
barometric height determination is required, accurate altimeter settings and
altitude references must be used to obtain reasonable results. The flight
validation report will reflect the documentation for the method of height
determination including altimeter corrections applied for low temperature,
mountain wave, etc. The GNSS altitude must also be noted.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
APPENDIX 9 – OBSTACLE ASSESSMENT
9.2.4 Obstacle assessment for multiple approaches to the same runway may be
completed during a single evaluation to meet periodic requirements.
9.2.5 While the challenging nature of this task is acknowledged, its basic purpose
is to confirm that at no time during the approach was the aircraft ever brought
into close proximity – laterally or vertically – to any obstacles. It is not intended
to imply an exhaustive survey of every obstacle in the area.
9.3.1 Some TAWS(s) may alert while flying over irregular or rapidly rising terrain at
altitudes providing standard obstacle clearance. If TAWS alerts are received
while validating a procedure, repeat the maneuver, ensuring flight at the
designed true altitude using temperature compensation at the maximum
design speed for the procedure.
9.3.2 If the alert is repeatable, indicate the information in the report, including
sufficient details for resolution by the designer. The FVP should not hesitate
to provide potential operational solutions such as speed restrictions, altitude
restrictions or waypoint relocation. A TAWS alert may be generated when
approaching an airport runway that is not in the TAWS database. The TAWS
check should be performed with proper aircraft configuration in the respective
phase of flight.
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
APPENDIX 10 – SAMPLE VALIDATION DOCUMENTATION
APPENDIX 10
Comments
None
UNCONTROLLED COPY
Manual of Standards for Instrument Flight Procedure Design Service
APPENDIX 10 – SAMPLE VALIDATION DOCUMENTATION
UNCONTROLLED COPY