D1.4.3-Quality Assurance & Risk Assessment Plan
D1.4.3-Quality Assurance & Risk Assessment Plan
Deliverable Form
Nature: R
Dissemination Level: PU
Date: 21/11/2014
Document description: This deliverable will incorporate details about SemaGrow’s quality assurance
processes. It defines all processes and instruments to be used for the regular
quality monitoring and risk assessment of the project in the form of a handbook
for project partners. Furthermore, it will include a Critical Path Analysis (CPA) of
the main project activities, identifying risk points, and procedures to deal with
them. This deliverable will also include the Quality Assurance performance
indicators
D1.4.3 Quality Assurance & Risk Assessment Plan FP7-ICT-2011.4.4
Document History
Page 2 of 31
D1.4.3 Quality Assurance & Risk Assessment Plan FP7-ICT-2011.4.4
EXECUTIVE SUMMARY
This document addresses the Quality Assurance and the Risk Management Plan. The aim of this deliverable is to
describe the mechanisms that will be used throughout the project in order to ensure the quality level of the project
deliverables and the project outcomes.
This document will also serve as a guide to the project coordinator, in order to ensure that quality reviews will occur at
appropriate points in the project, and as a reference for all project partners, in order to understand their
responsibilities, regarding the project deliverables and outcomes.
In this context, quality control mechanisms are defined as well as Critical Path Analysis, in order to be easy to identify
important tasks and dependencies that are critical for the success of the project. This document will also serve as a
detailed guide to the SemaGrow partners in order to establish effective cooperation within the consortium and ensure
the highest level of project documentation. Moreover, the document outlines the success criteria for each deliverable,
defines the structure of each deliverable, describes the quality review techniques according to PRINCE2 technique and
also defines configuration management procedures and change control.
The last chapter of the document is devoted to the potential problems that may occur during the project: It includes
not only a detailed description of potential risks, but also management procedures that will be applied to either avoid
the potential risk or minimize its negative impact.
This document should be used as a reference by the project coordinator and all project partners.
Page 3 of 31
D1.4.3 Quality Assurance & Risk Assessment Plan FP7-ICT-2011.4.4
TABLE OF CONTENTS
LIST OF FIGURES ........................................................................................................................................................... 5
1. INTRODUCTION..................................................................................................................................................... 8
3. QUALITY CONTROL...............................................................................................................................................15
5.1 Scope................................................................................................................................................................... 27
5.2 Risk Assumption .................................................................................................................................................. 27
5.3 Risk Assessment .................................................................................................................................................. 27
Page 4 of 31
D1.4.3 Quality Assurance & Risk Assessment Plan FP7-ICT-2011.4.4
LIST OF FIGURES
Figure 1: Quality Relationship ............................................................................................................................................. 12
Figure 2: Deliverable Production Process ........................................................................................................................... 18
Figure 3: Change Control Approach .................................................................................................................................... 26
Figure 4: Risk Analysis Process ............................................................................................................................................ 27
Page 5 of 31
D1.4.3 Quality Assurance & Risk Assessment Plan FP7-ICT-2011.4.4
LIST OF TABLES
Table 1: Performance Indicators ......................................................................................................................................... 10
Table 2: Key Milestones ...................................................................................................................................................... 13
Table 3: Deliverables List .................................................................................................................................................... 17
Table 4: General Quality Indicator ...................................................................................................................................... 18
Table 5: Deliverables Quality Indicators ............................................................................................................................. 19
Table 6: Work Package Quality Indicators .......................................................................................................................... 20
Table 7: Technology Quality Indicators .............................................................................................................................. 22
Table 8: Sample Risk Methodology ..................................................................................................................................... 28
Table 9: Management Risks ................................................................................................................................................ 30
Table 10: Technical Risks .................................................................................................................................................... 31
Page 6 of 31
D1.4.3 Quality Assurance & Risk Assessment Plan FP7-ICT-2011.4.4
refers to the monitoring and co-financing unit of the project in the context of the
European Commission
ICT Policy Support Programme, which is represented by the Project Officer (PO)
(EC)
and any other appointed personnel
an independent check that the project outputs fit for purpose or meet
Quality Assurance
requirements
a set of grouped work activities that have been described Description of Work
Work Package (WP)
(DoW), resulting in a number of deliverables
Terms used in a quality context are sometimes interpreted differently or interchangeably by various people.
This can lead to misunderstandings. For the purposes of the SemaGrow project management methodology,
the terminology used in this deliverable is derived from international ISO 9000 standards.
Page 7 of 31
D1.4.3 Quality Assurance & Risk Assessment Plan FP7-ICT-2011.4.4
1. INTRODUCTION
Page 8 of 31
D1.4.3 Quality Assurance & Risk Assessment Plan FP7-ICT-2011.4.4
2. Quality Approach
2.1 Planning
Quality Management is defined as the coordinated activities to direct and control a project with respect to quality. The
Consortium Lead (UAH) recognises that each of the Partners may have their own documented quality management
system; however for ease of coordination the project will put its own quality processes in place.
Quality planning is about defining the outputs required by the project, with their respective quality criteria, quality
assessment methods and the quality responsibilities of the involved partners. Quality assurance provides control to the
project direction, ensures that the management is of a high quality with respect to the nature of the project and that
the project complies with relevant corporate or programme management standards and policies.
The purpose of quality planning is to provide a secure basis for:
Project Board agreements on the overall quality expectations, the products required with their associated
quality criteria, the means by which quality will be achieved and assessed, and ultimately, the acceptance
criteria by which the projects products will be judged
Communicating these agreements unambiguously so all project Partners have a common understanding of
what the project is setting out to achieve
Control i.e. establishing an effective baseline for the projects quality controls and a secure means of achieving
deliverables that are fit for purpose
This plan forms (a) a guide for the project coordinator to follow in order to ensure that the quality reviews occur at
appropriate points in the project, and (b) a reference for all project partners in order to understand their
responsibilities, thus delivering high quality deliverables and outcomes to help SemaGrow achieve its goals.
Page 9 of 31
D1.4.3 Quality Assurance & Risk Assessment Plan FP7-ICT-2011.4.4
Six monthly reports will include on-going evaluation of activities and impact (based on the criteria above) and it is
anticipated that these areas will be based on data collected not only from partners themselves but also from other
organizations, in particular Member States that are participating in the project activities. To achieve this, focus groups
will be held – in parallel with piloting activities – in order to provide feedback from stakeholders external to the project.
This approach recognizes that evaluation needs to be placed at the centre of the planning and development processes
and also that, not only is analysis of information collected for monitoring purposes important, but also evaluation from
partners and key stakeholders. Therefore, those involved in the on-going quality assurance and formative evaluation
processes include:
• The partnership
• Beneficiary Groups
• Social Partners (representatives of employers and employees)
• Local, regional and national organizations
• Other EC projects
• Other policy makers
Project Coordinator
Responsible for day-to-day quality management tasks
Ensures that Documents Commissions meet quality expectations and acceptance criteria
Prepares and maintains the product descriptions
Page 10 of 31
D1.4.3 Quality Assurance & Risk Assessment Plan FP7-ICT-2011.4.4
Ensures that Work Package Leaders implement the quality control measures
Address possible conflicts, looking for the widest internal consensus and taking care that project internal rules
are respected, including legal and ethical obligations; in the event that consensus is not reached, apply the
rules for problem management and conflict solving.
The Project Coordinator is Prof. Miguel-Angel Sicilia (http://www.cc.uah.es/msicilia/) who is a Professor at the
Computer Science Dept. of UAH. Miguel-Angel is currently coordinating the FP7 INFRA agINFRA and the CIP PSP VOA3R
projects that are working on the creation of large scale virtual data infrastructures for agriculture and aquaculture. He is
the Editor-in-Chief of the International Journal of Metadata, Semantic & Ontologies (IJMSO) and the International
Journal of Service Science, Management, Engineering, and Technology (IJSSMET). In 2005 he has launched and has
served in various Chairing roles for the annual Metadata and Semantics Research Conference (MTSR) that has a rather
applied and multi-disciplinary nature with established domain-specific tracks like the Metadata & Semantics for
Agriculture, Food & Environment one that has been organized in MTSR since 2007.
Scientific Manager
Responsible for the scientific vision of the project
Responsible for the scientific supervision of the work packages, planning and control of activities
Responsible for guiding all activities related to the research of the project on intelligent information
management topics
Dr. Vangelis Karkaletsis (http://users.iit.demokritos.gr/~vangelis/) serves as the SemaGrow Scientific Manager (SM). Dr.
Vangelis Karkaletsis is a Research Director at NCSR-D and head of the Software and Knowledge Engineering Laboratory
of the Institute of Informatics and Telecommunications of NCSR-D. He is the Technical Manager of the FP7 ICT NOMAD
project on web content analysis for e-government applications, and has served as the Project or Technical Manager in
FP projects such as QUATRO Plus, MedIEQ, and OntoSum. He belongs to the Adjunct Faculty of the Dept. of Computer
Science & Engineering, University of Texas at Arlington (UTA), USA; also regularly serving as a lecturer in postgraduate
courses at the University of Athens, Greece. He has served as the Chair of the 12th Conference of the European Chapter
of the Association for Computational Linguistics (EACL-2009), the 6th Hellenic Conference on Artificial Intelligence
(SETN-10), and has served in the past as the Vice-chair of the Hellenic Association of Artificial Intelligence (EETN).
Technical Manager
Responsible for the technical vision of the project.
Responsible for monitoring the technical development and the integration of all deployed services
Dr. Stasinos Konstantopoulos (http://www.iit.demokritos.gr/people/konstantopoulos-stasinos) serves as the Technical
Manager (TM). Stasinos is MEng in Computer Engineering and Informatics (University of Patras, Greece, 1997), MSc in
Artificial Intelligence (Edinburgh University, U.K., 1998), PhD on Computational Logic and Language Technology
(Groningen University, the Netherlands, 2003) and has been affiliated to the Institute of Informatics &
Telecommunications, NCSR "Demokritos" since 2004 through several national, FP6-IST, and FP7-ICT projects. He was
previously leading WP3 in the SemaGrow project. He is also actively involved in W3C activities and has participated in
various Working Groups and Community Groups, including the POWDER Working Group (2007-2009) where he
contributed the logical foundations of the POWDER Recommendation. He currently participates in the newly
established CVSW Working Group (2014).
The Quality Assurance Sub-Committee
Will monitor the WP activities
Guide the implementation and assessment of milestones and deliverables
Take necessary actions to adjust, modify and fasten the activity of a Work Package
Account for feedback from the WP leaders and the Quality Manager
Decide whether deliverables pass internal review and can be submitted to the Commission
Page 11 of 31
D1.4.3 Quality Assurance & Risk Assessment Plan FP7-ICT-2011.4.4
report about work progress, deliverables, achievements, deviations from schedule, problems, results,
following the reporting methodology adopted in the project
A summary of the quality relationship between each of these roles is provided in the diagram below.
European
Commission
Activity Reports
Project Reviews
Project Board
Activity Reports
Project Meetings
Quality Assurance
Project Coordinator
Sub Committee
Project Meetings
Deliverable Peer Reviews Conference Calls
(Inspection and Testing) Activity Reports
Work Package
Leaders
Page 12 of 31
D1.4.3 Quality Assurance & Risk Assessment Plan FP7-ICT-2011.4.4
WP Expected
No Milestone Name Means of Verification1
involved date
Project setup: Project Management Plan, PO, DV (D1.1, D1.2.1, D1.4.1, D2.1.1, D2.2.1,
first version of Quality Insurance & Risk WP1 D2.3.1, D7.1.1, D7.2.1, D7.3)
MS1 Assessment Plan, first version of Data WP2 M6
Stream & Collections, first version of Use WP7 (All deliverables were submitted
Cases, Project website and Fact Sheet successfully)
(2nd Review)
PO, DV (D1.2.4, D.1.3.2, D1.4.3, D2.1.3,
Final Use Cases & Interim Integrated &
D2.3.3, D4.2, D4.3, D5.1.2, D5.4.3, D6.2.1,
Evaluated Prototype: Use Cases finalized.
D6.3.1, D7.1.3, D7.2.3, D7.4.2, D7.5.2)
MS4 Interim prototype integrated. Interim All M24
(All deliverables were submitted
sustainability, uptake & marketing
successfully
positioning plan.
Official EC Review scheduled for 12
December 2014
1
DV: Peer Reviewed corresponding deliverables. PO: Assessed by Project Officer UE: Evaluated by users
Page 13 of 31
D1.4.3 Quality Assurance & Risk Assessment Plan FP7-ICT-2011.4.4
At these milestones, the Project Coordinator needs to review project achievements against the Project Plan to ensure
work is on track. Any changes or deviations will need to be reviewed and approved by the Project Board (see chapter
4.4 on Change Control).
Page 14 of 31
D1.4.3 Quality Assurance & Risk Assessment Plan FP7-ICT-2011.4.4
3. Quality Control
Quality control focuses on the operational techniques and activities used by those involved in the project to:
Fulfil the requirements for quality (i.e. inspections and testing)
Identify ways of eliminating causes of unsatisfactory performance
Page 15 of 31
D1.4.3 Quality Assurance & Risk Assessment Plan FP7-ICT-2011.4.4
Page 16 of 31
D1.4.3 Quality Assurance & Risk Assessment Plan FP7-ICT-2011.4.4
Page 17 of 31
D1.4.3 Quality Assurance & Risk Assessment Plan FP7-ICT-2011.4.4
FINAL VERSION
During the production of the deliverable, there may be other intermediate phases where the Project Coordinator is
asked to review partial drafts, but because of time constraints this cannot be established as a rule. During the whole
process of draft production, each partner will be responsible for checking the quality of the deliverable as it progresses
(according to the same indicators in the table below).
The Project Manager and Quality Assurance Sub-committee will evaluate the final draft of each deliverable. The
following table provides a short list of indicators that the Quality Manager will use to assess the general quality of each
deliverable.
Page 18 of 31
D1.4.3 Quality Assurance & Risk Assessment Plan FP7-ICT-2011.4.4
SemaGrow DOW
The development activity is based on a solid work plan
WP work plan
Monitoring Reports
All steps of development activity are fully documented Internal Reports
Deliverables
Page 19 of 31
D1.4.3 Quality Assurance & Risk Assessment Plan FP7-ICT-2011.4.4
Internal documents
Architecture is available
Deliverables
Page 20 of 31
D1.4.3 Quality Assurance & Risk Assessment Plan FP7-ICT-2011.4.4
Page 21 of 31
D1.4.3 Quality Assurance & Risk Assessment Plan FP7-ICT-2011.4.4
3.4.1 Actions
Actions are specific activities which are required for the project to move forward. They are normally the consequence
of decisions made during meetings, of Project Management Board decisions made by e-mail or tele-conference or they
may correspond to deadlines set in the Description of Work.
Meeting minutes will contain a record for each action with the following data:
• WPx: .Work Package & Work Package Title
• Partner/s: The partner or partners responsible for that action.
• Description: A short description of the action.
• Date: The completion date for the particular action.
3.4.2 Decisions
Decisions are official statements that are approved at the Project Board level. Decisions may affect the project in terms
of schedule, budget, corrective or back-up actions, technological choices, etc. The record for each decision will be as
follows:
Ref. WP/task Decision Notes
Their status becomes OK when the issue has been solved (usually translated into an Action or a Decision).
Page 22 of 31
D1.4.3 Quality Assurance & Risk Assessment Plan FP7-ICT-2011.4.4
4. Quality Guidelines
Title and Logos: the title of the document will be shown along with the relevant logos, such as the project logo,
the EU flag2 in order to acknowledge receipt of European Community funding 3 etc. According to the 2008
Project Management Guidelines, the European flag must be given appropriate prominence when displayed
together with the project’s logo.
Dates, due and actual: The due submission date along the actual submission date must be provided.
Leading organisation: The name of the lead organisation for the preparation of the document must be
indicated here.
Revision: This field denotes the version of the document which may be in the forms of v1, v2, v01 etc. The
value ‘Final’ denotes that the version of the document is the final and the submitted one.
Dissemination level: In this field the list of persons or groups involved in the document distribution is reported.
The dissemination level field can have one of the following possible values:
o PU: The document is open and public to everyone
o PP: The document is restricted to the eParticipation Preparatory Action participants, including
European Commission services and project reviewers
o RE: The document is restricted to a specified group
o CO: The document is confidential i.e. restricted to the consortium members, including Agency and
Commission and project reviewers.
2
http://europa.eu/abc/symbols/emblem/download_en.htm
3
See Article II of the Grant Agreement
Page 23 of 31
D1.4.3 Quality Assurance & Risk Assessment Plan FP7-ICT-2011.4.4
Documents internal to the project may also use this field for indicating the relevant work package with the
format WPx.
The predetermined structure of each document’s contents is broken down in the following sections:
History: The History page will report version, date, modification reason, and organisation/author that have
performed the respective modification. Versioning will be kept as follows:
o Version integers are kept for document submission to the Agency. The first submission of a document
to the Agency will be marked as v1. If a second submission is needed, this will be v2 etc.
o Version decimals (in other words, releases) will be used for communication between partners. The
first draft version to be communicated within the Consortium will be vX.1, the second vX.2 etc.
Executive Summary: An executive summary is a report, proposal, or portfolio, etc in miniature (usually one to
two pages). That is, the executive summary contains enough information for the readers to become
acquainted with the full document without reading it. Usually, it contains a statement of the problem, some
background information, a description of any alternatives, and the major conclusions. Someone reading an
executive summary should get a good idea of main points of the document without becoming bogged down
with details.
An executive summary differs from an abstract in that the former’s purpose is to inform the reader of the
points to be covered in the report without any attempt to tell what is said about them. Covering no more than
one to two pages in length, the executive summary is longer and is a highly condensed version of the most
important information the full document contains. Both the executive summary and the abstract are
independent elements rather than a part of the body of the document. Both are placed at the beginning of the
document.
With the possible exception of the conclusion and the recommendations, the executive summary is the most
important part of a report. As such, it should be the best-written and most polished piece of the document.
This is because many readers may only look at the executive summary when deciding whether or not to read
the entire document. In short, it may be expected that an executive summary will be read more frequently and
by more people than the entire document.
Since the executive summary is a condensation, when creating it, any preliminaries, details, and illustrative
examples must be omitted. In this respect, the main ideas should be included as well as the facts, the
necessary background to understand the problem, the alternatives, and the major conclusions. Brevity and
conciseness are the keys to a well-written summary.
Therefore, the structure of a comprehensive executive summary would address and incorporate the following
points:
o First, the objective and the scope of the document are described. In a concise, comprehensive and
straightforward way, it is explained what this document aims to do and how this is going to be done.
For example “In this report we identify future research priorities for eParticipation researchers. We do
this by first setting the context by providing the trajectory of eParticipation from its early days to
current practice. We then consider this current situation...”
o Second, the methodology and/or the rationale of the document are presented in order to provide an
overview of how the research results were obtained. For example, “The research priorities were
identified through analysing the literature – both workshop reports and scientific published papers
by...”
o Third, the main results/outcomes of the document are described. For example, “This coding resulted
in six main areas of barriers and challenges which are listed below: Complexity of research field
addresses problems...”
o Finally, if it is highly necessary some conclusions may be provided.
Table of Contents
List of figures
List of tables
Page 24 of 31
D1.4.3 Quality Assurance & Risk Assessment Plan FP7-ICT-2011.4.4
List of abbreviations and terms: a list providing the full titles and/or explanations of the abbreviation and terms
used in the document
Introduction: this is a beginning section which states the purpose and goals of the following writing within the
document. This is generally followed by the main body and conclusions.
Main body: the main body, as the name suggests, is the most important part of the document. The subject of
the document is explored and valid reasons and justifications are given.
References: a reference is a previously published written work within academic publishing which has been
used as a source for theory or claims referred to which are used in the document. References contain complete
bibliographic information so the interested reader can find them in a library. References are added either at
the end of each document or at the end of the relevant section.
SemaGrow_ContentDescription_VER
ContentDescription A short description of the file’s content
VER Version number (v1, v01, …)
Any participant in the SemaGrow project may raise a Change Request. The Project Coordinator will ensure they are
captured and are proactively managed to conclusion. An initial review should be made to examine the need for the
Page 25 of 31
D1.4.3 Quality Assurance & Risk Assessment Plan FP7-ICT-2011.4.4
change, how it could be achieved and what the consequences would be. The most appropriate member of the Project
Team would normally perform this review. Based on those conclusions, the recommended action would be proposed
which would be one of three possible courses:
Minor changes within scope can be approved by the Project Coordinator
Any change affecting the deadline of a deliverable or outcome would need to be reviewed by the Project
Director and shared with the Project Board who would confirm the necessary revisions to get the project back
on course
Changes of scope and contract revisions would require the approval of the European Commission
Identify
Potential Capture
Change
Propose Contract
Action Revision
Review Action
Agree Closure
Page 26 of 31
D1.4.3 Quality Assurance & Risk Assessment Plan FP7-ICT-2011.4.4
5. Risk Management
5.1 Scope
Risk management is concerned with identifying potential problems and eliminating or reducing the damage the
realisation of those risks would cause. Failure to adequately manage risks will threaten the success of the project.
Risk management is the responsibility of the Project Management Board, and chiefly of the Project Coordinator. A well-
planned approach to risk control will allow the project team to concentrate resources in those areas where risk is high
and reduce risks to acceptable limits.
Risk assessment and management will be conducted at the start of the project and also throughout the project lifecycle
to ensure that risks are acknowledged and controlled. It is usually impossible to eliminate all risks, but they can be
recognised and dealt with. The risk management process requires that each risk is assessed and measures formulated
to prevent it (avoidance actions) or minimise its effect (amelioration actions). Both need to be considered because
avoidance measures may fail.
As the project proceeds, the nature of risks is changing. Old risks disappear and new ones come up. Consequently, risk
management is a continuous process thus risks should be regularly reviewed and reassessed.
Page 27 of 31
D1.4.3 Quality Assurance & Risk Assessment Plan FP7-ICT-2011.4.4
The project
The total set of
One or more of methods and The outcomes do The project
RISK of activities is too
The activities are the partners is strategies applied not reflect the real outcomes may
Overall large for the
too complex to not able to are inappropriate needs and not lead to a
project partners to
realize. honour its to realize the priorities of the sustainable
activities realize and/or
commitments intended stakeholders. outcome.
manage.
outcomes.
Review the
activities and/or Prioritize and/or Replace Adjust project Adjust the project Adjust the
Actions scale down scale down defaulting methods and activities and project activities
project ambitions. partners. strategies. outputs. and outputs.
ambitions.
PC, SM, TM,PB PC, PB PC, PB PC, SM, PB PC, PB PC, SL, PB
Decision
(upon agreement (upon agreement (upon agreement (upon agreement (upon agreement (upon agreement
Maker
with PO) with PO) with PO) with PO) with PO) with PO)
SemaGrow is a research project with partners from several countries and different expertise; hence, the partners had
to clearly identify a number of management risks. In order to minimize the risks, the partners have concretized the
project proposal as much as possible and have agreed on the global project tasks. Furthermore, an elaborate project
management structure has been defined in order to monitor the cooperation between the partners and identify and
investigate management risks as soon as possible. In SemaGrow, the following potential management risks have been
mainly foreseen, and corresponding contingency plans are suggested.
Page 28 of 31
D1.4.3 Quality Assurance & Risk Assessment Plan FP7-ICT-2011.4.4
Management Risks
Loss of key personnel and delays due Each partner is responsible for making sure that the
to re-hiring. Low Medium case of personnel turnover can be handled
adequately.
Page 29 of 31
D1.4.3 Quality Assurance & Risk Assessment Plan FP7-ICT-2011.4.4
SemaGrow fails to secure external Even in the extremely unlikely event that this trend
Low Low is reversed to the point where there is no relevant
data due to IPR or privacy issues
public data whatsoever, the data that consortium
members have direct access to and/or ownership
over (cf. Annex II) is adequate to satisfy the
project’s development and pilot needs.
Table 9: Management Risks
In SemaGrow, the following potential technical risks have been mainly foreseen, and corresponding contingency plans
are suggested.
Technical Risks
Page 30 of 31
D1.4.3 Quality Assurance & Risk Assessment Plan FP7-ICT-2011.4.4
Page 31 of 31