Solution Evaluation

Agenda
• Overview of Solution Evaluation
• Core Concept Model in Solution Evaluation
• Measure Solution Performance
• Analyze Performance Measures
• Assess Solution Limitations
• Assess Enterprise Limitations
• Recommend Actions to Increase Solution Value

Classification: Restricted Page 2

 Core Concept Model in Solution Evaluation

Classification: Restricted Page 3

 Measure Solution Performance

Classification: Restricted Page 4

 Measure Solution Performance
• Purpose : The purpose of Measure Solution Performance is to define
performance measures and use the data collected to evaluate the
effectiveness of a solution in relation to the value it brings.

• Description : Performance measures determine the value of a newly

deployed or existing solution. The measures used depend on the solution
itself, the context and how the organization defines value.

Classification: Restricted Page 5

 Inputs
• Business Objective
• Implemented Solution ( external )

Classification: Restricted Page 6

 Elements
• Define Solution Performance Measures
• Validate Performance Measures
• Collect Performance Measures

Classification: Restricted Page 7

 Guidelines and Tools
• Change Strategy
• Future State Description
• Requirements(validated)
• Solution Scope

Classification: Restricted Page 8

 Technique
1. Acceptance and Evaluation Criteria
2. Benchmarking and Market Analysis
3. Business Cases
4. Data Mining
5. Decision Analysis
6. Focus Groups
7. Metrics and Key Performance Indicators(KPI)
8. Non-Functional Requirements Analysis
9. Observation
10. Prototyping
11. Survey or Questionnaire
12. Use Cases and Scenarios
13. Vendor Assessment

Classification: Restricted Page 9

 Acceptance & Evaluation Criteria

Classification: Restricted Page 10

 Non-Functional Requirement Analysis

Classification: Restricted Page 11

 Use Cases and Scenarios

Classification: Restricted Page 12

 Stakeholder
• Customer
• Domain Subject Matter Expert
• End User
• Project Manager
• Regulator
• Sponsor

Classification: Restricted Page 13

 Output
• Solution performance measures

Classification: Restricted Page 14

 Analyze Performance Measures

Classification: Restricted Page 15

 Analyze Performance Measures
• Purpose : The purpose of Analyze Performance Measures is to provide
insights into the performance of a solution in relation to the value it brings.

• Description : In order to meaningfully analyze performance measures,

business analysts require a thorough understanding of the potential value
that stakeholders hope to achieve with the solution.

Classification: Restricted Page 16

 Inputs
• Potential Value
• Solution Performance Measures

Classification: Restricted Page 17

 Elements
• Solution Performance versus Desired Value
• Risks
• Trends
• Accuracy
• Performance Variances

Classification: Restricted Page 18

 Guidelines and Tools
• Change Strategy
• Future State Description
• Risk Analysis Results
• Solution Scope

Classification: Restricted Page 19

 Technique
1. Acceptance and Evaluation Criteria
2. Benchmarking and Market Analysis
3. Data Mining
4. Interviews
5. Metrics and Key Performance Indicators(KPI)
6. Observation
7. Risk Analysis and Management
8. Root Cause Analysis
9. Survey or Questionnaire

Classification: Restricted Page 20

 Stakeholders

• Domain Subject Matter Expert

• Project Manager
• Sponsor

Classification: Restricted Page 21

 Output
• Solution Performance Analysis

Classification: Restricted Page 22

 Assess Solution Limitations

Classification: Restricted Page 23

 Assess Solution Limitations
• Purpose: The purpose of Assess Solution Limitations is to determine the
factors internal to the solution that restrict the full realization of value.

• Description: Assessing solution limitations identifies the root causes for

under-performing and ineffective solutions and solution components

Classification: Restricted Page 24

 Inputs
• Implemented Solution (External)
• Solution Performance Analysis

Classification: Restricted Page 25

 Elements
• Identify Internal Solution Component Dependencies
• Investigate Solution Problems
• Impact Assessment

Classification: Restricted Page 26

 Guidelines and Tools
• Change Strategy
• Risks Analysis Results
• Solution Scope

Classification: Restricted Page 27

 Technique
1. Acceptance and Evaluation Criteria
2. Benchmarking and Market Analysis
3. Business Rules Analysis
4. Data Mining
5. Decision Analysis
6. Interviews
7. Item Tracking
8. Lessons Learned
9. Risk Analysis and Management
10. Root Cause Analysis
11. Survey or Questionnaire

Classification: Restricted Page 28

 (12) Item Tracking (p. 294)

HUB - MIS (2023) 29

 Elements
• Item Record
• Item Management
• Metrics.

HUB - MIS (2023) 30

 Stakeholders

• Customer
• Domain Subject Matter Expert
• End User
• Regulator
• Sponsor
• Tester

Classification: Restricted Page 31

 Outputs

• Solution Limitation

Classification: Restricted Page 32

 Assess Enterprise Limitations

Classification: Restricted Page 33

 Assess Enterprise Limitations
• Purpose : The purpose of Assess Enterprise Limitations is to determine how
factors external to the solution are restricting value realization.

• Description : Solutions may operate across various organizations within an

enterprise, and therefore have many interactions and interdependencies.

Classification: Restricted Page 34

 Inputs
• Current State Description
• Implemented (or Constructed) Solution(external)
• Solution Performance Analysis

Classification: Restricted Page 35

 Elements
• Enterprise Culture Assessment
• Stakeholder Impact Analysis
• Organizational Structure Changes
• Operational Assessment

Classification: Restricted Page 36

 Guidelines and Tools
• Business Objectives
• Change Strategy
• Future State Description
• Risk Analysis Results
• Solution Scope

Classification: Restricted Page 37

 Technique
1. Benchmarking and Market Analysis 10. Organizational Modelling
2. Brainstorming 11. Process Analysis
3. Data Mining 12. Process Modelling
4. Decision Analysis 13. Risk Analysis and Management
5. Document Analysis 14. Roles and Permissions Matrix
6. Interviews 15. Root Cause Analysis
7. Item Tracking 16. Survey or Questionnaire
8. Lessons Learned 17. SWOT Analysis
9. Observation 18. Workshops

Classification: Restricted Page 38

 Stakeholders

• Customer
• Domain Subject Matter Expert
• End User
• Regulator
• Sponsor

Classification: Restricted Page 39

 Outputs

• Enterprise Limitation

Classification: Restricted Page 40

 Recommend Actions to increase Solution Value

Classification: Restricted Page 41

 Recommend Actions to increase Solution Value
• Purpose : The purpose of Recommend Actions to Increase Solution Value is
to understand the factors that create differences between potential value
and actual value, and recommend a course of action to align them.

• Description : This focuses on understanding the aggregate of the

performed assessments

Classification: Restricted Page 42

 Inputs

• Enterprise Limitations
• Solution Limitation

Classification: Restricted Page 43

 Elements
• Adjust Solution Performance Measures
• Recommendations

Classification: Restricted Page 44

 Guidelines and Tools
• Business Objectives
• Current State Description
• Solution Scope

Classification: Restricted Page 45

 Technique
1. Data Mining
2. Decision Analysis
3. Financial Analysis
4. Focus Groups
5. Organizational Modelling
6. Prioritization
7. Process Analysis
8. Risk Analysis and Management
9. Survey or Questionnaire

Classification: Restricted Page 46

 Stakeholders

• Customer
• Domain Subject Matter Expert
• End User
• Regulator
• Sponsor

Classification: Restricted Page 47

 Outputs
• Recommended Actions

Classification: Restricted Page 48

 One Minute Drill

Classification: Restricted Page 49

 KEY TAKEAWAYS

Classification: Restricted Page 50

 Topics to be covered in next session
• Overview of Requirements Analysis and Design Definition
• Core Concept Model in Requirements Analysis and Design Definition
• Specify and Model Requirements
• Verify Requirements
• Validate Requirements
• Define Requirements Architecture
• Define Design Options
• Analyze Potential Value and Recommend Solution

Classification: Restricted Page 51

 THANK YOU

Classification: Restricted Page 52