Data Quality - TechM offerings & Solutions

Aug, 2023

Copyright
1Copyright © 2022 © 2019
Tech | TechAllMahindra.
Mahindra. Confidential. All rights reserved.
rights reserved. 1
Agenda

1 TechM Credentials & Offerings

Our Understanding of the Enbridge Data Eco

2
System

3 Collibra Data Quality Architecture

4 TechM Data Quality Solution Framework

5 Case Studies

6 Next Steps

Copyright © 2019 | Tech Mahindra. Confidential. All rights reserved. 2

Where We Are Today
CUSTOMER 35+ 5 of Top 10 4 of Top 10 4 of Top 10 3 of Top 10 3 of Top 5
HIGHLIGHTS Fortune 500 Telco Automotive Oil & Gas CPG Chemical MFG

Network data lake setup

IOT Platform Data Data Governance For leading Telco E2E Digital Transformation -

50+ Ingestion and Analytics implementation for a UK-

based telecom giant
Customer and billing migration to strategic
stack

Countries
D&A Platforms on MS Azure, Google
and Private cloud – big global bank DL / DWH on Cloud

15,500+ Fiber penetration

improvement using
AI Lab
Innovation
Associates AT&T IP - MARS
OSS Datalake on
Cloud
MDM and Advanced Analytics for a
400+ Transformation for a new-age Digital
Collections Platform for leading US
Redshift to Snowflake
Migration for Data Disruption
Banking giant in SE Asia

Global Customers Telco Multinational

Entertainment and Data on Cloud transformation for
DW migration to GCP Record Label Large Australian Bank
conglomerate

60+ MDM Assessment and

Product MDM ERP Digital transformation for
Technologies leading Telco in NZ
Modernization data analytics
DWH migration to AWS Redshift for a
platform by migrating on-
leading manufacturer of jet and
premises solutions to multi-cloud
turboprop engines
70+
environment for Multinational
Energy Transport Co.
Data Platform
Strategic Alliances Modernization on GCP

Billing Platform modernization

40+ Banking
Telecom
Aerospace

Parks and Entertainment

Hi-Tech
Manufacturing
Record
IPs & Industry Solutions Cloud Migration for the Parks division of the
Energy Pharmaceuticals
Label
Retail
World’s leading Entertainment and Content
Production Company

Copyright © 2019 | Tech Mahindra. Confidential. All rights reserved. 3

 Our Understanding of the Enbridge Data Ecosystem

Product Data Pipeline Data Storage Data 2023 Collibra Initiatives

Data related to the
Information about the
transportation of oil and gas
Information about the volume inventory and capacity of
through pipelines, including
and quality of oil and gas storage facilities for crude oil,
flow rates, pressure levels,
produced from different wells natural gas, and refined
and pipeline integrity
and fields. products.
monitoring.

Quality and Composition Data Quality & Observability

Transportation and Metering Data
Data Shipping Data Implementation
Data from metering stations
Data on the composition and used to measure the flow and
Data related to the movement
quality of oil and gas, quantity of oil and gas at
of oil and gas through various
including API gravity, sulfur modes of transportation, such different points in the supply Power BI for Collibra
content, BTU value, and other chain.
as trucks, railcars, and ships . Insights in Azure
specifications.

Logistics and Supply

Environmental Data Market and Pricing Data
Chain Data Collibra Integration with
Data related to environmental Information about commodity
prices, market trends, and Data on the logistics and BigID
factors and compliance,
competitor analysis to inform supply chain operations,
including emissions
trading and marketing including scheduling,
monitoring, spill incidents, and
inventory management, and
regulatory reporting. strategies.
delivery tracking.

Copyright © 2019 | Tech Mahindra. Confidential. All rights reserved.

4 4
 Collibra Reference Architecture

PUBLICATION
WEB LAYER

Metadata
DATA CATALOG
DB Extraction DATA

Adapters/ Parsers/ APIs

DISCOVERY

ASSET
RANKING

DATA LINEAGE
metadata driven ingestion framework

DATA
Unstructured/
SCIENTISTS
Semi-
Structured
DATA BUS
MARKETPLACE USERS

API
DATA GOVERNANCE
Data Repository

DATA
DATA LAKE

STEWARDS
EDW

BUSINESS
Interpreter
Taxonomy

. GLOSSARY

IT
. DQ SCORE
. DATA QUALITY & CARD

OBSERBAVILITY
. DATA
EXTERNAL
Metadata
Crawler

PROVISIONING

LINEAGE
CDC DATA PRIVACY & VIEWER
SECURITY
DATA SET
CERTIFICATION

Copyright © 2019 | Tech Mahindra. Confidential. All rights reserved. 5

 Data Quality as a Service – TechM Solution Framework
Global and Local DQ services (Profile, Data Reconciliation & DQM KPI
Data Gathering & Profiling Problem Management RCA & Keep it Clean
Suggest, Cleanse) across domains, use Reporting Dashboard
cases and applications
BPM Communication BPM Process
• KPI • Compliance
Event driven API based Proactive Workflow •
Workflow
Error • Legal
Cleansing & Validation 7 • Data Cleansing • Merge & Unmerge 7
• DQ Profile • Governed Cleansing

AI/ML based Automated DQ Rules

4 Reporting Platform 5 Collaboration Platform
based on metadata and data profiles &
patterns Compliance & Security
Store
Integration Services 6 API ETL CRM
Self Healing & Governed cleansing
capability Business Glossary 1 Logical Layer
DQ Dimensions/KPI PLM

Data Quality Core Engine

Accuracy | Completeness | Consistency | Timeliness | Validity | Uniqueness
Metadata
Real Time and Batch Services through DQ Rules Legacy
API and ETL Integration
Global Process/Domain System
Third Party (Validation
Data Lake/Warehouse
& Enrichment) DQ Action
Monitoring & Communication based Report Auto Cleanse Govern & Cleanse
error framework ERP
MDM
2 Physical Layer
Database Repository Execution
Ref Data E-Commerce
Use Case, KPI & Category based
Monitor Log Action
dashboard reporting 3 Error Framework
Interface Color Legend Enablers & Consumers 8
Scalable, Agile and Reusable Enabler & Validator
framework for hybrid environment Reconciliation Predictive DQ rule (Verify, Profile & AI/ML Model
Query Update Update/ Create) Enabler & Consumer
CRUD Request Response
Query Consumer
Effective DQ & Change Management
through Collaborative platform
Cloud Advanced Enterprise Data Platforms CRM & ERP E-Commerce MDM
Modernization Analytics Governance (CDP) Modernization Enablement Implementation
Copyright © 2019 | Tech Mahindra. Confidential. All rights reserved.
6 6
Collibra Data Quality Reference Architecture

Metadata
Store

CLIENT REST
APT Web App
DQ Engine
JDBC RDBMS

Cluster

JDBC Cloud

File

Copyright © 2019 | Tech Mahindra. Confidential. All rights reserved. 7

TechM Framework on top of Collibra Data Quality Solution

10+ TechM provided

additional features Self Healing &
through framework Govern Cleansing
Metadata
ETL Store
Integration

Event
Driven API

CLIENT REST
APT Web App
DQ Engine
JDBC RDBMS

Cluster

JDBC Cloud

File

Copyright © 2019 | Tech Mahindra. Confidential. All rights reserved. 8

Data Quality & Governance Implementation for the major Financial Institute –(Citi)

Background
Solution
Enterprise level data inconsistency and repetition between Finance, Risk
and Treasury leading to challenges in meeting Regulatory requirements  Implemented Data Quality as a Service Solution
(BCBS 239) and being compliant to Data Governance practices using Collibra  Identify the required reporting data elements at the lowest grain possible from multiple systems
(origination, servicing, collections, etc.) that generate a reporting line item.
Requirements & Challenges  Design, implement, automate and maintain large scale enterprise data
 BCBS Compliance - To consolidate regulatory reporting data from
Finance, Risk and Treasury to support the Bank's regulatory reporting
requirements for the US and EU and adhere to the Enterprise Data
Governance (EDG) standards for BCBS compliance.
 KYC Compliance : Compliance to new Know Your Customer (KYC)
policies which must precede any new business relationship and
includes three steps; collection of information, process/risk scoring
(AML, sanction, regulatory and reputational risk), and business
decision
 Poor Data Quality & No Framework – No Framework to address Data
Quality Solution at organization level.

Business Benefits
 Reduced 20% TCO by centralizing Enterprise-wide Risk, Finance and
Treasury data repository.
 Meeting 100% Regulatory compliances for the US and EU region.
 30% Improved KYC process and secured the quality and integrity of
information.
 Meet Data Governance standards.

Tools & Technologies Collibra

Copyright © 2019 | Tech Mahindra. Confidential. All rights reserved. 9

Data Quality & Governance Implementation for the major Healthcare Organization(GSK)

Background
Solution
UK based pharma Giant , looking for modernize their Data Ecosystem
 AI/ML predictive data quality done to classify critical data elements
 API based Data Quality Solution for use case-based services
 Enhance Reporting with Self Service capability
Requirements & Challenges  Implemented Data Quality as a Service
The HealthCare major is embarking on a journey to modernize their Data
Ecosystem, migrate their on-premise systems & Analytics Applications to
Azure Cloud. As part of this initiative to develop and implement a Modern
Architecture, following are some key priority:

 Build & Support Data & Semantic model ; Provide Real time and
Predictive Insights for Data Quality issues
 Enable Self-Service Data Analytics; Design and develop ML Models – for
predictive & early warning insights for Data Operations
 Implement an Enterprise Metadata Repository and initiate Data
Governance journey

Business Benefits
Reduced drug development time by almost 25-30 %
20% manual hour saved through data issue rectification
25% improvement in exception process handled automatically

Tools & Technologies Collibra

Copyright © 2019 | Tech Mahindra. Confidential. All rights reserved. 10

Data Quality & Governance Implementation for a Japanese Auto Maker(Nissan)

Background
Solution
The Automotive IT SCM GM and Sr. Data Architect wanted to
 Data Stewardship and Dashboards
carry out a data quality activity to identify process
optimization and revenue saving opportunities  Universal Data Catalog
 Data Lineage
Requirements & Challenges  Data Profiling & Rule integration
 Platform support
To identify business challenges within supply chain
management related to production parts business processes  Implemented Data Quality as a Service
– ordering, receiving and inventory
 Collection and maintenance of business metadata & Business Metric
Glossary for all business areas
 Enterprise Data Lake ingesting data from 130+ Interfaces, some with
over 500 attributes per Interface
 Complete technical metadata of systems down to individual attributes

Business Benefits

 30% increase in Cross and Up Selling

 75% effort reduction in Customer creation and approval process
 Faster TTM for Vehicle and OEM/Aftermarket parts

Tools & Technologies Informatica

Copyright © 2019 | Tech Mahindra. Confidential. All rights reserved. 11

TechM Data Quality as a Service Engagement Approach

1 2 3 4

ASSESMENT DEFINE DEVELOP SUPPORT &

• Define Governance KPI •
GOVERN
• Data Assessment Develop DQ Rules • Establish governance vis
• Set up & Installations • Define Data Quality Rules • Develop API Services approval process
• Workshop with Enbridge SME • Define Foundational Data • Develop Integrations • Measure critical KPI’s and
Security & privacy. • Configure Collibra metrics for monitoring.
• High Level Solution • Define roll out strategy.
Architecture • Consolidated & Standardised • Data governance
• Scope Document • Baselined DQ rules & Profile date set • Analyse metrics
results • Configured Environment
• Development plan

Copyright © 2019 | Tech Mahindra. Confidential. All rights reserved.

12 12
TechM Data Governance - An Overview

1000 100 200 18+

+
Data Governance +
Successful +
Certified Years of
Professionals Implementations Consultants Experience

Our Offerings

Advisory & Consulting Solution Implementation Partner Engagement & Key Partnerships
Partnership
• Data Governance readiness • End to end Data Governance • Joint account alignment and
& maturity assessment Implementation GTM activities with leading
• Business workshops & • Data platform modernization product vendors across
surveys • COTS & tailored solutions geographies and verticals
• Product evaluation • Single & multi-domain • Access to key stakeholders
• Data Governance roadmap & solutions to ensure right leadership
strategy • Adaptive & AI/ML Augmented support for end customers
• Data Architecture & Data Governance • Access to Partner Tool
Availability Assessment • Metadata Management & environment for POC’s,
Data Quality Service demos, Use Case build
• Training & Enablement by
Partner Academy

Copyright © 2019 | Tech Mahindra. Confidential. All rights reserved.

13 13
 Thank You

www.techmahindra.com

Copyright © 2019 | Tech Mahindra. Confidential. All rights reserved. 14