Data Analytics Essentials
Data Analytics Essentials
Ehtisham Zaidi
16 May 2023
Data and Analytics Essentials: How to Define, Build
and Operationalize a Data Fabric
Published 16 May 2023 - ID G00790376 - 6 min read
Ehtisham Zaidi
Additional Perspectives
The Challenge
Most organizations struggle with a comprehensive data management design that allows
them to optimally collect, connect, integrate and deliver distributed data from
heterogeneous data sources and applications for their data and analytics (D&A) use-
case demands. The number of data and application silos has surged in the last decade,
while the number of skilled personnel in data teams has either stayed constant or
dropped. As a result, the time deficit between when a request for integrated data is
raised to when the request is fulfilled is now at an all-time high.
The growing popularity of cloud for data management has only increased the complexity
of creating and maintaining a consistent data management architecture that caters to all
existing and upcoming requests for data integration.
A data fabric is a data management design concept for attaining flexible, reusable and
augmented data pipelines and services in support of various operational and analytics
use cases. Data fabrics support a combination of different data integration styles, and
utilize active metadata, knowledge graphs, semantics and machine learning to augment
data integration design and delivery (see Figure 1).
■ Defining what data fabric is and therefore failing to demonstrate how it leverages
currently implemented technology solutions.
■ Getting started with creating a data fabric and knowing the main steps they need to
follow.
D&A leaders pursuing current implementations report that skills, roles and team
management are the key components to success and not necessarily the tools and
software. They have learned that tools and platforms are the enabling technology for a
data fabric and consist of solutions already deployed, the metadata that represents
experience and learning patterns from those existing use-cases, and adding technology
only when the team and conditions highlight gaps.
2. The second segment of the presentation addresses the common question, “How do I
stitch together the data fabric, and what are the components needed to do so?”
This introduces D&A leaders in their strategic roadmap assessment to the key
composable components and technology parts needed to deliver their data fabric. It
also touches on the discipline (in this case, DataOps) and the team structures and
skills needed to make the data fabric more usable. Next, D&A leaders are guided
through three paths to production for common use cases, which will help them get
started (and get some important wins under their belt to keep the business
interested). They can then progress to more advanced paths that support use cases
that need knowledge graphs for highly interconnected datasets. Finally, the data
fabric can move into the final frontier: the automation path that supports
automation of various tedious, error-prone and repetitive data management tasks by
activating metadata and analyzing it.
3. The final part of this presentation — the “where” — will allow D&A leaders to
navigate the complex vendor landscape to select mature technology components
from established vendor markets. We explain which types of technology choices are
needed and how they can be assembled. Finally, the presentation provides some
cautions (based on the mistakes that Gartner has noticed early stage adopters
make) and a representative list of vendors that can be investigated for implementing
data fabrics.
Please review the Notes Section for each slide, which explains and builds on the ideas
represented in each slide in detail.
■ Invest in augmented data catalogs to inventory all types of metadata assets along
with their associated relationships in a flexible data model on a graph.
■ Ensure that the data fabric allows business teams to contribute and enrich the data
models with semantics and taxonomies/ontologies.
■ Provision a data fabric architecture that has the capability to combine various data
integration styles (such as extraction, transformation and loading with data
virtualization).
These presentation slides are most useful to data and analytics leaders who are working
to educate their stakeholders. Gartner clients working to get buy-in for their business case
to modernize the data management infrastructure can use this simple presentation
format to help executives understand the role and importance of data fabric.
■ 2022 Gartner State of Data and Analytics Cloud Adoption Survey (see below)
■ Client inquiries, Gartner search analytics, Google trends, Gartner social media
analysis of emerging technology topics in May 2022
2022 Gartner State of Data and Analytics Cloud Adoption Survey: This survey was
conducted to validate and understand how end-user organizations are practicing and
planning their journeys to perform data and analytics in the cloud, and what the key
drivers are for such a transition.The research was conducted online from October through
November 2022 among 461 respondents from North America, EMEA and Asia/Pacific.
The respondents were from the manufacturing, natural resources, healthcare provider,
banking and finance, IT, retail and wholesale, government, education, media and
communications, transportation, and utility industries, in organizations with more than
250 full-time employees.The respondents were screened for being in director roles and
higher, having responsibility for adopting cloud or planning it, and having some visibility
or involvement in financial decision making for cloud adoption.
Webinar Webinar
Is Your Data AI Ready? Critical Gartner 100 Data & Analytics
Questions You Must Ask Data Predictions Through 2028
Engineers Delve into 100 data and analytics strategic
Explore the interactive relationship planning assumptions through 2028.
between traditional and augmented data
management.
eBook Roadmap
Get AI Ready — What IT Leaders Essential Guide to Data Fabric
Need to Know and Do Explore this roadmap to find out how to
Ready your enterprise to capture AI share the right data at the right time.
opportunities and bolster your cybersecurity.
Already a client?
Get access to even more resources in your client portal. Log In
Connect With Us
Get actionable, objective insight that drives smarter decisions and
stronger performance on your mission-critical priorities. Contact us
to become a client:
Become a Client
© 2024 Gartner, Inc. and/or its affiliates. All rights reserved. CM_GTS_2737624