0% found this document useful (0 votes)
440 views2 pages

Implementing Travel & Hospitality Data Mesh: AWS Reference Architecture

The document discusses implementing a data mesh architecture for travel and hospitality companies. It describes how data from various sources flows into AWS, where producers manage data and build operational data stores. Consumer domains then use process data sets from multiple producers based on business needs, building data marts and performing analytics.

Uploaded by

Pavan Savla
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
440 views2 pages

Implementing Travel & Hospitality Data Mesh: AWS Reference Architecture

The document discusses implementing a data mesh architecture for travel and hospitality companies. It describes how data from various sources flows into AWS, where producers manage data and build operational data stores. Consumer domains then use process data sets from multiple producers based on business needs, building data marts and performing analytics.

Uploaded by

Pavan Savla
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 2

Data flows into AWS through batch processing,

1
Implementing Travel & Hospitality Data Mesh real-time data, Secure File Transfer Protocol
(SFTP) and IoT sensors.
The travel and hospitality industries are facing new challenges when generating, accessing, and analysing data at scale. Use this new approach to build a data
Data sources are managed by the Business
platform that serves both operational and analytical needs by using domain owned design, maintained data properties, open data standards, purpose-built
databases, and extensible serverless architecture. This data delivery platform architecture helps relieve and eventually replace the on-premises data platform
2 Domain. Producers use organization-level
load, leading to cost savings and an agile environment. blueprints to provide core services such as
security, governance, and open standards.
Producers build the Operational Data Store using
External AWS Cloud Amazon DynamoDB and Amazon DynamoDB
2 Producer Domain Accounts Central IT Platform 3 Consumer Domain Accounts Accelerator (DAX) to provide consistent single-
Data
4 digit-millisecond latency performance.
Producer 1 Account – Metadata
Reservation Domain Consumer 1 Account-
Batch 5 Marketing Domain Consumer Domain uses process data sets from
AWS Glue Amazon Amazon
3 multiple producer domains based on business
1 Data Catalog Neptune DynamoDB needs. Consumers build a data mart using
Events Data Amazon Redshift Amazon
Ingestion Crawler Amazon Amazon
(Data mart) Athena
Amazon Redshift and analytics using Amazon
EMR Athena
and Governance QuickSight.
Integration
Metadata is managed via multiple services. AWS
Amazon S3 Amazon S3 Amazon S3
AWS
CloudTrail
Amazon
CloudWatch
AWS Cloud
Formation
Amazon S3
Derived Data Sets
Amazon
QuickSight 4 Glue is used for data cataloguing. Data lineage is
AWS Transfer Raw Data Raw Data Process Data (Visualization)
System of Family Batch Real Time Sets stored in Amazon Neptune. Data contracts are
Records AWS Security & Access stored in DynamoDB.
Management Services Consumer accounts 2 –
Revenue Management
Consumers use online, text-based search and
Amazon
EventBridge
AWS Step AWS Amazon
Domains
5 filtering of data sets recorded in the central data
Batch Functions Lambda DynamoDB
(ODS)
AWS AWS
AWS AWS
Consumer accounts 3..m –
catalog to collect data. They can search for
Secrets Single relevant data by name, contents, sensitivity, or
IAM KMS Other Domains such as Sales,
Manager Sign-On
Finance, Customer, Airport, other any other custom labels you have defined.
Amazon Kinesis Producer 2 Account - and Operation
Events
Loyalty Domain
AWS Lake Formation provides centralized
Amazon Amazon Amazon AWS Firewall
GuardDuty Inspector Macie Manager
7
Account(s) - Machine Learning 6 management of security, governance and auditing
AWS Data
Producer 3 Account -
policies including fine-grain permissions. It also
Exchange enables automatic schema discovery and
Engineering Domain Discovery
Amazon Amazon conversion to the required format.
IOT Sensor SageMaker Athena
Data ML (Machine Learning) is performed using Lake
Producer accounts – Other
7
Batch AWS IoT Core Amazon Crawler AWS Glue
Domains such as Digital, Athena DataBrew Formation. Use Amazon SageMaker to provide
Revenue, and HR Amazon S3 AI Services standard AI/ML models for customer
AWS Lake Formation 6 Predictive Models
segmentations and lifetime value. Other AI
AWS IoT Greengrass Events
services such as Amazon Personalize can be
utilized to get actionable insight.

Reviewed for technical accuracy July 30, 2021


© 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Reference Architecture
Implementing Travel & Hospitality Data Mesh 1
Data flows into AWS through batch processing,
real-time data, SSH File Transfer Protocol (SFTP)
and IoT sensors.
A view of all of the services in the data mesh and how they connect and work together on AWS.
Provide staging for ingesting all batch and real-
External 2 time data using cost effective storage classes in
AWS Cloud 3 4
Data Amazon Simple Storage Service (Amazon S3).

AWS Glue AWS Glue


6 An AWS Glue crawler creates the table metadata
Crawler Data Catalog
AWS Glue Amazon EMR
3 in the data catalog. The AWS Glue data catalog
AWS Transfer Amazon Redshift
Datamart is an index of the location, schema, and runtime
1 Amazon QuickSight Reporting and Analytics
metrics of your data. Use the information in the
AWS Storage
Analytics Dashboard data catalog to create and monitor your ETL
Gateway Amazon S3 Amazon S3 Amazon S3 Amazon S3 Amazon S3 (extract, transform, and load) jobs.
Raw Data Raw Data Processed Derived Data Predictive Amazon Athena
Batch Staging Real-time Data Sets Sets Models
SageMaker Studio IDE
Use open standards to build the data lake using
AWS Data
Exchange
4 the same data as the operational data platform.
… … … … … Amazon SageMaker Amazon SageMaker Amazon SageMaker Use a read pattern schema to make the raw data
Studio Notebooks Ground Truth Build
and curated data readily available seamlessly for
2 Mobile Customer all user roles using a workflow such as Apache
… … … … …
System of Service Apps Airflow.
Records Amazon SageMaker Amazon SageMaker Amazon SageMaker
Model Monitor Deploy and Manage Train and Tune
… … … … … Use purpose-built databases such as Amazon
5 DynamoDB and serverless architecture to deliver
7 Customer Service
Amazon SageMaker
Debugger
Dashboard microservices and events to the operational data
Prediction Models
… … … … … store.
5
Customer Website
Build all reportable data sets in Amazon S3 and
Events
Lambda function Amazon API Gateway
6 leverage Amazon Redshift and Amazon Athena
Amazon DynamoDB DynamoDB
1 Amazon Kinesis Amazon Kinesis Operational Data Store Streams for analytics. Optionally, for heavily used
Data Streams Data Firehose
AWS Step Functions AWS Step Functions
analytics, build data marts in Amazon Redshift.
Mobile Customer
Customer Data Processing Complex Event Processing Apps For ad-hoc requirements, use Athena to analyse
data in the data lake with standard SQL.
Amazon Kinesis Published
IOT Sensor Events Lambda function Lambda function Events
Data Lambda function Lambda function Data Streams Use Amazon SageMaker to provide standard
Data Events
AI/ML models for customer segmentations and
1 AWS Security and Access Management Services Governance 7 lifetime value. Other AI services such as Amazon
Subscribers
Personalize can be utilized to get actionable
AWS IoT
Greengrass
AWS IoT
AWS AWS AWS Secrets AWS Single Amazon Amazon Amazon AWS Firewall AWS Amazon AWS insight.
Core
IAM KMS Manager Sign-On GuardDuty Inspector Macie Manager CloudTrail CloudWatch CloudFormation

Reviewed for technical accuracy July 30, 2021


© 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Reference Architecture

You might also like

pFad - Phonifier reborn

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.


Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy