Scribd
Upload
56 views35 pages

PL17 Accelerate MySQL Apache Ignite 4656

The document discusses problems with using MySQL for certain use cases like handling hot or volatile data, large data volumes, analytics processing, and full text search. It then describes how Apache Ignite can address these problems by providing an in-memory data fabric with features like an in-memory data grid, SQL support, and integration with Hadoop. The presentation focused on how Ignite can accelerate MySQL workloads and enable new in-memory capabilities.

Uploaded by

Kishor p
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
56 views35 pages

PL17 Accelerate MySQL Apache Ignite 4656

The document discusses problems with using MySQL for certain use cases like handling hot or volatile data, large data volumes, analytics processing, and full text search. It then describes how Apache Ignite can address these problems by providing an in-memory data fabric with features like an in-memory data grid, SQL support, and integration with Hadoop. The presentation focused on how Ignite can accelerate MySQL workloads and enable new in-memory capabilities.

Uploaded by

Kishor p
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 35

Accelerate MySQL for Demanding OLAP

and OLTP Use Cases with Apache Ignite


Peter Zaitsev, Denis Magda
Santa Clara, California | April 25th, 2017
About the Presentation

Problems

Existing Solutions

Denis Magda will show the power of Apache Ignite


My Conviction

There is no silver bullet in


technology!
Why ?

All design decisions comes with


their own benefits and drawbacks
Technologies not Technology

Large Scale applications tend to


use more than one technology on
data layer
Works especially well with Open Source!

Additional Components do not require hefty license fees

Easy to prototype and test out

Open Source Community is good at building bridges


Balance is Needed

•Use as many technologies as you need, but no more


MySQL

•MySQL is no Exception. It is not Great for Everything.


Some of the Problems

Hot Data

Highly Volatile Data

Large Data Volume

Analytical Processing

Full Text Search


Hot Data

For example “Cache”

Large volume of simple requests

High overhead due to SQL

No good Memory focused Engine

Not Designed for very high Concurrency


Solutions

•MySQL
•MemcacheD interface
•Thread Pool

•External
•MemcacheD
•Redis
Highly Volatile Data

Lots of updates, especially to a single row

Design around full Transactional ACID semantics

Disk Log based durability

Pessimistic Logging
Solutions

•MySQL
•Data Design
•Configuration Tuning
•Parallel Replication

•External
•MemcacheD
•Redis
Large Data Volume

MySQL is designed as single node system

Limited in CPU, Memory

Manual “Sharding” solutions are painful

Especially with complex queries


Solutions

•MySQL
•Manual Sharding
•Vitess
•ProxySQL

•External
•Shading for MemcacheD and Redis
•MongoDB
•Cassandra
Analytics (OLAP)

MySQL does not support column based storage

MySQL optimizer is limited for complex queries

MySQL does not do parallel query execution

MySQL does not do distributed query execution


Solutions

•MySQL
•Configuration and Schema Design (Limited)

•External
•Hadoop & Spark
•Vertica
•ClickHouse
Full Text Search

Can handle basic Full Text Search

Does not scale well with data volume

No parallel processing

Limited search relevance options

Hard To do GIS searches; Facets

No language processing
Solutions

•MySQL
•Small Scale search applications only
•Supported with Innodb tables since MySQL 5.6
•External
•Elastic
•Solr
•Sphinx
New Solutions constantly appear

•Always be on lookout for a better solutions!


Apache Ignite - In-Memory Data Fabric
Beyond the Data Grid

DENIS MAGDA
Product Manager, Apache PMC Chair

www.ignite.apache.org #apacheignite
• In-Memory Data Fabric
• Advanced Clustering
• In-Memory Compute Grid
• In-Memory Data Grid
• In-Memory SQL Grid
• In-Memory Service Grid
• In-Memory Streaming & CEP
• Plug-n-Play Hadoop Accelerator
IN-MEMORY DATA FABRIC
STRATEGIC APPROACH TO IMC
IN-MEMORY COMPUTING
WHY NOW?
ADVANCED CLUSTERING & DEPLOYMENT

Ease of Getting Started


Automatic Discovery
Any Environment
Public Cloud
Private Cloud
Hybrid Cloud
Local Laptop
Zero-Deployment
Auto-Deploy Code
Full Cluster Management
Pluggable Design
IN-MEMORY COMPUTE GRID

Direct API for MapReduce


Zero Deployment
Cron-like Task Scheduling
State Checkpoints
Load Balancing
Automatic Failover
Full Cluster Management
Pluggable SPI Design
IN-MEMORY DATA GRID

Distributed In-Memory Key-Value Store


Replicated and Partitioned data
TBs of data, of any type
On-Heap and Off-Heap Storage
Highly Available In-Memory Replicas
Automatic Failover
Distributed ACID Transactions
SQL queries and JDBC driver
Collocation of Compute and Data
IN-MEMORY SQL GRID
ANSI-99 SQL Compliant
Aggregations, group by, sorting
Cross-cache joins, unions, etc.
DML and DDL
JDBC, ODBC, Native APIs
Distributed
Always consistent
Fault tolerant
IN-MEMORY SERVICE GRID

Distribute Any Data Structure


Available Anywhere on the Grid
Automatic Remote Access via Proxies
Controlled Deployment
Support for Cluster Singleton
Support for Node Singleton
Support for Custom Topology
Load Balanced
Guaranteed Availability
Auto Redeployment in Case of Failures
IN-MEMORY STREAMING AND CEP

Streaming Data Never Ends


Branching Pipelines
Pluggable Routing
Sliding Windows
Real Time Analysis
IN-MEMORY HADOOP ACCELERATOR

Plug and Play installation


2x to Nx Acceleration
In-Memory Native MapReduce
In-Process Data Colocation
IgniteFS In-Memory File System
Read-Through from HDFS
Write-Through to HDFS
Sync and Async Persistence
SPARK INTEGRATION
SHARED RDD & IN-MEMORY FILE SYSTEM
Turbocharge your SQL queries in-memory with Apache® Ignite™
25 April - 4:50 PM - 5:15 PM @ Room 210
THANK YOU!

www.ignite.apache.org #apacheignite
Thank You to All of Our Sponsors!!

You might also like

pFad - Phonifier reborn

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.


Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy