Scribd
Upload
135 views27 pages

Webinar Elastic Stack (On Telecom) English Webinar Part

Telecoms network consists of hundreds of network elements that generate call detail records or event data for each phone call, text message, internet activity, or even a simple walk from one location to another. The number of records per day varies between millions and billions. In many cases, the network elements are from different vendors. The typical interface to access these records is file-based.

Uploaded by

Yassine LASRI
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
135 views27 pages

Webinar Elastic Stack (On Telecom) English Webinar Part

Telecoms network consists of hundreds of network elements that generate call detail records or event data for each phone call, text message, internet activity, or even a simple walk from one location to another. The number of records per day varies between millions and billions. In many cases, the network elements are from different vendors. The typical interface to access these records is file-based.

Uploaded by

Yassine LASRI
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 27

Introducing Elastic Stack for

Telecom Analytics

Yassine LASRI - Product Manager


Septembre 26, 2019
Yassine LASRI
Product Manager - Analytics
Synapticiel (www.synapticiel.co) @ylasri

@lasri
Telecoms Engineer
+12, Senior Architect BSS/OSS, Analytics
Revenue Assurance & Fraud Management

2
Housekeeping & Logistics

Attendees are automatically muted when joining Zoom


Ask questions for us in the Zoom chat during the webinar
Slides & Recording will be available after the webinar
Q/A will be at the end of the webinar

3
Agenda

1) Telecom Data Challenges.


2) Quick Elastic Stack Overview.
3) High Level Architecture Example.
4) Demo
5) Q/A

4
Telecom Data Challenges

Complex & Diverse


Major Challenges Valuable
Events Data Sources
Business insights

Network Optimizing
Network Operations
QoS & SLA, CEM

Fraud (Assurance)

Smart Marketing

Subscribers Behavior Product Innovation

5
NoSQL is better at
“scaling out” than RDBMS

Issue #1 : RDBMS fails to support Big Data Issue #2 : Capex & Opex Cost Open Source NoSQL
Scaling "out" with RDBMS is not possible Example : Oracle's Enterprise Edition Plus Business
Intelligence Suite lists at $221,2500 per processor How do you build
Distributed
H. Scalable,
Search/Analytics
platform ?

6
Elastic Stack Overview

7
High Level Architecture

ELASTICSEARCH

8
Anatomy of Logstash Pipeline

Multiples sources (S&U) Multiples Transformations Multiples Outputs

Network Logs Normalization Files Distribution


Mediation Files Enrichment Elasticsearch Ingest
Queues Corrélations ….
Beats Aggregation
RDBMS Pseudonymization
…. ….
9
Elastic Stack {Demo}

Demo Use Case/Context :


Generated full 24H prepaid voice charging events (Ercicsson CCN node)
Simulate medium Operator

Stages:
High Level example of logstash pipeline
Kibana data discovery, visualization & dashboarding
Elasticsearch data frames & entity-centric index (Starting version 7.3.0)

10
Webinar : Introducing Elastic
Stack for Telecom Analytics
(Q&A Session)

Yassine LASRI - Product Manager


Septembre 26, 2019
Security is free, starting in
versions 6.8.0 and 7.1.0

Encrypted communications (inside/outside cluster)


Built-in authentication realms & IP-based authorization
Role-based access control (Index, Document & Field level access)
12
Role-based access control (RBAC)

Access can be restricted to resources :

Indices
Aliases
Documents
Fields
Users
Cluster
13
X-Pack Open Code

14
Elastic Stack Features

15
Elasticsearch Scaling

16
16
Elasticsearch Resiliency/HA

PUT /cortex_ocs_data
{
"settings" : {
"index.default_pipeline": "cortex_data_ingest",
"index" : {
"number_of_shards" : 5,
"number_of_replicas" : 1,
"refresh_interval" : "10s"
}
},
"mappings": {
"properties": {
"@timestamp": {"type": "date"},
"event_id": {"type": "keyword"},
"event_type": {"type": "keyword"},
"caller_party_number": {"type": "keyword"},
"called_party_number": {"type": "keyword"},
"duration": {"type": "long"}
}
}
} 17
Elasticsearch CCR/DR

18
Elasticsearch CCR/DR

19
Elasticsearch CCR/DR

20
Elasticsearch CCR/DR

21
Analytics for The Network
Dominate Telco Deployments

In order to understand where vendors are gaining traction with


products which included Advanced analytics, AI and Automation
(A3), it is useful to look beyond the vendor PowerPoint ☺ - at
published case studies and press releases.

Main Findings
45% of the press releases/case studies related to the network
36% specifically to network management and assurance
The relative maturity of using ML in campaign management and the
reduction in hype around consumer chatbots meant that there was less
case study materials seen in this 2018/19 analysis period than might be
expected.
Increased activity was seen in field service workforce management, the
contact center and digital channels.

22
Source : https://charlottepatrick.uk/most-popular-a3-projects-in-2018-19/
Beats (Logs & Security Analytics)

Audit data Auditbeat


Log files Filebeat
Cloud data Functionbeat
Availability Heartbeat
Systemd Linux journals Journalbeat
Metrics Metricbeat
Network traffic Packetbeat
Windows event logs Winlogbeat

23
Logstash Input

24
Logstash Filter

25
Logstash Output

26
Logstash Pipeline

27

You might also like

pFad - Phonifier reborn

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.


Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy