Open-source Cloud-Computing Platform

Presentation for Grid and Cloud Computing

( CS- 771 )
By:
Abhishek Kumar, Akash Chandra Gupta, Anisha Singh,
Ankit Kumar, Ayush Verma, Rashi Jaiswal, Yashika Kashyap

16 April, 2021
Objectives
• Introduction and Benefits of the latest OpenNebula version (Yashika)
• OpenNebula features for the different cloud types
 Private (Anisha)
 Hybrid (Abhishek)
 Public (Abhishek)
• Architecture of OpenNebula (Akash)
• Deployment of OpenNebula (Ankit)
• Provisioning Model of OpenNebula (Rashi)
• Consumption Model of Open Nebula (Ayush)
• Compare OpenNebula with other similar technologies (Ayush)
What is OpenNebula?
Open-Source Toolkit for Building Cloud Infrastructures

• Orchestrates storage, network and virtualization technologies to enable

the dynamic placement of multi-tier services on distributed infrastructures,
combining both data center resources and remote cloud resources,
according to allocation policies.
• Provides internal and Cloud administration and user interfaces for the full
management of the IaaS Cloud platform

• Private Cloud: Management of

virtual infrastructure in the data-
center or cluster

• Hybrid Cloud : Combination of

private with Cloud resources

• Public Cloud: Cloud interfaces for

the full management of services
Benefits
Infrastructure Manager
• Faster response to infrastructure needs for services
• Centralized management of the virtual and physical distributed infrastructure
• Higher utilization of existing resources
• Operational saving with server consolidation
• Lower infrastructure expenses

Infrastructure User
• Faster delivery and scalability of services to meet dynamic demands
• Support for heterogeneous execution environments
• Full control of the lifecycle of virtualized services management

System Integrators
• Fits into any existing data center
• Builds any type of Cloud deployment
• Open-source software, Apache license
• Seamless integration with any product and service in the virtualization/cloud
ecosystem and management tool in the data center
Features – Private Clouds
Private Clouds
• The infrastructure is owned and used by a single organization
• Private clouds enable a flexible and agile management of local infrastructure
• Not a new model, datacenter management has been around for a while
• Internal interfaces expose additional functionality for managing virtualized
resources and controlling data center operation, not exposed by cloud interfaces
• Cloud interfaces may be also provided for users requiring higher abstraction

• Centralized management
• VM placement optimization
• Dynamic resizing and partitioning
of the infrastructure
• Support for heterogeneous
workloads
Features – Private Clouds
Private Clouds
Feature Function
Internal Interface • Unix-like CLI for fully management of VM life-cycle and physical boxes
• XML-RPC API and libvirt virtualization API
Scheduler • Requirement/rank matchmaker allowing the definition of workload and
resource-aware allocation policies
• Support for advance reservation of capacity through Haizea
Virtualization • Xen, KVM, and VMware
Management • Generic libvirt connector (VirtualBox planned for 1.4.2)
Image Management • General mechanisms to transfer and clone VM images
Network Management • Definition of isolated virtual networks to interconnect VMs
Service Management • Support for multi-tier services consisting of groups of inter-connected
and Contextualization VMs, and their auto-configuration at boot time
Security • Management of users by the infrastructure administrator
Fault Tolerance • Persistent database backend to store host and VM information
Scalability • Tested in the management of medium scale infrastructures with hundreds
of servers and VMs (no scalability issues has been reported)
Installation • Installation on a UNIX cluster front-end without requiring new services
• Distributed in Ubuntu 9.04 (Jaunty Jackalope)
Flexibility and • Open, flexible and extensible architecture, interfaces and components,
Extensibility allowing its integration with any product or tool
Features – Hybrid Clouds
Hybrid Clouds

• Extension of Private Clouds to combine private with public Cloud-based

infrastructure to enable highly scalable hosting environments
• Access to remote cloud is fully transparent to private cloud users
• Hybrid Clouds enable the dynamic scaling of capacity to meet peak or
fluctuating demands
Features – Hybrid Clouds
Hybrid Clouds

Feature Function

Cloud Plugins • Amazon EC2 and ElasticHosts connectors

Federation • Support for simultaneous access to several remote clouds

Flexibility • Modular approach to develop new connectors

Features – Public Clouds
Public Clouds

• The infrastructure is owned by a single commercial organization and used

by customers
• Public clouds enable the deployment of an entire IT infrastructure without the
associated capital costs, paying only for the used capacity
• Cloud interface: Simple remote management of virtualized server instances
Features – Public Clouds
Public Clouds

Feature Function

Cloud Interfaces for

• Implementation of a subset of the EC2 Query API
Users

• The Cloud Service allows the implementation of new Cloud interfaces

Flexibility
(OCCI planned for 1.4.2)
The Anatomy of the Cloud
Different Perspectives of the Cloud – Demands from the Different Communities

Cloud Consumer

Cloud Application
Developer
Cloud
Administrator

Cloud Integrator
 The Anatomy of the Cloud
OpenNebula Architecture - Infrastructure Agnostic and Highly Customizable

Cloud
CLI GUI
Servers

Scheduler
OCA (Ruby, Java)

XML-RPC API

OpenNebula core

Monitoring Storage Network DB

Virtualization Images Auth

 OpenNebula is implemented as plugin model.

 It does not have any specific infrastructure requirements, fitting well into any pre-
existing environment, storage, network, or user-management policies.

 The user can take advantage of the native OpenNebula cloud API (OCA), available as
Java, Ruby, and XML-RPC API.
The Anatomy of the Cloud
OpenNebula Architecture – Performance and Security

 For performance reasons, the core of OpenNebula is written in highly optimized

C++ code, giving good scalability.

 A good example of its robustness is the CERN infrastructure prototype, initially

managing 480 server hosts; in spring 2010, they reached an impressive figure of
16,000 virtual instances.

 Security is also taken into serious consideration. Host communication takes place
exclusively through secured connections protected with the SSH RSA keypairs
and Secure Socket Layer (SSL).

 Each virtual network is isolated with a firewall, eatables.

 Ebtables works at the Address Resolution Protocol (ARP) level, also known as
the data link layer in the OSI stack.
The Anatomy of the Cloud
Cloud Architecture - The Internals of the Cloud

Interfaces, Tools& API

•CLI & Sunstone (GUI)
• API
• Cloud (EC2,OCCI)
• Service Management

Network Storage
• VLAN • VM disks (file & block)
• Firewalling • Image Distribution
• Multiple Technologies • Multiple Backends

Compute Hosts Multi-tenancy

• Grouped into logical clusters • AAA Services
• Multiple hypervisors • Scheduling
• Monitoring • Permissions & roles
The Anatomy of the Cloud
Basic OpenNebula Deployment

Monitoring,Virtualization,
Storage and Network

• Repository of VM images
• Multiple Backends (LVM, Ceph)

• Provides physical resources for the VMs

• Must have a hypervisor installed
Front end

 In OpenNebula front end run several services.

 Front end is also called as master node is a single gateway is responsible for queuing
Scheduling and submitting the job to machine in cluster.

 Provide an interface to the user for managing , monitoring, and submitting the job.

 It host the virtual machine repository and also run the transfer services to manage the
transfer of virtual machine image to concern work node.

 It allows to add new machine to our cluster.

 Provide an easy mechanism to setup virtual network in cloud.

Worker node

 OpenNebula worker node is also called as clusters

 It provides raw computing power for processing the jobs which is submitted
by the master node.

 Work node in OpenNebula that deploy a virtualization, hypervisor such as

xen ,VMware, kvm. .

 Provides physical resources for the VMs

The OpenNebula Provisioning Model
Challenges from the Infrastructure Perspective

Comprehensive Framework to Manage Infrastructure Resources

• Scalability: Several DCs with multiple clusters
• Outsourcing: Access to several clouds for cloudbursting
• Heterogeneity: Different hardware for specific workload profiles

Public Clouds DC West Coast DC Europe

The OpenNebula Provisioning Model

Challenges from the Organizational Perspective

Web Development HPC Simulations Big Data Analysis

Comprehensive Framework to Manage User Groups

• Several divisions, units, organizations…
• Different performance and security requirements
• Dynamic groups that require admin privileges
The OpenNebula Provisioning Model
The Goal: Dynamic Allocation o f Private and Public Resources to Groups o f Users

Web Development HPC Simulations Big Data Analysis

Public Clouds DC West Coast DC Europe

The OpenNebula Provisioning Model

Benefits
• Partition of cloud resources
• Complete isolation of users, organizations or workloads
• Allocation of Clusters with different levels of security, performance or high
availability to different groups with different workload profiles
• Containers for the execution of virtual appliances (SDDCs)
• Way of hiding physical resources from Group members
• Simple federation and scalability of cloud infrastructures beyond a single
cloud instance and data center
The OpenNebula Consumption Model

How Do I Manage a Multi-tier Service?

A Comprehensive Framework to Manage Complex Applications

• Several tiers
• Deployment dependencies between components
• Each tier has its own cardinality and elasticity rules
• …

Front-end

Worker Nodes
The OpenNebula Consumption Model

Multi-tier Application Management and Catalog

Management of interconnected multi-VM applications:
• Definition of application flows
• Catalog with pre-defined applications
• Sharing between users and groups
• Management of persistent scientific data
• Automatic elasticity
Comparison with Similar Technologies

Platform ISF VMware Vsphere Eucalyptus Nimbus OpenNebula

Virtualization Xen, KVM,

VMware, Xen VMware Xen, KVM Xen
Management VMware
Virtual Network
Yes Yes No Yes Yes
Management
Image
Yes Yes Yes Yes Yes
Management
Service
Contextualizatio No No No Yes Yes
n

Scheduling Yes Yes No No Yes

Administration
Yes Yes No No Yes
Interface
Hybrid Cloud
No No No No Yes
Computing

Cloud Interfaces No vCloud EC2 WSRF, EC2 EC2 Query

Flexibility and
Yes No Yes Yes Yes
Extensibility

Open Source No No GPL Apache Apache

References:

1. https://opennebula.io/docs/

2. https://www.opensourceforu.com/2017/02/an-
introduction-to-opennebula/

3. https://archives.opennebula.org/about:technology

4. https://github.com/OpenNebula/one
Thank You !