Cloud Computing

Dr. Monoj Kumar Muchahari

Dr. Monoj Kumar Muchahari 1

Outline

1 Introduction
Cloud computing at a glance
The vision of cloud computing
Defining a cloud
Potential Cloud Users
Deployment Model
Reference model
Characteristics and benefits
Challenges ahead

2 Historical developments
Distributed systems
Virtualization
Parallel and Distributed Computing
Parallel processing
Hardware architectures for parallel processing
Dr. Monoj Kumar Muchahari 2
Table of Contents

1 Introduction
Cloud computing at a glance
The vision of cloud computing
Defining a cloud
Potential Cloud Users
Deployment Model
Reference model
Characteristics and benefits
Challenges ahead

2 Historical developments
Distributed systems
Virtualization
Parallel and Distributed Computing
Parallel processing
Hardware architectures for parallel processing
Dr. Monoj Kumar Muchahari 3
1 Introduction
Cloud computing at a glance
The vision of cloud computing
Defining a cloud
Potential Cloud Users
Deployment Model
Reference model
Characteristics and benefits
Challenges ahead

2 Historical developments
Distributed systems
Virtualization
Parallel and Distributed Computing
Parallel processing
Hardware architectures for parallel processing

Dr. Monoj Kumar Muchahari 4

Cloud computing at a glance

1969 vision by ARPANET’s Leonard Kleinrock for ”computer utilities”

akin to essential services.
21st Century Transformation: Anticipated a paradigm shift with com-
puting services available on-demand without heavy investment.
Cloud Computing Evolution: Transitioned to cloud computing around
2007, enabling global access to applications and services.
Dynamic Provisioning: Cloud computing offers dynamic service provi-
sioning using virtualization technologies.
Pay-Per-Use Model: Operates on a pay-per-use basis, allowing flexible
rental of infrastructure and services.
Diverse Perspectives: Stakeholders have varied views, with enterprises
scaling infrastructure and end-users valuing ubiquitous access.
Utility-Like Characteristics: Cloud computing mirrors utility services,
providing global, device-agnostic access.
Dr. Monoj Kumar Muchahari 5
Cloud computing at a glance (contd.)

Role of Web 2.0 Technologies: Web 2.0 technologies are pivotal, en-
hancing cloud computing’s attractiveness for building systems.
Service Orientation and Virtualization: Service orientation enables fa-
miliar abstractions; virtualization ensures customization, control, and
flexibility.
Advantages: Dynamically provisioned IT resources overcome challenges
of estimating and purchasing additional infrastructure.
Consolidation and Standardization: Widely deployed, leading to con-
solidation and standardization of foundational technologies.
Long-Term Vision: Realization of a long-term vision for cloud comput-
ing as an open environment trading computing, storage, and services
as utilities.

Dr. Monoj Kumar Muchahari 6

1 Introduction
Cloud computing at a glance
The vision of cloud computing
Defining a cloud
Potential Cloud Users
Deployment Model
Reference model
Characteristics and benefits
Challenges ahead

2 Historical developments
Distributed systems
Virtualization
Parallel and Distributed Computing
Parallel processing
Hardware architectures for parallel processing

Dr. Monoj Kumar Muchahari 7

The vision of cloud computing

Cloud Accessibility: Allows easy provision of virtual resources with a

credit card, no upfront commitments.
Utility Transformation: Transforms computing into utilities, enabling
rapid, cost-effective deployment.
Market Evolution: Initially met with skepticism, now widely practiced,
accelerating technical development.
Current Limitations: Often limited to a single service or related services
by the same vendor due to standardization challenges.
Human-Driven Service Discovery: Currently relies on human interven-
tion for service discovery.
Consolidation and Efficiency: Concentrating cloud capabilities reduces
consumer-side infrastructure needs, optimizes facilities, contributes to
a greener IT, and increases revenue.

Dr. Monoj Kumar Muchahari 8

The vision of cloud computing (contd.)

Dr. Monoj Kumar Muchahari 9

1 Introduction
Cloud computing at a glance
The vision of cloud computing
Defining a cloud
Potential Cloud Users
Deployment Model
Reference model
Characteristics and benefits
Challenges ahead

2 Historical developments
Distributed systems
Virtualization
Parallel and Distributed Computing
Parallel processing
Hardware architectures for parallel processing

Dr. Monoj Kumar Muchahari 10

Defining a cloud

Dr. Monoj Kumar Muchahari 11

Defining a cloud (contd.)

Cloud Computing Basics: A broad term in IT covering various tech-

nologies like virtualization and utility computing.
Historical Origin: Comes from telecom, representing the Internet in
system diagrams.
Internet-Centric Nature: Signifies an Internet-centric way of comput-
ing, where the Internet is crucial for service delivery.
Definition by Armbrust et al.:
Cloud computing refers to both the applications delivered as ser-
vices over the Internet and the hardware and system software in
the datacenters that provide those services.
It introduces the concept of Everything as a Service (XaaS): Introduces
XaaS concept, meaning IT components are delivered, measured, and
priced as services.

Dr. Monoj Kumar Muchahari 12

Defining a cloud (contd.)

NIST’s Definition:
Cloud computing is a model for enabling ubiquitous, convenient,
on-demand network access to a shared pool of configurable com-
puting resources(e.g., networks, servers, storage, applications, and
services) that can be rapidly provisioned and released with mini-
mal management effort or service provider interaction.
Another important aspect of cloud computing is its Utility-Oriented
Model: Focuses on a pay-per-use model, where services are accessed
via web browser or API with minimal upfront costs.
Reese’s Criteria: A service is considered cloud-based if accessible via
web/browser, requires zero upfront cost, and adopts a pay-only-for-
usage model.

Dr. Monoj Kumar Muchahari 13

Defining a cloud (contd.)

Buyya et al.’s Definition:

A cloud is a type of parallel and distributed system consisting
of a collection of interconnected and virtualized computers that
are dynamically provisioned and presented as one or more unified
computing resources based on service level agreements established
through negotiation between the service provider and consumers.

Dr. Monoj Kumar Muchahari 14

1 Introduction
Cloud computing at a glance
The vision of cloud computing
Defining a cloud
Potential Cloud Users
Deployment Model
Reference model
Characteristics and benefits
Challenges ahead

2 Historical developments
Distributed systems
Virtualization
Parallel and Distributed Computing
Parallel processing
Hardware architectures for parallel processing

Dr. Monoj Kumar Muchahari 15

Potential Cloud Users

Cloud computing enables organizations across all market segments to

easily access, integrate, and leverage on-demand computing resources to
build effective, demand-driven systems.
Large enterprises can offload some of their activities to cloud-based
systems.
Small enterprises and start-ups can afford to translate their ideas into
business results more quickly, without excessive up-front costs.
System developers can concentrate on the business logic rather than
dealing with the complexity of infrastructure management and scala-
bility.
End users can have their documents accessible from everywhere and
any device.

Dr. Monoj Kumar Muchahari 16

1 Introduction
Cloud computing at a glance
The vision of cloud computing
Defining a cloud
Potential Cloud Users
Deployment Model
Reference model
Characteristics and benefits
Challenges ahead

2 Historical developments
Distributed systems
Virtualization
Parallel and Distributed Computing
Parallel processing
Hardware architectures for parallel processing

Dr. Monoj Kumar Muchahari 17

Deployment Model

The three major models for deploying and accessing cloud computing
environments are public clouds, private clouds, and hybrid clouds
Public Cloud - Cloud services are provided over a public network and
available to the general public. Resources are owned and managed by
the cloud provider.
Private Cloud - Cloud services are set up internally and used exclusively
by a single organization. The cloud infrastructure may be managed by
the organization or a third party.
Hybrid Cloud - Combines public and private clouds. Some computing
resources are managed in-house while others are external public cloud
services.

Dr. Monoj Kumar Muchahari 18

Deployment Model (contd.)

Dr. Monoj Kumar Muchahari 19

1 Introduction
Cloud computing at a glance
The vision of cloud computing
Defining a cloud
Potential Cloud Users
Deployment Model
Reference model
Characteristics and benefits
Challenges ahead

2 Historical developments
Distributed systems
Virtualization
Parallel and Distributed Computing
Parallel processing
Hardware architectures for parallel processing

Dr. Monoj Kumar Muchahari 20

Reference model

Variety in Cloud Services: Cloud computing offers diverse on-demand

IT services leading to varying user perceptions.
Three Major Categories: Classifies cloud computing services into three
categories: IaaS, PaaS, and SaaS.
Cloud Computing Reference Model: Describes the Cloud Computing
Reference Model as a layered view, organizing services from bottom to
top.

Dr. Monoj Kumar Muchahari 21

Reference model (contd.)

Infrastructure-as-a-Service (IaaS):
Base of the stack, delivers virtual hardware, storage, and networking on
demand.
Virtual hardware provides compute on demand through virtual machine
instances.
Virtual storage in raw disk space or object store, catering to different
needs.
Virtual networking manages networking among instances and their con-
nectivity.
Example: Amazon Web Services (AWS)

Dr. Monoj Kumar Muchahari 22

Reference model (contd.)

Platform-as-a-Service (PaaS):
Next step in the stack, provides scalable and elastic runtime environ-
ments on demand.
Hosts the execution of applications with a core middleware platform.
Focuses on abstracting environment for application deployment, manag-
ing scalability and fault tolerance.
Users leverage provider’s APIs and libraries, operating in a more con-
trolled environment.
Example: Google App Engine

Dr. Monoj Kumar Muchahari 23

Reference model (contd.)

Software-as-a-Service (SaaS):
Top of the stack, offers on-demand applications and services.
Replicates common desktop functionalities on the provider’s infrastruc-
ture.
Applications like office automation, document management, photo edit-
ing, CRM, etc.
Accessible through a browser on demand, shared across multiple users.
Example: Microsoft 365

Dr. Monoj Kumar Muchahari 24

Reference model (contd.)

User Needs Across Layers:

IaaS for building dynamically scalable computing systems with a specific
software stack.
PaaS for scalable programming platforms when developing new systems.
SaaS for end users wanting elastic scalability without software develop-
ment, installation, and maintenance hassles.
SaaS fits when existing services match user needs with minimal cus-
tomization.

Dr. Monoj Kumar Muchahari 25

Reference model (contd.)

Dr. Monoj Kumar Muchahari 26

1 Introduction
Cloud computing at a glance
The vision of cloud computing
Defining a cloud
Potential Cloud Users
Deployment Model
Reference model
Characteristics and benefits
Challenges ahead

2 Historical developments
Distributed systems
Virtualization
Parallel and Distributed Computing
Parallel processing
Hardware architectures for parallel processing

Dr. Monoj Kumar Muchahari 27

Characteristics and benefits

Cloud computing has some interesting characteristics that bring benefits to

both cloud service consumers (CSCs) and cloud service providers (CSPs).
These characteristics are:
No up-front commitments
On-demand access
Nice pricing
Simplified application acceleration and scalability
Efficient resource allocation
Energy efficiency
Seamless creation and use of third-party services

Dr. Monoj Kumar Muchahari 28

Characteristics and benefits (contd.)
Cloud computing reduces capital and maintenance costs for organiza-
tions by turning IT infrastructure and software into utilities that are
paid for as they are used. This is beneficial for startups and small busi-
nesses.
Cloud computing increases agility and flexibility in structuring software
systems since organizations can dynamically rent services rather than
being constrained by upfront capital costs. It also simplifies scalability.
For end users, cloud computing provides ubiquitous access to data and
services from anywhere at any time through multiple devices. It also
provides access to computing capabilities like office automation without
large upfront software investments.
Cloud computing enables optimization of resource allocation and energy
efficiency through economies of scale in large data centers.
The service-oriented and on-demand nature of cloud computing facil-
itates composing new systems and applications in a flexible way by
aggregating existing services.
Dr. Monoj Kumar Muchahari 29
1 Introduction
Cloud computing at a glance
The vision of cloud computing
Defining a cloud
Potential Cloud Users
Deployment Model
Reference model
Characteristics and benefits
Challenges ahead

2 Historical developments
Distributed systems
Virtualization
Parallel and Distributed Computing
Parallel processing
Hardware architectures for parallel processing

Dr. Monoj Kumar Muchahari 30

Challenges ahead

Cloud computing creates new challenges for dynamically provision-

ing resources and managing large virtualized infrastructures. Service
providers must efficiently allocate resources to meet changing demands
and integrate systems.
Securing confidential data is a major concern since organizations do
not own the infrastructure. Encryption protects transmitted data but
decrypted data in memory remains vulnerable to access.
Global nature of cloud computing leads to legal and regulatory issues.
Differing privacy laws across countries create disputes over third party
data access.

Dr. Monoj Kumar Muchahari 31

Table of Contents

1 Introduction
Cloud computing at a glance
The vision of cloud computing
Defining a cloud
Potential Cloud Users
Deployment Model
Reference model
Characteristics and benefits
Challenges ahead

2 Historical developments
Distributed systems
Virtualization
Parallel and Distributed Computing
Parallel processing
Hardware architectures for parallel processing
Dr. Monoj Kumar Muchahari 32
Historical developments

Renting computing services by leveraging distributed facilities dates

back to 1950s mainframes.
Since then, technology has continuously evolved and advanced. This
evolution created favorable conditions enabling cloud computing.
Five core technologies influenced cloud computing:
Distributed systems - computing across networked machines
Virtualization - abstracting compute resources from hardware
Web 2.0 - internet-based applications and services
Service orientation - modular, reusable software components
Utility computing - pay-as-you-go model for computing services
Mainframes enabled early distributed computing.
Advances in virtualization, Web 2.0, service orientation led to on-
demand utility computing model.
The combination of these technologies over decades of progress ulti-
mately realized modern cloud computing.
Dr. Monoj Kumar Muchahari 33
1 Introduction
Cloud computing at a glance
The vision of cloud computing
Defining a cloud
Potential Cloud Users
Deployment Model
Reference model
Characteristics and benefits
Challenges ahead

2 Historical developments
Distributed systems
Virtualization
Parallel and Distributed Computing
Parallel processing
Hardware architectures for parallel processing

Dr. Monoj Kumar Muchahari 34

Distributed systems

Distributed systems involve multiple independent computers acting as

one coherent system.
Clouds are large distributed computing systems that provide on-demand
services.
Cloud computing utilizes distributed systems to share and better utilize
resources.
Distributed systems have properties like scalability, concurrency, and
availability that also characterize clouds.
Evolution to cloud computing involved mainframes, cluster computing,
and grid computing as key milestones.

Dr. Monoj Kumar Muchahari 35

Distributed systems (contd.)

Mainframes
Mainframes were early large computational facilities using multiple
processors.
Used by organizations for bulk data processing like transactions, ERP,
etc.
Offered large compute power by using multiple processors presented as
single entity.
Key feature was high reliability, being always on and tolerating failures.
Popularity has reduced but evolved mainframes still used for
transaction processing.
Not distributed systems but laid groundwork for utilizing multiple
processors and reliability needed in clouds.

Dr. Monoj Kumar Muchahari 36

Distributed systems (contd.)

Clusters
Cluster computing emerged as a low-cost alternative to mainframes
and supercomputers.
These were connected over high-bandwidth networks and managed as a
single system.
Became standard for parallel and high-performance computing starting
in the 1980s.
Built from commodity hardware so cheaper than mainframes, made
HPC accessible.
Leveraged commodity machines to solve problems previously requiring
supercomputers.
Easily scalable by adding more machines if higher compute power
needed.

Dr. Monoj Kumar Muchahari 37

Distributed systems (contd.)

Grids
Emerged in 1990s as evolution of cluster computing.
Proposed new approach to access large compute, storage, services - like
a utility.
Initially aggregates of geographically dispersed clusters via Internet.
Grids are dynamic aggregations of heterogeneous computing nodes, Scale
is nationwide or worldwide.
New problems required more compute power than single clusters.
Improvements in networking and Internet enabled connectivity.
Grids now serve multitude of users worldwide.
Laid groundwork for on-demand access to resources that defines cloud
computing.

Dr. Monoj Kumar Muchahari 38

1 Introduction
Cloud computing at a glance
The vision of cloud computing
Defining a cloud
Potential Cloud Users
Deployment Model
Reference model
Characteristics and benefits
Challenges ahead

2 Historical developments
Distributed systems
Virtualization
Parallel and Distributed Computing
Parallel processing
Hardware architectures for parallel processing

Dr. Monoj Kumar Muchahari 39

Virtualization

Virtualization is core technology enabling abstraction of computing re-

sources, like hardware, runtimes, storage, networking.
Around for 40+ years but now applied efficiently due to technology
advances.
Hardware virtualization simulates hardware for OS, enables VM isola-
tion.
Enables on-demand customized software stacks on shared hardware.
Essential for delivering servers on demand like EC2.
Also used for runtime environments like Java and .NET.
Isolates application execution and controls resource access.
Performance impact is minor thanks to technology advances.
Cloud platforms leverage virtualization to deliver on-demand, scalable
services.
Dr. Monoj Kumar Muchahari 40
1 Introduction
Cloud computing at a glance
The vision of cloud computing
Defining a cloud
Potential Cloud Users
Deployment Model
Reference model
Characteristics and benefits
Challenges ahead

2 Historical developments
Distributed systems
Virtualization
Parallel and Distributed Computing
Parallel processing
Hardware architectures for parallel processing

Dr. Monoj Kumar Muchahari 41

Parallel and Distributed Computing

The two fundamental and dominant models of computing are sequential

and parallel.
More precisely, the term parallel computing refers to a model in which
the computation is divided among several processors sharing the same
memory.
The term distributed computing encompasses any architecture or sys-
tem that allows the computation to be broken down into units and
executed concurrently on different computing elements, whether these
are processors on different nodes, processors on the same computer, or
cores within the same processor.
Silicon processors are reaching physical limits in speed and density.
Connecting multiple coordinated processors is a solution. Led to devel-
opment of parallel computing techniques, architectures, systems.
Helps solve complex ”Grand Challenge” problems. Overcomes limita-
tions of single processors.
Dr. Monoj Kumar Muchahari 42
1 Introduction
Cloud computing at a glance
The vision of cloud computing
Defining a cloud
Potential Cloud Users
Deployment Model
Reference model
Characteristics and benefits
Challenges ahead

2 Historical developments
Distributed systems
Virtualization
Parallel and Distributed Computing
Parallel processing
Hardware architectures for parallel processing

Dr. Monoj Kumar Muchahari 43

Parallel processing

Parallel processing involves executing multiple tasks simultaneously on

multiple processors.
Parallel program hasmultiple active processes working on a problem
concurrently.
Problem is divided into subtasks using divide-and-conquer approach.
Each subtask runs on a different CPU.
Needed because many applications require more compute power than
one CPU can provide.
Parallel processing cost-effectively increases compute power by adding
more CPUs.
Provides more computing power than single processor systems.

Dr. Monoj Kumar Muchahari 44

1 Introduction
Cloud computing at a glance
The vision of cloud computing
Defining a cloud
Potential Cloud Users
Deployment Model
Reference model
Characteristics and benefits
Challenges ahead

2 Historical developments
Distributed systems
Virtualization
Parallel and Distributed Computing
Parallel processing
Hardware architectures for parallel processing

Dr. Monoj Kumar Muchahari 45

Hardware architectures for parallel processing

Based on the number of instruction and data streams that can be

processed simultaneously, computing systems are classified into the
following four categories:
Single-instruction, single-data (SISD) systems
Single-instruction, multiple-data (SIMD) systems
Multiple-instruction, single-data (MISD) systems
Multiple-instruction, multiple-data (MIMD) systems

Dr. Monoj Kumar Muchahari 46