Scribd
Upload
3 views14 pages

week 1

The document provides an overview of parallel and distributed computing (PDC), highlighting its significance in enhancing computational speed and efficiency through simultaneous task execution. It discusses the applications of PDC across various domains, including engineering, computer systems, and commercial sectors, emphasizing its role in optimizing performance and resource utilization. Additionally, it addresses the evolution of parallel programming environments and the necessity of parallelism in the face of advancing uniprocessor speeds.

Uploaded by

cosc222101006
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
3 views14 pages

week 1

The document provides an overview of parallel and distributed computing (PDC), highlighting its significance in enhancing computational speed and efficiency through simultaneous task execution. It discusses the applications of PDC across various domains, including engineering, computer systems, and commercial sectors, emphasizing its role in optimizing performance and resource utilization. Additionally, it addresses the evolution of parallel programming environments and the necessity of parallelism in the face of advancing uniprocessor speeds.

Uploaded by

cosc222101006
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
You are on page 1/ 14

Introduction to Parallel

and Distributed
Computing
Topics covered
• Introduction to Parallel and Distributed Computing
• What, Why and Who uses PDC?
• Visualization and Animation
• Interconnection Networks (INs)
• Static INs Tree
• Hypercube
• k-d Mesh
Motivating parallelism
• The role of parallelism in accelerating computing speeds
has been recognized for several decades.
• Its role in providing multiplicity of data paths and
increased access to storage elements has been
significant in commercial applications.
• The scalable performance and lower cost of parallel
platforms is reflected in the wide variety of applications.
• Developing parallel hardware and software has
traditionally been time and effort intensive.
Need for Parallelism
• If one is to view this in the context of rapidly improving
uniprocessor speeds, one is tempted to question the
need for parallel computing.
• There are some unmistakable trends in hardware
design, which indicate that uniprocessor (or implicitly
parallel) architectures may not be able to sustain the
rate of realizable performance increments in the future.
• The emergence of standardized parallel programming
environments, libraries, and hardware have significantly
reduced time to (parallel) solution.
• Parallel computing involves
the simultaneous execution
of multiple tasks, breaking
down a large problem into
Parallel Computing smaller, independent sub
problems that can be
solved concurrently.
• Parallelism enhances
computational speed by
leveraging multiple processors
or cores.
• Parallel computing boosts
performance, enabling the
handling of complex tasks
efficiently.
• Applications include scientific
simulations, data analytics, and
multimedia processing.
• Distributed computing
involves the coordination
and collaboration of Distributed Computing
multiple independent
systems to work towards
a common goal.
• Distributed systems span across
geographically dispersed locations, connected
through a network, and share resources.
• Distributed computing enhances scalability,
fault tolerance, and resource utilization in
large-scale systems.
Distributed • Cloud computing, grid computing, and
internet-based applications showcase
computing distributed computing in action.
Distributed computing
Parallel and Distributed Computing
Who uses parallelism
• Parallelism finds applications in very
diverse application domains for different
motivating reasons.

• These range from improved application


performance to cost considerations.
Applications in Engineering and Design

• Design of airfoils (optimizing lift, drag, stability), internal


combustion engines (optimizing charge distribution,
burn), high-speed circuits, and structures (optimizing
structural integrity, design parameters, cost, etc.).
• Design and simulation of micro- and Nano scale systems.
• Process optimization, operations research.
• Advances in computational physics and chemistry have
explored new materials, understanding of chemical
pathways, and more efficient processes.
Applications in Computer Systems

• Network intrusion detection, cryptography, multiparty


computations are some of the core users of parallel computing
techniques.
• Embedded systems increasingly rely on distributed control
algorithms.
• A modern automobile consists of tens of processors
communicating to perform complex tasks for optimizing handling
and performance.
• Conventional structured peer-to-peer networks impose overlay
networks and utilize algorithms directly from parallel computing.
Commercial Applications
• Some of the largest parallel computers power the wall
street!
• Data mining and analysis for optimizing business and
marketing decisions.
• Large scale servers (mail and web servers) are often
implemented using parallel platforms.
• Applications such as information retrieval and search
are typically powered by large clusters.

You might also like

pFad - Phonifier reborn

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.


Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy