Storage for Networking Professionals

Presented by

Elaine Silber
Training and Certification Director

Infinity I/O
www.InfinityIO.com
Page 1

SNIA Legal Notice

The material contained in this tutorial is copyrighted by the SNIA. Member companies and individuals may use this material in presentations and literature under the following conditions:
Any slide or slides used must be reproduced without modification The SNIA must be acknowledged as source of any material used in the body of any document containing material from these presentations.

This presentation is a project of the SNIA Education Committee.

Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Page 2

Aims and Objectives

This tutorial is intended to be an introduction to basic storage technologies, techniques and terminology associated with data storage devices for networking professionals. It provides an introduction for industry professionals who wish to acquire these fundamentals of data storage before attending more targeted networked storage presentations

Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Page 3

Outcomes
After attending this tutorial you should be able to:
Understand basic storage terms and technology and the basic operation of hard disk drives Identify the components of the SNIA Shared Storage Model Appreciate how disk drive characteristics impact performance Describe storage concepts, including LUN mapping, zoning, volume manager and file systems Describe basic storage protection techniques - RAID Identify tape storage technologies Learn Storage connectivity approaches Understand Tiers of Storage (TOS) as seen from an Information Life Cycle Management point of view

Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Page 4

Networking vs Storage Language

The Language of Networking The Language of Storage
Data over Distance Information movement Configuring and segmenting network topologies Hubs, bridges, switches, routers, gateways, NIC (Network Interface Card), HBA (Host Bus Adaptor) Inherently error prone and acceptable Client/Server applications Email, Web Browsing, File Management Network Interfaces Data over Time Information repository Formatting and partitioning hard disks, Tiers of Storage (TOS) JBOD, RAID, Tape drive Controllers Designed to maximize correct delivery. Expect error free. Initiator/Target Functions Backup, Archive, Mirror, Block Management I/O interfaces
Page 5

Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Networking vs Storage Language

The Language of Networking The Language of Storage
Speed, Solid State Media - Copper, Fiber, Wireless Bits in packets, CRC error checks every packet Buffers and Link transfer rates Kb/s, Mb/s, Gb/s Interconnectivity network and device latencies bottlenecks Applications HTTP, NFS, SMTP Transport Protocols (TCP/IP/Ethernet), Fibre Channel Capacity, Mechanical Movement Media Disk, Tape Bytes in blocks, Parity check every byte Cache and Disk/Tape I/O interface transfer rates MB/s Throughput Disk/Tape seek times and latencies ms, us, ns Logical Device Protocols Serial SCSI, FC, IDE/ATA Physical Protocols Parallel SCSI
Page 6

Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Historical View of Storage/Network

Host-attached storage Network Administrators saw storage as a black box Storage Managers saw the network as a cloud

Storage Admin Network Admin Database Manager

Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Page 7

Current View of Shared Storage

Storage is a shared resource Separate from the computer system (host) Hosts are consumers of storage

Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Page 8

Overall Terminology Confusion Classic Storage Model

Applications

Storage Domain:
Host

Anything goes?
Appliance?

Network?
Disk array? Data mover?

JBOD?

Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Page 9

SNIA Shared Storage Model

Applications

File/record layer

Files/Databases Files/Databases

Storage Domain

Database (dbms)

File system (FS)

Packing many smaller things into a few larger ones..

Block Layer Block Layer Host

Network Device Storage Devices disk drives, tape drives, solid state disk Block Aggregation address mapping, concatenation, striping, mirroring

Block layer

Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Storage Devices

Block Aggregation

Page 10

Storage Basics

Disk Physical Characteristics

Page 11

Disk Drives Walk the Same Walk

From a component perspective, all disk drives are basically the same. A disk platter, usually comprising an aluminum or glass substrate material that is sputter-coated with a magnetically corrosive media (chromium, ruthenium, etc.), provides a precision surface area in which discrete data bits can be written into a series of tracks. Jon William Toigo
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Page 12

The ABCs of Physical Addressing

Head
Read/write head Defines a single disk surface

Cylinder
The information that can be accessed on a disk drive by all the heads, without having to seek

Sector
A subdivision of a disk surface which is created during formatting (typically a 512-byte segment)
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Page 13

The ABCs of Physical Addressing

16 Logical Heads Specifications on label: 1416 Cylinders (1416 tracks) 16 Heads 63 Sectors
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

But 4 Physical Heads

Page 14

The ABCs of Disk Performance

Data transfer time is determined by:
Speed of I/O technology (SCSI, Fibre Channel, etc) Seek time (time for heads to move to a new track) Latency (time for sector to rotate under heads) Speed and size of disk drive buffer memory Whether the demand equals offered load
(Can drive keep up with it speed of disk drive vs throughput)

Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Page 15

Storage Basics

Storage Interfaces

Page 16

Drives Do Not Talk the Same Talk

Drive Interface
Parallel IDE/ATA or Serial ATA (sometimes abbreviated SATA)
Integrated Drive Electronics (IDE), AT Attachment (ATA)

Parallel SCSI or SAS (Serial Attached SCSI) Fibre Channel

Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Page 17

Drives Do Not Talk the Same Talk

Drive Interface
Parallel IDE/ATA
lower-cost devices than SCSI, controller/drive electronics wedded to the drive itself. IDE standardizes how disk drives are connected to servers via a ribbon cable and an interface connector on a PC or server motherboard. IDE/ATA protocol five+ revisions, For 10 years now speeds and feeds keeping pace with speed- and capacity-hungry applications. Little improvement in transfer rate expected in future Difficult to create arrays with Parallel ATA

Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Page 18

Drives Do Not Talk the Same Talk

Drive Interface
Serial ATA (sometimes abbreviated SATA)
is a standards-based interface that improves on parallel IDE/ATA interface transfer rate is 150Mb/s, (compared with parallel ATA's 100Mb/s) That's a 50% increase, particularly useful in applications with large data volume requirements, such as video editing. First Generation SATA drives not yet more efficient than Parallel ATA, SATA-2 and SATA-3 - expected transfer rates of 300 and 600 Mb/s Still limited by max speed of PCI bus at 133 Mb/s
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Page 19

Drives Do Not Talk the Same Talk

Drive Interface
Parallel SCSI
Several standards-based iterations, Confusing descriptors Fast, Wide, Ultra Currently, UltraSCSI 3 or Ultra160 SCSI transfer rates of 160Mb/s attach up to 16 devices on a single bus. Ultra320 andUltra640 are demonstrated at trade shows Doubling and quadrupling of transfer rates No significant improvement in device attachment or cabling distance characteristics. Note Tape Drive speeds do not come close to SCSI bus speeds which is a good thing in order to keep drives moving
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Page 20

Drives Do Not Talk the Same Talk

Drive Interface
SAS (Serial Attached SCSI)
Greater throughput Higher device attachment capabilities Greater cabling distances http://www.scsita.org/aboutscsi/presentations.html

Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Page 21

Drives Do Not Talk the Same Talk

Reliability SCSI Drives
Mechanical pieces of a SCSI disk drive are manufactured with a higher duty cycle Enterprise drives, supporting highperformance transaction processing databases, are constantly being beaten on by random seeks.

CPU Utilization SCSI & FC drives

Responsibility is split between the host processor and a specialized processor on the hard disk assembly for performing functions such as queue management.

IDE/ATA drives
The electronics in an IDE/ATA drive rely on the host processor to perform all storage tasks.

IDE/ATA drives
Considerably lower duty cycles. For PCs.

Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Page 22

Storage Basics

Protocols

Page 23

SCSI Standards Architecture*

SCSI Block Commands (e.g., disk drive) (SBC, SBC-2)

Reduced Block Commands (e.g., disk drive) (RBC, RBCAM-1)

SCSI Stream Commands (e.g., tape drive) (SSC, SSC-2, SSC-3)

SCSI Media Changer (e.g., jukebox) (SMC, SMC-2)

Multi-Media Commands (e.g., DVD) (MMC, MMC-2-5)

SCSI Controller Commands (e.g., RAID) (SCC-2)

SCSI Enclosure Services (SES, SESAM1, SES-2)

Device Specific Command Sets

Object Based Storage Device (OSD)

Management Server Commands (MSC)

Primary Commands for All Devices (SPC, SPC-2, SPC-3)

Shared Command Set Architectural Model

SAM SCSI Architectural Model (Originally SCSI-3)

SCSI Parallel Interface (SPI-2-5)

Serial Bus Protocol (SBP-2-3)

Fibre Channel Protocol (FCP, FCP-2, FCP-3)

SSA-SCSI-3 Protocol (SSA-S3P) SSA-TL2

SCSI-RDMA Protocol (SRP, SRP-2)

iSCSI

Serial Attached SCSI (SAS, SAS1.1)

Transport Protocols

Related Standards and Technical Reports (SDV, PIP, SSM, SSM2 and EPI)

IEEE-1394

Fibre Channel (FC)

SSA- PH1 or SSA-PH2

InfiniBand TM

Internet

Physical Interfaces

Storage for Networking Professionals *See Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Page 24 Tutorial SCSI The Protocol for all Storage Architectures

ABCs of SCSI Addressing

SCSI Initiator Host Bus Adaptor

Data/Address Bus

ID7
Interface Interface

Control Signals Interface

SCSI RAID
ID0

SCSI RAID
ID4

SCSI RAID
ID6

LUN 0 LUN 1 LUN 2 LUN 3

LUN 0 LUN 1

LUN 0 LUN 1 LUN 2 LUN 3

Address = BUS : Target ID : LUN

Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Page 25

How do you route SCSI?

SCSI isnt a routable protocol so how do you route SCSI?

SCSI-FCP FCIP
Ethernet header IP TCP header
FCIP Header

S O F

FC Frame Header

Payload: SCSI Command in IU

C R C

E O F

S O F

FC Frame Header

Payload: SCSI Command in IU

C E R O C F

F C S

iFCP iSCSI

Ethernet header

IP TCP header

iFCP Header

FC S O Frame F Header

Payload: SCSI Command in IU

C E R O C F

F C S

Ethernet header

IP header

TCP

iSCSI header

Payload: SCSI Command PDU

F C S

Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Page 26

Storage Basics

Basic Storage Protection

Page 27

RAID Flavors
Why RAID? -Redundant Array of Independent Disk
Original work was to get away from large monolithic disks Better performance with more individual disks and smaller

RAID 1Mirrored Volumes RAID 0+1Mirrored Array RAID 4Block-Level Striping with Parity Disk RAID 5Striping with Distributed Parity RAID 10Mirrored Striping Array

See Appendix for further definitions

Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Page 28

RAID Flavors

Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Page 29

Software RAID

Volume A Volume,me B

Volume n

Block A1 Block A2 Block A3

Block B1 Block B2 Parity 3

Block C1 Parity 2 Block C3

Parity 1 Block D2 Block D3

SERVER

RAID STORAGE

Volume management performed by server Parity computation performed by server increased overhead RAID performance dependent on server performance and CPU load For simple environments with lower performance and availability requirements
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Page 30

Hardware RAID

Volume A Volume,me B

Volume n

Block A1 Block A2 Block A3

Block B1 Block B2 Parity 3

Block C1 Parity 2 Block C3

Parity 1 Block D2 Block D3

SERVER

RAID STORAGE

Volume management performed by RAID controller card Embedded processor in RAID controller to reduce server overhead Parity computation performed by auxiliary processor in controller Dedicated cache memory increases server write performance
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Page 31

Future for RAID

A SNIA Technical Working Group (TWG) is currently a common RAID Disk Data Format (DDF) Specification Would allow storing RAID configuration on physical disks in a DDF by different vendor implementations in a common format Why? -- Would enable data-in-place migration among systems from different vendors.

www.snia.org/tech_activities/ddftwg
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Page 32

Storage Basics
Physical vs. Logical

Logical View of Storage

Page 33

Data Presentation Chain

Application
presents

Users Applications Application

presents

File File

Applications Files System Records tuples tables File System Volumes Metadata tables tablespaces I/O Subsystem

File File

presents

Volume

Volume

presents

Logical Blocks

Logical Blocks

presents

RAID Controller

RAID Controller

presents

Phys. Blocks (C/H/S) Disk Drives Page 34

Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

What the Host Sees

?
SAN

JBOD (Just a Bunch of Disks)

Identifying storage volumes (SCSI IDs and LUNs) Block Access

Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Page 35

What the Host Sees with JBOD

Logical Disks SCSI LUNs (Logical Units) 5 x 1GB Physical Disks 5 x 1GB

Host A Drive D (2GB) Drive E (500MB) Drive F (500MB) SCSI ID 3 SCSI ID 4 SCSI ID 1

JBOD
1GB 1GB 1GB 1GB LUN 0 LUN 0 LUN 0 LUN 0

Host B Drive D (1GB) Drive E (1GB) SCSI ID 2 SCSI ID 0

SAN

1GB

LUN 0

Volume Manager

HBA (Host Bus Adaptor) Utility

Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Page 36

What the Host Sees with RAID

Logical Disks SCSI LUNs 2 x 1GB 1 x 3GB Physical Disks 5 x 1GB

Host A Drive D (3GB) SCSI ID 2

1GB 1GB 3GB

RAID (Redundant Array of Independent Disks)

LUN 0 LUN 0 LUN 0 LUN 1 LUN 2

Host B Drive D (1GB) Drive E (1GB) SCSI ID 0 SCSI ID 1

SAN

Volume Manager

HBA Utility

RAID Configuration Utility

Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Page 37

Storage Virtualization at Work

Logical Disks Virtualized LUNs 1 x 1GB 1 x 4GB 1 x 5GB
Metadata Manager SCSI ID 2
3GB 1GB

SCSI LUNs 4 x 1GB 2 x 3GB

Physical Disks 10 x 1GB

Host A Drive D (5GB)

1GB 1GB

LUN 0 LUN 0 LUN 0 LUN1 LUN 2

RAID

Host B Drive D (1GB) Drive E (4GB)

4GB 5GB

SAN
1GB 1GB

LUN0 LUN0 LUN 0 LUN 1

RAID

SCSI ID 0 SCSI ID 1

3GB

LUN 2

Volume Manager

HBA Utility

Virtualization Software

RAID Configuration Utility

Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Page 38

Summary: WYSIWYG? Not..

What the file system makes the user believe.

Myfile.doc Myfile.xls Myfile.ppt

Volume Manager keeps track where data blocks are written

13 9 Reality

10 4 12 14 6 1 15 8 11 3 7

Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Page 39

Storage Basics

Tape (no less important)

Page 40

Tape in the SNIA Shared Storage Model

Applications Tape Application (e.g. backup software)

File/record layer

Database (dbms)

File system (FS)

Block Aggregation

Host

Host
Network Device Network Device Extent aggregation

Block layer

Storage Devices

Tape Devices Tape Media

Page 41

Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Tape format system

Why Tape?
Speed Faster than disk? Scalability
Real estateGB/sq. ft.

Proven longevity
Legal, Archiving

Unlike disk, tape media and devices are not co-dependent

Transportableoff-site archiving and storagedisaster recovery Media could be read on compatible tape mechanisms Mechanism failure does not compromise data

Serial access is appropriate for reading and writing long streams of data (but not for real-time backup) Disk to disk copy in theory, but disk to disk to tape is reality for backup. Question
If an appliance controls the backup to tapes, can the backup software read it?

Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Page 42

ABCs of Tape Media

Tape Reel Tape Reel Take-up reel Take-up reel

Tape Reel Tape Reel Tape Arms Tape Arms Pinch Rollers Pinch Rollers Read/write head Read/write head

Take-up reel Take-up reel

Leader pin Leader pin Read/write head Read/write head

Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Page 43

Media Compatibility
Tape drives and cartridges are typically developed together as inseparable technologies:
New tape drives may have the capability to read existing cartridges made on older drives Older drives may not have the capability to read the cartridges written by newer drives

Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Page 44

Tape Recording Method

Data is written to tapes in large contiguous sequential blocks (variable size) Access time to a random block on a tape may be long due to serial recording method:
Some technologies read tape from the middle outreduces access time by 50% on average

Tape can achieve streaming speeds in the range of 5 to 30MB/sec (uncompressed) Compressed speeds vs uncompressed speeds
Compression typically done at tape drive Compression ratio is dependent on the data type (e.g. BMP vs JPEG format)
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Page 45

Automatic Tape Subsystems

Tape Library
Tape automation product Requires host level specialized management software Management path different from data path Automates media selection and loading Uses bar code readers to facilitate media management

No tight connection between tape library and tape drives (unlike tape drives and tape cartridges)

Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Page 46

Storage Basics

Storage Connectivity

Page 47

Storage Connectivity (DAS)

Traditional way of implementing storage Storage is managed by a single host Other hosts must access the storage through that single host, over the LAN
Direct-attached external storage

Fibre Channel SCSI

Tape device Direct-attached internal storage

Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Direct-attached external storage

Page 48

Storage Connectivity (NAS)

Provides access to storage over the Network NAS devices contain a thin server that provides file services to other hosts on the LAN using network file access methods File access

NAS appliance
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Page 49

Storage Connectivity (SAN)

Servers and stand-alone storage devices, connected by a dedicated network Any server can be configured to access any storage array and/or storage to storage access Servers and storage can scale independently Block level access
Tape device

Server
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Storage array
Page 50

Storage Connectivity Transport Technologies

Parallel SCSI Fibre Channel (Serial)

InfiniBand (Serial) iSCSI (Serial) Close integration of Close integration of System Software and System Software and Hardware functions Hardware functions Definable low latencies Definable low latencies In order delivery built in In order delivery built in to the hardware to the hardware

IP based message passing IP based message passing environment environment Variable (high) latencies Variable (high) latencies In-order delivery support In-order delivery support required (TCP) required (TCP) Security and QoS defined Security and QoS defined

Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Page 51

Storage Connectivity Long Distance

Long Distance to Storage Why???
Large campus environment Separate data centers that need improved manageability Disaster recovery or business continuity Vendors want to demonstrate unique features
FC

Short distance <= 100 km

SONET/SDH

Medium distance <= 160km

IP Routed WAN

Long distance > 160km

Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Page 52

Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Page 53

Storage Connectivity Long Distance

Before you go the distance, consider Applications differ in terms of latency and bandwidth Application read and write characteristics vary
some applications read more data than they write some write in small data blocks, others large some have serial activity while others are random

Where is caching being done?

in the server, array or application

Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Page 54

Storage Connectivity Long Distance

Before you go the distance, consider Cross-site replication techniques vary considerably*
Should you mirror the data synchronously, asynchronously or semi-synchronously? Should the storage array do the replication, or should the operating system or application do the replication? Should a virtualization appliance handle the replication? Should you make full replicas of data or just snap copies?
Check out Check out SNIA Tutorial: SNIA Tutorial:
Data Protection Data Protection with Storage with Storage Networks Networks
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Page 55

Storage Connectivity SAN Extension Options

FC
FCIP
TC P

FCIP over public or private IP (Frame Relay or T1/T3)* FCIP over SONET/SDH FC directly over SONET/SDH Check out Check out FC over DWDM or CWDM SNIA Tutorial: SNIA Tutorial:
Metropolitan and Metropolitan and Wide Area Wide Area Networks Networks
FC AAL ATM SO N ET FC FC

IP
Ethernet/PoS

SO N ET

SONET

SONET DWDM

FCIP

FC over ATM

FC over SONET

FC over SONET over DWDM or CWDM

Page 56

Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Page 57

Hurdles to Overcome

Optical Network Speed

User

User

Doubling every 8-9 months

Storage Capacity

Doubling every 12 months

Compute Power

Doubling every 18 months

Average values

Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Page 58

Storage Basics
New way to look at Storage Information Life Cycle Management (ILM) and Tiers of Storage (TOS)

Page 59

Information Lifecycle
Information lifecycle:
The creation and/or acquisition of the data information comes into the organization either by being created by one or more individuals or by being acquired through e-mails, faxes, letters, phone calls, etc. The publication of the data some information needs to be published, either in print form or on a companys intranet or a public Web site. The retention and/or removal of the data some information must be archived for later use, and some information has a finite purpose and can be discarded once it has served its purpose or is no longer valuable to the organization.
http://www.webopedia.com/TERM/I/ILM.html
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Page 60

Information Lifecycle MANAGEMENT

IL Management
determining how the information is stored based on how high of a priority the access of the information has in the organization at any given moment. At each stage in the informations lifecycle, the management infrastructure must determine the best software, hardware and storage medium required for the information at that stage, and how those factors differ as the data move through the lifecycle.
Check out Check out SNIA Tutorial: SNIA Tutorial:
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Business Business Continuity Continuity And HA And HA

Page 61

Tiers of Storage (TOS)

Hardware driven*
High-end storage Super RAID Array Middle tier Raid Array Low end storage jbod
features, functionality, capacity, I/O features, functionality, capacity, I/O capabilities, etc capabilities, etc
*Moving beyond data storage By Ed Frauenheim Staff Writer, CNET News.com
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Page 62

Tiers of Storage (TOS)

Policy Driven
First
How valuable is this information now? What kind of performance do you need now? Where is the best place for storing it? What is the lowest cost that meets your requirements?

Secondly
What Information needs to be protected and how? Backup tiers (Primary, secondary, nearline, online, offline) What is the value of information over time? Migration of data

Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Page 63

Case Study Hardware TOS

Stanford University Information Technology Systems and Services

Feature
Uptime Connectivity Ports Internal Disks RAID levels Maximum LUNs Cache Size Non-Disruptive Upgrades Upgrade Cost per GB Architecture

High- End
>99.999% < 6 min down/year FC, SCSI, ESCON, FICON 16 - 96 SCSI or FC (73GB/146GB) 0, 1,3,5 20,000 16GB 64GB Yes >$120 Monolithic or Modular

Mid-Tier
>99.99% < 1 hour down /year FC 4-8 SCSI or FC (73GB/146GB) 0,1,3 1024 2GB 16GB Yes < $25 Modular

Low-End
>99.9% < 9 hours down /year FC 2 ATA (180GB/250GB) 0,1 32 512MB 1GB Maybe < $7 Modular Page 64

Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Case Study End User Requirements

Requirements
8TB usable RAID 5 capacity GT or = 1024 LUNs GT or = 2 Gb/s FC ports Support for existing infrastructure Multipathing LUN copying and Snapshots Ability to support FC and ATA drives

Desirable Features
RAID 1, 1 + 0 Veritas DMP support
DMP Dynamic MultiPathing Hardware agnostic

Replication of volumes to another array Array management by 3rd party tools

Stanford University Information Technology Systems and Services

Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Page 65

Storage Basics

Audience Poll and Q&A

Page 66

Audience Poll
Are you an end user?
Reseller? Vendor?

Have you attended other SNIA Tutorials?

At this meeting or other SNIA event?

Do you have networked storage in place today?

NAS or SAN? Do you plan to within 6 or 12 months?

Have you been SNIAcertified?

Do you or your staff plan on taking exam within 6 to 12 months?

Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Page 67

Q&A / Feedback
Please send any questions or comments on this presentation to SNIA: tut-storagefornetwor@snia.org
Many thanks to the following individuals for their contributions to this tutorial.
SNIA Education Committee Elaine Silber Infinity I/O Bob Lockhart Neoscale Brandy Bartyon Medusa Labs Howie Goldstein - HGAI Leroy Budknik Knowledge Transfer John Moores Sandial Systems Barry Walker Infinity I/O SW Worth Microsoft Jim Nelson Vixel Sam Samuel Infinity I/O Barbara Craig QLogic Ronnie Koch Infinity I/O, Africa

Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Page 68

Storage Basics

Appendix Hidden Slides

Page 69

RAID 0Striped Volumes

Volume A Volume B

Volume n

Block 1 Block 3 Block 5

Block 2 Block 4 Block 6

SERVER

RAID STORAGE

Data blocks written sequentially to each disk in turn Not really RAID No redundant check data Single disk failure can result in loss of all data Better performance than single disk access for large files Good where performance is more important than redundancy
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Page 70

RAID 1Mirrored Volumes

Volume A Volume B

Volume n

Block 1 Block 2 Block 3

Block 1 Block 2 Block 3

SERVER

RAID STORAGE

Data blocks written to both disks at once 100% data redundancy means no data loss If one disk fails, data can be retrieved from mirrored disk Requires two disk write operations per block but only one read Good for small files where security is paramount
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Page 71

RAID 0+1Mirrored Array

Volume A Volume,me B

Volume n

Block 1 Block 3 Block 5

Block 2 Block 4 Block 6

Block 1 Block 3 Block 5

Block 2 Block 4 Block 6

SERVER

RAID STORAGE

Data blocks written to each disk in turn then copied to mirrored array Combines RAID 0 performance with RAID 1 Redundancy If one disk fails, the array becomes a RAID 0 Limited scalability and double the cost
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Page 72

RAID 4Block-Level Striping with Parity Disk

Parity
Volume A Volume B

Volume n

Block A1 Block A2 Block A3

Block B1 Block B2 Block B3

Parity 1 Parity 2 Parity 3

SERVER

RAID STORAGE

Data blocks written sequentially to each disk in the array Similar to RAID 3 but generally performs better because data is accessed in blocks instead of bytes

Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Page 73

RAID 5Striping with Distributed Parity

Volume A Volume,me B

Volume n

Block A1 Block A2 Block A3

Block B1 Block B2 Parity 3

Block C1 Parity 2 Block C3

Parity 1 Block D2 Block D3

SERVER

RAID STORAGE

Data blocks written sequentially to each disk in turn Parity block computed for each row and distributed across all disks If one disk fails, data can be retrieved using parity blocks Parity calculation overhead reduces write performance Good aggregate transfer rate during read
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Page 74

RAID 10Mirrored Striping Array

Volume A Volume,me B

Volume n

Block 1 Block 3 Block 5

Block 1 Block 3 Block 5

Block 2 Block 4 Block 6

Block 2 Block 4 Block 6

SERVER

RAID STORAGE

Data blocks written sequentially to each mirrored disk array Combines RAID 0 performance with RAID 1 redundancy If one disk fails, data can be retrieved from mirrored disk Parity is not calculated so good write performance
Storage for Networking Professionals Copyright 2004 Storage Networking Industry Association. All Rights Reserved.

Page 75