Validation Test Plan

ACME Media
Virtualization Project

Created by
Jason Grierson Cisco Inc. - Canada
Shady Ali ElMalatawey VAS Integrated Solutions (VIS) - EMC2 Distributor - Egypt

Date: 15th May 2015

Validation Test Plan

Document Version Log

Version Date Author Description
Version 1.0 st
May 1 2015 Jason Grierson Starting on Validation Test Plan
Shady Ali
Version 1.5 May 10 th 2015 Jason Grierson Revision and minor changes
Shady Ali
Version 2.0 May 15 th 2015 Jason Grierson Final Version
Shady Ali

2|P a g e
Validation Test Plan

Document Contacts
Name Role Cell Phone Email
Jason Grierson Design Architect +1-204-894-7055 jgrierso@cisco.com
Shady Ali ElMalatawey Design Architect +20-100-6541141 shady.ali@vas-eg.com

3|P a g e
 Validation Test Plan

Contents
Document Version Log.......................................................................................................................................................... 2
Document Contacts............................................................................................................................................................... 3
Contents ................................................................................................................................................................................ 4
List of Tables.......................................................................................................................................................................... 5
Document Overview ............................................................................................................................................................. 6
Success Criteria ..................................................................................................................................................................... 7
Validation Tests..................................................................................................................................................................... 8
Supplemental Resources and Documents ........................................................................................................................11
Main VMware Documentation ......................................................................................................................................11
VMware KB Articles ........................................................................................................................................................11
3 rd Party Resources.........................................................................................................................................................11

4|P a g e
 Validation Test Plan

List of Tables
Table 1. Success Criteria for Validation Tests ..................................................................................................................... 7
Table 2. Validation Tests ....................................................................................................................................................10

5|P a g e
 Validation Test Plan

Document Overview
This document serves as a guideline of testing procedures to validate the implemented design, specified in the
ACME Project Architecture Design Document, and verify that this design will successfully satisfy customer’s
requirements and business goals. These procedures are based on customer’s requirements and constraints
specified in ACME Project Architecture Design Document.

This document assumes that users of this document will be familiar with VMware vSphere concepts and
technology as well as accompanying design documents.

6|P a g e
 Validation Test Plan

Success Criteria
No. Description Measurement
1. Users roles are successfully implemented Yes/No
2. Users permissions granted on vSphere Inventory object segregate tasks Yes/No
and duties as required by the customer
3. New Servers/VMs deployment is much easier using Templates Yes/No
4. New Servers/VMs deployment is much faster using Templates Yes/No
5. VMs deployed using Templates are deployed with correct settings Yes/No
6. Tier 1 Cluster can survive two nodes failure Yes/No
Nodes Utilization recorded
on remaining nodes under
85-93%
7. Tier 1 VMs (Exchange CAS, Exchange MBX or SQL Servers) can be fully Yes/No
operational in 3-4 minutes After being restarted by vSphere HA
8. Tier 2, Tier 3 and Management Cluster can survive single node failure Yes/No
Nodes Utilization recorded
on remaining nodes under
75-80%
9. Configured HA Restart Priorities are applied successfully Yes/No
Application services are
restarted successfully in
correct order
10. DMZ Web Farm VMs can’t communicate with Production VMs Yes/No
11. DMZ Web Farm VMs can communicate with each other only Yes/No
12. Production VMs can communicate with each other Yes/No
13. Exchange DAG Failover is working successfully with no downtime Yes/No
14. SQL Mirror Automatic Failover is working successfully with no downtime yes/No
15. Converted Servers can perform all business operations without Yes/No
performance issues
16. Virtualized AD Domain Controller supports current load of 4500 users Yes/No
DC VM CPU/ Memory
Utilization recorded under
80-85%
17. Virtualized Exchange Mailbox 2013 supports current load of 900 users Yes/No
MBX VM CPU/ Memory
Utilization recorded under
85-90%
18. Virtualized SQL Mirror VMs support current load of 900 Users Yes/No
MBX VM CPU/ Memory
Utilization recorded under
95%
19. vMotion Traffic is only on Side-B Fabric during normal operations Yes/No
20. vMotion Traffic is only limited to 8Gb/s during normal operations Yes/No
Table 1. Success Criteria for Validation Tests

7|P a g e
Validation Test Plan

Validation Tests
Test No. Test Description Test Tasks Summary Expected Results
Usability Tests
VAL-UT01 Confirm that created - Test a sample of AD users - All users will log in successfully
Roles on vCenter is assigned to different roles, and log into vCenter.
configured correctly in with each on vSphere Web - Each user will have certain
and will satisfy Client. privileges that satisfy his role.
customer’s need of - Try different actions using each - Segregation is implemented
segregation of duties user to confirm correct between different teams: Tier 1,
between different permissions and privileges of each Tier 2, Tier 3 and Management Tier
teams role.
VAL-UT02 Verify that Syslog - Using any SSH Client, connect on Logs will be collected successfully
Collector is collecting some ESXi Hosts Shell and force with the custom message in them.
log successfully them to send a custom message in
its logs.
- Check Syslog Collector Server to
see if logs contain the custom
message.
Refer to VMware KB Article.
Refer to Risk Analysis &
Management Document - Risk
RS25
Reliability Tests
VAL-RT01 Verify that Tier 1 Simulate two hosts failure, by - All failed VMs will be restarted on
Cluster can withstand shutting down two random hosts other hosts.
two hosts failure with on Tier 1 Cluster, using UCS - Each ESXi Host will have single
max. utilization of 85- Manager Console Exchange MBX, single Exchange
90% per remaining Refer to Risk Analysis & CAS, single SAXXO App VM, single
hosts Management Document - Risk Active SQL Instance and other
RS75 Mirror Instance (not same mirror
pair).
- Utilization per host will be within
85-90% level.
VAL-RT02 Verify that During test (VAL-RT01), two In worst case scenario, within 3-4
Exchange/SQL successive nodes fail in Tier 1 minutes system will be 100%
Systems down time is Cluster. In worst case scenario, operational again.
less than 3-4 minutes failure of two nodes will cause two There’s a high probability of no
during test (VAL-RT01) DAG members to be restarted and downtime for SQL or Exchange.
both SQL members of same mirror
configuration to be restarted.
Exchange system can handle single
node failure as well as SQL Mirror.
vSphere HA will restart all failed
nodes which will be fully
operational (all services started)
within 3-4 minutes.

8|P a g e
Validation Test Plan

VAL-RT03 Verify that Tier 2, Tier Simulate single host failure, by - All failed VMs will be restarted on
3 and Management shutting down single random other hosts.
Clusters can withstand hosts on Tier 2, Tier3 or - Utilization per host will be within
single host failure with Management Cluster, using UCS 85-90% level.
max. utilization of 75- Manager Console
85% per remaining
hosts
VAL-RT04 Verify that VMs During tests (VAL-RT01) and (VAL- - All restarted VMs will be restarted
restart priorities RT03), verify that HA restart the as configured in restart priority
configured are applied VMs according to their restart - Each Application will have its
during HA restart priority configured. services started successfully in
Refer to Risk Analysis & correct order
Management Document - Risk
RS10, RS15 and RS17
VAL-RT05 Verify that DMZ VMs - On any of DMZ VMs, try to - DMZ Web Farm VMs can’t ping
can’t communicate continuously ping another VM in any other VM in any other Tier,
with anything but Tier 1, Tier 2 or Tier 3 (except AD except AD Domain Controllers
each other Domain Controller) - DMZ Web Farm VMs can only ping
- In another windows, try to each other
continuously ping another DMZ
VM
Refer to Risk Analysis &
Management Document - Risk
RS66
VAL-RT06 Verify connectivity - ON sample of VMs, try to - All VMs in Tier 1, Tier 2 or Tier 3
between all continuously ping other VMs in can contact and ping each other
Production VMs, different Tiers successfully
specially Tiered - On same sample VMs, try to - DMZ VMs can’t be contacted by
Enterprise Application continuously ping couple of DMZ other VMs
VMs VMs
VAL-RT07 Verify Exchange DAG Force Power of single Exchange Mailbox DBs will failover to another
Automatic Failover MBX VM using VM console DAG member with no downtime for
users
VAL-RT08 Verify SQL Mirror Force Power of primary SQL 2014 Mirror Instance will take over
Automatic Failover Instance VM using VM console primary role with no downtime to
users
Performance Tests
VAL-PT01 Confirm that - Test converted servers in normal No performance degradation after
converted Servers are business days on all business conversion from physical to virtual
performing as old operations.
physical servers - Monitor converted servers’
performance and their utilization
of resources.
Refer to Risk Analysis &
Management Document - Risk
RS74
VAL-PT02 Verify that new - Monitor Domain Controller - Virtualized Domain Controller will
virtualized AD Domain performance, using PerfMon tool have no performance issues.
Controllers 2012 in Windows. - The collected sample will show
support current users - During business rush hours, fast login times.
(4500 users) monitor login times of sample of
users.

9|P a g e
 Validation Test Plan

VAL-PT03 Verify that new - After installing Exchange 2013 - Virtualized Mailbox VM will have
created Exchange Application and migrating 900 no performance issues.
MBX VMs can support Users to this VM, - Collected sample will show fast
user load of 900 each monitor its performance. and reliable email service
- During business rush hours,
monitor email system
performance for sample of users.
VAL-PT04 Verify that new - After installing SQL 2014 Mirror - Virtualized SQL Mirror VMs will
created SQL 2014 and configuring Enterprise have no performance issues.
Mirror can support Application to use new Mirror, - Collected sample will show fast
users load monitor SQL Mirror VMs and highly-responsive performance.
performance.
- During business rush hours,
monitor Enterprise Application
performance for sample of users
out of 900 users using this Mirror.
VAL-PT05 Confirm that vMotion - Using vSphere Web Client, vMotion process will not be
is on Side-B only disable Network Failover on initiated due to network failure.
during normal times vMotion port group on certain
Distributed Switch.
- Disconnect all Uplinks on Side-B
from FEX Module to FI on a
chassis.
- Try to migrate a VM from a host,
connected to changed vMotion
port group on the disconnected
chassis, using vMotion.
VAL-PT06 Confirm that vMotion - Using vSphere Web Client, vMotion process(es) bandwidth will
Rate is as configured initiate simultaneous four vMotion be limited to just 8 Gb/s per each
on UCSM (8Gb/s) processes. host.
- Using Performance Charts,
monitor network usage on the
Uplink dedicated for vMotion.
Table 2. Validation Tests

10 | P a g e
Validation Test Plan

Supplemental Resources and Documents

Main VMware Documentation
- Configuration Maximums: VMware vSphere 5.5
- VMware Compatibility Guide
- VMware Product Interoperability Matrixes
- vSphere Installation and Setup
- vSphere Upgrade
- vCenter Server and Host Management
- vSphere Virtual Machine Administration
- vSphere Networking
- vSphere Storage
- vSphere Security
- vSphere Resource Management
- vSphere Availability
- vSphere Monitoring and Performance
- vSphere Troubleshooting
- vSphere Getting-started Command Line Guide
- Installing and Administering VMware vSphere Update Manager
- VMware Converter 5.5.3 User Guide

VMware KB Articles
- Creating a persistent scratch location for ESXi 4.x/5.x/6.0
- Enabling EVC on a cluster when vCenter Server is running in a virtual machine
- Configure ESXi Host to use ESXi Dump Collector
- Migrate VMKernel Adapters from vSphere Standard Switch to a vSphere Distributed Switch
- Disabling Time Synchronization
- Best practices for using and troubleshooting VMware Converter

3rd Party Resources

- Installing SQL Server 2014 Step by Step Tutorial
- Create a Database
- Create a SQL Server Login (User)
- SQL Server 2014 Documentation
- UCS Manager Documentation
- Cisco UCS B200 M4 Blade Specification Sheet
- EMC2 VNX Arrays Documentation Center
- EMC2 VNX Arrays Gen2 Specifications
- EMC2 VNX Arrays Gen2 Best Practices
- EMC2 VNX Arrays Gen2 Best Practices with VMware vSphere
- EMC Arrays Storage Systems Fundamentals for Availability and Performance
- Backup Exec 2014 Compatibility Matrix
- Backup Exec 2014 Administration Guide

11 | P a g e