IBM zSystems

IBM z16 Technical Overview

Kenny Stine
IBM zSystems Technical Specialist
Washington System Center
kjstine@us.ibm.com

IBM z16 Technical Overview_1 © 2022 IBM Corporation

 IBM zSystems
Trademarks
The following are trademarks of the International Business Machines Corporation in the United States, other countries, or both.

Not all common law marks used by IBM are listed on this page. Failure of a mark to appear does not mean that IBM does not use the mark nor does it mean that the product is not actively marketed or is not
significant within its relevant market.
Those trademarks followed by ® are registered trademarks of IBM in the United States; all others are trademarks or common law marks of IBM in the United States.

For a more complete list of IBM Trademarks, see https://www.ibm.com/legal/copytrade :

*BladeCenter®, CICS®, DataPower®, Db2®, e business(logo)®, ESCON, eServer, FICON®, IBM®, IBM (logo)®, IMS, MVS, OS/390®, POWER6®, POWER6+,
POWER7®, Power Architecture®, PowerVM®, PureFlex, PureSystems, S/390®, ServerProven®, Sysplex Timer®, System p®, System p5, System x®, z Systems®, System
z9®, System z10®, WebSphere®, X-Architecture®, z13™, z13s™, IBM z14™, IBM z15™, z16 ™, z Systems™, z9®, z10, z/Architecture®, z/OS®, z/VM®, z/VSE®,
zEnterprise®, zSeries®, IBM Z®, IBM LinuxONE III™, IBM LinuxONE Emperor™, IBM LinuxONE Rockhopper™

The following are trademarks or registered trademarks of other companies.

Adobe, the Adobe logo, PostScript, and the PostScript logo are either registered trademarks or trademarks of Adobe Systems Incorporated in the United States, and/or other countries.
Cell Broadband Engine is a trademark of Sony Computer Entertainment, Inc. in the United States, other countries, or both and is used under license therefrom.
Java and all Java-based trademarks are trademarks of Sun Microsystems, Inc. in the United States, other countries, or both.
Microsoft, Windows, Windows NT, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both.
Intel, Intel logo, Intel Inside, Intel Inside logo, Intel Centrino, Intel Centrino logo, Celeron, Intel Xeon, Intel SpeedStep, Itanium, and Pentium are trademarks or registered trademarks of Intel Corporation or its
subsidiaries in the United States and other countries.
UNIX is a registered trademark of The Open Group in the United States and other countries.
Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both.
ITIL is a registered trademark, and a registered community trademark of the Office of Government Commerce, and is registered in the U.S. Patent and Trademark Office.
IT Infrastructure Library is a registered trademark of the Central Computer and Telecommunications Agency, which is now part of the Office of Government Commerce.
* All other products may be trademarks or registered trademarks of their respective companies.
Notes:
Performance is in Internal Throughput Rate (ITR) ratio based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput that any user will experience
will vary depending upon considerations such as the amount of multiprogramming in the user's job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance
can be given that an individual user will achieve throughput improvements equivalent to the performance ratios stated here.
IBM hardware products are manufactured Sync new parts, or new and serviceable used parts. Regardless, our warranty terms apply.
All customer examples cited or described in this presentation are presented as illustrations of the manner in which some customers have used IBM products and the results they may have achieved. Actual
environmental costs and performance characteristics will vary depending on individual customer configurations and conditions.
This publication was produced in the United States. IBM may not offer the products, services or features discussed in this document in other countries, and the information may be subject to change without
notice. Consult your local IBM business contact for information on the product or services available in your area.
All statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only.
Information about non-IBM products is obtained Sync the manufacturers of those products or their published announcements. IBM has not tested those products and cannot confirm the performance,
compatibility, or any other claims related to non-IBM products. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products.
Prices subject to change without notice. Contact your IBM representative or Business Partner for the most current pricing in your geography.

IBM z16 Technical Overview_2 © 2022 IBM Corporation

 IBM zSystems
Table of Content
• IBM z16 Announcement Dates
• IBM z16 Design Principles
• IBM z16 Overview
• IBM z16 Processor Design and Structure
• IBM z16 Memory
• IBM z16 New Features and Functionality
• IBM z16 Capacity on Demand
• IBM z16 I/O Infrastructure
• IBM z16 Coupling
• IBM z16 STP
• IBM z16 Power and Cooling
• IBM z16 Physical Configuration
• IBM z16 HMC
• IBM z16 Site Tools
• IBM z16 Operating Systems
• IBM z16 Statements of Direction

IBM z16 Technical Overview_3 © 2022 IBM Corporation

 IBM zSystems

IBM z16 Announcement Dates

IBM z16 Technical Overview_4 © 2022 IBM Corporation

 IBM zSystems
IBM z16 availability Dates – Driver Level 51
• General Availability – May 31st, 2022
• New features and functions for the IBM z16 (Type number: 3931)
– IBM z16 Model A01:
• Features: Max39, Max82, Max125, Max168, Max200
– IBM z15 air/water-cooled upgrades to IBM z16 (air to air, water to air)
– IBM z14 air/water-cooled upgrades to IBM z16 (air to air, water to air)
– Field installed features and conversions on IBM z15 that are delivered solely
through a modification to the machine's Licensed Internal Code (LIC)
– TKE 10.0 LIC (FC 0882) IBM z16
– TKE HW (new order, w/4770 Cryptographic Adapter):
• Tower: FC 0057
• Rack mount: FC 0058
• TKE FCs 0087 and 0088 TKEs can be carried forward and converted by replacing the
installed Crypto adapter card with a 4770 Crypto adapter card FC 0851.
• TKE FCs 0085 and 0086 TKEs can be carried forward and converted by replacing the
installed Crypto adapter card with a 4770 Crypto adapter card FC 0851.
• If the TKE code level is less than the current level shipping, new TKE code (10.0 TKE LIC)
will be shipped for all TKEs installed.
– System Recovery Boost (Stage 3) enhancements
– Hardware Management Appliance (HMA, FC 0129)

IBM z16 Technical Overview_5 © 2022 IBM Corporation

 IBM zSystems
IBM z16 availability Dates – Driver Level 51
• MES orders cannot be placed until July 1, 2022
– TKE Rack Mount (#0057) on IBM z15
– TKE Tower (#0058) on IBM z15
– TKE 10.0 LIC (#0882) on IBM z15

• BPA Power Orders will ship starting September 13 2022

• IBM z16 to IBM z16 all remaining Loose Piece MES orders - September 30 2022
IBM z16

IBM z16 Technical Overview_6 © 2022 IBM Corporation

 IBM zSystems

Design Principles

IBM z16 Technical Overview_7 © 2022 IBM Corporation

 IBM zSystems

IBM z16 ™ is built to build

We built a powerful and secure platform for business.
Let’s build the future of yours.

Predict and Automate for Secure with a Cyber Modernize with

Increased Decision Velocity Resilient System Hybrid Cloud

IBM z16 Technical Overview_9 © 2022 IBM Corporation

 IBM zSystems

IBM z16 Overview

IBM z16 Technical Overview_10 © 2022 IBM Corporation

 IBM zSystems
IBM z16 with the IBM Telum Processor
IBM z16
Flexible compute design Memory Machine type: 3931
- Available in one to four 19” frames based on - Up to 40TB RAM memory Model A01
capacity needs - 25% more memory capacity per drawer
- Two power options – iPDU for electrical over IBM z15
CPC Max
efficiency and Bulk Power Assembly, no - Transparent memory encryption Client PUs
Drawers Memory
internal Battery Feature - 32TB memory per LPAR, 2x more per LPAR
- Industry’s first quantum-safe system with new than IBM z15 1 39 10 TB
Crypto Express8S card
2 82 20 TB
To the Data
IBM Telum Processor - 54% increase in throughput with new 3 125 30 TB
- 7nm technology, 5.2GHz, 4 Dual Chip FICON Express32S compared to IBM z15
Modules (DCM) per CPC drawer FICON Express 16S 4 168 40 TB
- 8 Cores/Chip, 2 Chips/DCM - 25% improvement in Coupling Facility write
- Up to 200 client configurable cores requests over IBM z15 for short reach 4 (Max) 200 40 TB
- New integrated AI Accelerator capability of coupling express links
processing up to 300B deep learning - Execute up to 14 million encrypted FCP
inference request per day with 1ms latency read IOPS using the IBM Fibre Channel
- 11% single-thread performance improvement Endpoint Security solution
and 17% maximum system capacity growth - Up to 25 billion encrypted z/OS OLTP
over IBM z15™ transactions per day.
- 25% more processor capacity per drawer
over IBM z15

IBM z16 Technical Overview_11 © 2022 IBM Corporation

 IBM zSystems
IBM Z – Processor Roadmap
7 nm
14 nm IBM z16
IBM z15 4/2022
14 nm 9/2019
22 nm IBM z14
7/2017
32 nm
IBM z13
1/2015
IBM zEC12 New cache hierarchy
8/2012 New multi-chip fabric
Focus on power efficiency and On-chip AI accelerator
new on-chip architectures shared by all cores
Pervasive encryption Improved and enlarged
Transparent memory
caches
Low latency I/O for encryption
acceleration of transaction Optimized Out-of-Order
Leadership System Capacity architecture COBOL performance
and Performance processing for DB2 on z/OS
enhancements
Pause-less garbage Binary Floating point
Leadership Single Modularity & Scalability
collection for enterprise scale enhancements Coupling/sysplex
Thread, Enhanced
Throughput Dynamic SMT JAVA applications enhancements
IBM Integrated Accelerator for
Supports two instruction New SIMD instructions zEDC (On-chip compression
Improved out-of-order 25% more processor and
threads support (DEFLATE))
Transactional Memory Optimized pipeline and memory capacity per drawer
SIMD enhanced SMT Enhanced Cryptographic over IBM z15
Dynamic Optimization Coprocessor (CPACF)
PCIe attached accelerators Virtual Flash Memory
2 GB page support
Business Analytics Optimized
Step Function in System
Capacity

IBM z16 Technical Overview_13 © 2022 IBM Corporation

 IBM zSystems
IBM z16 Continues the CMOS Mainframe Heritage
Up to 10% more capacity for equal IBM z16 n-way vs. IBM z15.
Up to 17% max capacity 200-way vs 190-way (IBM z15)
2253*
SMT vs Single Thread ~ 10–40% (average 25%) for both zIIP and IFL. 2055* +10%
1695* 1832*
+8% +12% GHz
1514* +12% GHz
GHz ==%
1202* +26% GHz ==
-9% +4%
920* +33% GHz
+50% GHz +6%
GHz +18%
+159% 5.5 GHz 5.2 GHz
581* 5.2 GHz 5.2 GHz
5.2 GHz 5.0 GHz

GHz / PCI*
4.4 GHz

215,089*
183,267* (+17%)
146,462* +25%
1.7 GHz 111,556* +31%
78,426* +42%
52,286* +50%
31,826* +64%
+72%
2012
2010 2019 2022
zEC12 2015 2017
z196 IBM z15 IBM z16
2005 32 nm SOI z13 IBM z14
2008 14 nm SOI 7 nm SOI
45 nm SOI 101 Cores** 22 nm SOI 14 nm SOI
z9 EC z10 EC 190 Cores** 200 Cores**
80 Cores** OOO and eDRAM 141 Cores** 170 Cores**
90 nm SOI 65 nm SOI OOO core cache improvements Optimized OoO AI Acceleration on CHIP
54 Cores** 64 Cores** eDRAM cache Arch extensions SMT and SIMD Enh. SMT & SIMD
On-Chip Compression Restructured Cache
System level High-freq core RAIM memory for scaling Up to 10TB of Memory Up to 32 TB of
scaling 3-level cache zBX integration Memory Up to 40 TB of Memory Up to 40 TB of Memory
* PCI Tables are NOT adequate for making comparisons of IBM Z processors. Additional capacity planning required
IBM z16 Technical Overview_14 ** Number of PU cores for customer use © 2022 IBM Corporation
 IBM zSystems
IBM z16 Full and Sub-Capacity CP Offerings
CP Capacity – Relative to Full Capacity Uni
701 = 100% ≈ 2,253 PCI
§ Subcapacity CPs, up to 39 may be ordered (317 total capacity levels).
601 ≈ 66% ≈ 1,496 PCI If more CPs are ordered, all must be full 7xx capacity.
501 ≈ 41% ≈ 937 PCI § All CPs on an IBM z16 CPC must be the same capacity (except during Recovery Boost
401 ≈ 12% ≈ 280 PCI periods).
§ All specialty engines are full capacity.
§ zIIP to CP ratio – 2:1 and is the same for CPs of any capacity
(except during System Recovery Boost periods).

7xx

6xx

5xx

4xx

*Capacity and performance ratios are based on measurements and

projections using standard IBM benchmarks in a controlled environment.
Actual throughput that any user will experience will vary depending upon
considerations such as the amount of multiprogramming in the user's job
stream, the I/O configuration, the storage configuration, and the workload.
MSU Sub Capacity

IBM z16 Technical Overview_15 © 2022 IBM Corporation

Max 39 Max 82 Max 125 Max 168 Max 200
 IBM zSystems

IBM z16 Processor Design and Structure

IBM z16 Technical Overview_17 © 2022 IBM Corporation

 IBM zSystems
IBM z16Dual Chip Module
§ 2 Telum chips per DCMs
§ Telum chips connected by highspeed Mbus
§ 2 sets of 700 signals between Telum Chips
§ ~166 GB/s bandwidth in each set

§ Each DCM has:

§ up to 15 active cores
§ up to 16 DDIMMs of memory
§ 3 PCIe Adapter connections A-Bus MC MCU

PBU

PBU
PCIe 1 PCIe 0

NXU
§ Up to 1 SMP Connection (to other CPC

X-Bus
MCD
Drawers)

X-Bus
Core 1 Core3 Core 5 Core 7 Core 6 Core 4 Core 2 Core 0

AIU

X-Bus
§ ~50 GB/s bandwidth between drawers

X-Bus
L2 L2 L2 L2 L2 L2 L2 L2

X-Bus
M-Bus
32MB 32MB 32MB 32MB 32MB 32MB 32MB 32MB

M-Bus
X-Bus

X-FBC

X-FBC
§ 12 Xbus connections

X-Bus
M-Bus

M-Bus
X-Bus
L2 L2 L2 L2

§ 6 per Telum chip to all the other Telum

L2 L2 L2 L2
32MB 32MB 32MB 32MB

X-Bus
32MB 32MB 32MB 32MB

X-Bus
chips in a drawer

X-Bus
AIU
Core 0 Core 2 Core 4 Core 6 Core 7 Core 5 Core3 Core 1

X-Bus

MCD
§ ~35 GB/s Bandwidth per link

NXU
PBU

PBU
PCIe 0 PCIe 1

§ ~120 GB/s bandwidth between DCMs

MCU MC A-Bus

*Speed and performance data based on running at max CP frequency in laboratory test
IBM z16 Technical Overview_19 © 2022 IBM Corporation
 IBM zSystems
8-Core Processor Chip Detail (Telum)
X-Bus X-Bus X-Bus X-Bus X-Bus X-Bus § 8 Telum chips per CPC Drawer in 4 DCMs
PBU
X-FBC NXU § Up to 8 active cores per Telum Chip
L2 L2
§ Up to 200 active cores per system

A-Bus
Core 0 Core 1
32MB 32MB
§ Added Integrated Accelerator for AI
PCIe 0

L2 L2
Core 2 Core3
32MB 32MB
§ On Core L1 Cache
§ Private 128K L1I and 128K L1D

MC
L2 L2
Core 4 Core 5
PCIe 1

32MB 32MB

L2 L2 MCU
§ On Core/Chip L2 Cache
Core 6 Core 7
32MB 32MB
§ Each core has access to a private 32 MB cache
PBU
AIU M-Bus M-Bus MCD § Up to 16MB of each cache can be used by other cores as
virtual cache depending on the current activity
§ L2 cache of an inactive core becomes shared virtual L3
§ 7nm FinFET Technology
cache by the active cores of the chip
– 8 cores per CP § L2 cache of an inactive core of another CP can become
– 18.8 miles of wire virtual L4 cache
– ~ 23mm x 22 mm
– Up to 2 PCIe buses, and 8 DDIMMS § I/O buses
– 22.5B transistors versus 9.2B on z15 § Each CP chip will support up to 2 Gen-5 PCIe buses
IBM z16 Technical Overview_20 © 2022 IBM Corporation
 IBM zSystems
8-Core Processor Chip Design & Improvements
§ General performance enhancements
§ New Cache/TLB Design
§ Branch prediction improvements
§ System Coherency Fabric Manager
§ On-Chip ring among all cores of a CP

§ Merge/Sort Accelerators
§ Introduced with the z15 CD announcement

§ Per-CP chip GZIP compression

§ zEDC replacement (introduced on z15)

§ Per-CP chip Integrated Accelerator for AI NXU – Nest Accelerator Unit

§ New functionality with the IBM z16
Integrated Accelerator for AI
§ In-Line Memory Encryption
§ Enabled by default
§ Encryption keys managed internally
IBM z16 Technical Overview_25 © 2022 IBM Corporation
 IBM zSystems
Integrated AI Accelerator – combining compute & data movers

On Chip AI Accelerator

Aggregate of >6 TFLOPS / chip

– Over 200 TFLOPS on 32-chip system

Compute Arrays
– 128 processor tiles with 8-way FP-16 FMA SIMD
– Optimized for matrix multiplication and convolution
– 32 processor tiles with 8-way FP-16/FP-32 SIMD
– Optimized for activation functions & complex operations

Intelligent Prefetcher and Data Movers

– 200+ GB/s read/store bandwidth from/to cache
– 600+ GB/s bandwidth between engines
– Multi-zone scratchpad for concurrent load, execution and store

IBM z16 Technical Overview_27 © 2022 IBM Corporation

 IBM zSystems
IBM z16 MES Upgrades
z15
IBM z16
§ IBM z16 to IBM z16 upgrades
Max200
−IBM z16 Concurrent upgrade from Max 39 to Max82 to Max125

Factory Only
−Max39, Max82, Max125, and Max168 each adds additional
CPC Drawers
Max168
−Max200 is implemented in 4 drawers
−No MES upgrade to Max168 or Max200
−Additional I/O Drawers
Max125
−Based on available space in current frames and/or I/O

Concurrent Upgrade
expansion frames

Max82 § Any z15 T01 to any IBM z16

§ Conversion from water cooled to radiator cooled
z14
§ Any z14 M01- M05 to any IBM z16
M01-M05 Max39
§ Conversion from water cooled to radiator cooled

IBM z16 Technical Overview_29 © 2022 IBM Corporation

 IBM zSystems

New Features and Functionality

IBM z16 Technical Overview_34 © 2022 IBM Corporation

 IBM zSystems
IBM z16: Predict and automate for increased decision velocity

Prevent fraud before it happens Insights at unprecedented speed Leveraging AI, in operational
by scoring up to 100% of and scale means every customer processes can proactively
transactions in real-time without interaction can now be a identify and stop outages
impacting SLA’s personalized experience before they occur

IBM z16 Technical Overview_35 © 2022 IBM Corporation

 IBM zSystems
Use Cases by Industry

Banking Finance Trading Insurance Other

Examples Examples Examples Examples Examples
• Compliance Testing: account • Enable point-of-sale • High frequency • Real-time fraud detection for • Supply Chain
ID take over payment processing with trading analytics claims and images • Payroll processing
and identity theft fraud detection • Algorithmic trading • Claims adjudication • Manufacturing
• Gaming the system – reward • Financial crimes detection, • Clearing & Settlements • Pricing & actuarial analysis
cards and anti-money laundering (AML) • Scientific research
for better risk assessment
account openings • Computer design
• Wealth management with
• Interest rate forecasting predictive models • Biosecurity
• Loan processing & approval • Mining
• Healthcare

IBM z16 Technical Overview_36 © 2022 IBM Corporation

 IBM zSystems
Seamlessly leverage AI accelerator on IBM z16
• Bring machine learning & deep learning models to IBM z16 with ONNX/DLC
• Exploit IBM Integrated Accelerator for AI for best inference performance.
• Repeatable practice for different vendors to leverage IBM z16 and Integrated Accelerator for AI

Generated
inference program
IBM Deep
Deploy on
Learning IBM z16 and
Compiler IBM LinuxONE

ONNX interchange
format

Build and train model Use ONNX, an opensource tool for The IBM DLC Deploy on IBM z16
in any popular framework interoperability (Deep Learning Compiler), and IBM LinuxONE
framework on any Models are converted optimized for performance and infuse model into
platform of to the ONNX interchange format and new libraries, generates workload application
your choice Leverage zCX and run on a program from the model for
zIIP engines execution on z/OS or Linux®
on IBM z16
IBM z16 Technical Overview_39 © 2022 IBM Corporation
 IBM zSystems
We are entering a new cryptographic era

There will be a time when the power Harvest now, decrypt later
of quantum may crack public key schemes are underway to collect data
now for decryption when quantum
cryptographic security protection … computers are powerful enough

Your data and security is already Replacing most of the

at risk for quantum-attacks public-key systems
currently in use will take 5 to 15 years

Lifetime of data
means that sensitive data generated
today that is not protected with
quantum-safe algorithms is at risk
now

IBM z16 Technical Overview_40 © 2022 IBM Corporation

 IBM zSystems
IBM z16 industry-first quantum-safe system

Quantum-safe technology and key management services were developed to help protect data
and keys against a potential future quantum attack like harvest now, decrypt later

Quantum-Safe System Protect Sensitive Data Create Crypto Inventory

Industry first quantum-safe system New Crypto Express8S HSM with Discover where and what crypto is
protected by quantum-safe quantum-safe APIs to enable you to start used in applications to aid in
technologies through multiple layers now to future proof your applications and developing a crypto inventory for
of firmware. data. migration and modernization
planning.
Helps protect IBM z16 firmware Modernize existing and build new
from quantum attacks through a applications leveraging quantum-safe New crypto discovery features in IBM
built-in dual signature scheme with cryptography along with classical Application Discovery and Delivery
no changes required. cryptography for a dual scheme approach Intelligence (ADDI) to discover crypto
as recommended by NIST. usage in applications. Using ADDI
can improve productivity up to 30%.1

1 See sources in notes

IBM z16 Technical Overview_41 © 2022 IBM Corporation

 IBM zSystems
IBM Flexible Capacity for Cyber Resiliency

Designed to help organizations proactively reduce the impact of downtime by

dynamically shifting their critical workloads to an alternate site for business continuity

Greater Flexibility Complete Client Control Simplified Compliance

Dynamically shift production Remotely transfer capacity – no on-site Simplify business continuity
capacity between z16 systems at personnel required after initial set up. compliance and improve audit
different sites within seconds readiness by using the same
Flexibility over duration of capacity procedures for both for DR testing
Can be used for proactive outage transfer, production can remain at the and real unplanned disasters.
avoidance, business continuity alternate site for up to one year.
compliance, disaster recovery and Automate and test recovery
DR test scenarios. Fully automatable using solutions such as procedures for unplanned outages to
GDPS. provide near-continuous availability
Be confident that production and disaster recovery.
workloads can be seamlessly Integrates with System Recovery Boost for
shifted to an alternate site and still faster system and workload startup
meet production SLAs.

IBM z16 Technical Overview_42 © 2022 IBM Corporation

 IBM zSystems
Business continuity is a key aspect of cyber resiliency

Proactive Outage Disaster Recovery Business Continuity Site Facility

Avoidance and DR Testing Compliance Maintenance
With extreme weather In the event of an Regulation around Site facility and building
events becoming more unplanned outage, business continuity and maintenance is an ongoing
and more frequent, a including cyber attacks, disaster recovery activity for businesses.
proactive approach to the ability to rapidly policies are increasing Upgrading for
delivering continuous restore operations and and becoming environmental, health, and
service is needed. service is paramount. more stringent. safety purposes or other
improvements sometimes
You need to be able to The ability to test that These regulations requires closures.
migrate your critical production workloads mandate that
workloads to an can be shifted and run businesses be able to The ability to continue to
alternate site before at full capacity is critical switch over full provide 24x7 service to
your business gets for ensuring continuous production loads to a your customers is more
impacted. availability during secondary data center important than ever.
unplanned outages is and operate there for
key. extended periods of
time.

IBM z16 Technical Overview_43 © 2022 IBM Corporation

 IBM zSystems

Site A Site B

zIIP Configuration
Configuration zIIP CP: 401
CP: 720 zIIPs: 0
zIIPs: 10
0 ICF: 0
ICF: 4
0 IFL: 0
IFL: 4
0 IFL IFL
ACP: 401 ICF ICF
UzIIP: 10 720 720
UICF: 4
UIFL: 4

710 710

401 401
Flex Record Flex Record
CP: 20 CP: 20
IFL: 4 IFL: 4
ICF: 4 ICF: 4
zIIPS: 10 zIIPS: 10
Capacity indicator: 7 Capacity indicator: 7

IBM z16 Technical Overview_44 © 2022 IBM Corporation

 IBM zSystems
Multi-system environment
Site B
• Multi-system example:
– A1, A2, A3 moved to B1, B2
Site A System B1

• Example shows all capacity from System A1

– A1 and A2 moved to B1 Flex Capacity

Flex Capacity
– A3 moved to B2

• Movement would not necessarily have to be System A2

‘all to one’ – could be split

Flex Capacity
System B2

• RULE: Total capacity active on all systems System A3

Flex Capacity
after swap cannot exceed total capacity
active prior to swap. Flex Capacity

– Sum all active capacities (Base + Flex Capacity) Flex Capacity

– Done for all engine types

– Exceeding the purchased capacity will be charged

• Monitoring to ensure compliance is done

IBM z16 Technical Overview_45 © 2022 IBM Corporation
 IBM zSystems
IBM System Recovery Boost
Over 95% of IBM z15 customers with System Recovery Boost eligible systems, are
using System Recovery Boost to unleash additional processing capacity.1
Introduced with IBM z15 New with IBM z16

Faster shutdown Faster GDPS Faster middleware restart Faster Hyperswap

and startup automation Accelerate the restart and Config Load
Accelerate the shutdown, Drive faster and more recycle of client-specified Accelerate the process of
restart and recovery of efficient GDPS automation middleware environments loading hyperswap
images, middleware actions to rapidly to rapidly return to steady- configuration and policy
environments and client reconfigure and recover state operations up to 35% information and to reduce
workloads to accelerate your environment. faster.3 the system impact while
return to pre-shutdown the load is in progress.
SLAs.2 Faster elimination Faster SVC
of backlog dump processing
Faster sysplex recovery Utilize additional capacity Accelerate the SVC dump
Accelerate Parallel Sysplex for a fixed period during capture process so you
recovery processes to recovery, so you can can gather the diagnostics
minimize disruption and process backlog faster and return to normal
expedite return to steady- after planned or unplanned operations up to 30%
state operations. downtime. faster.4

1,2,3,4 See claims in notes

IBM z16 Technical Overview_47 © 2022 IBM Corporation

 IBM zSystems

Supported I/O Features

IBM z16 Technical Overview_58 © 2022 IBM Corporation

 IBM zSystems
Storage connectivity
New Build Maximum Feature
Description Feature Code ⎼⎼⎼⎼⎼⎼⎼⎼⎼⎼⎼⎼⎼⎼⎼⎼⎼⎼⎼⎼ Ports
Carry Forward Quantity

FICON Express16S+ LX 0427 Carry Forward 2 192

FICON Express16S+ SX 0428 Carry Forward 2 192

FICON Express16SA LX 0436 Carry Forward 2 192
FICON Express16SA SX 0437 Carry Forward 2 192
FICON Express 32S LX 0461 New Build 2 192
FICON Express 32S SX 0462 New Build 2 192

zHyperLink Express 0431 Carry Forward 2 16

zHyperLink Express1.1 0451 New Build / Carry Forward 2 16

IBM z16 Technical Overview_59 © 2022 IBM Corporation

 IBM zSystems
IBM z16-Qualified 3rd Party FICON Switches
Partner FICON Switches Supported Firmware Supported
Broadcom Name IBM Name
X7-8 SAN512B-7
X7-4 SAN256B-7 FOS 9.0.1x
Broadcom/ G720 SAN64B-7
Brocade X6-8 SAN512B-6
X6-4 SAN256B-6 FOS 8.2.3x or FOS 9.0.1x
G620 SAN64B-6
Cisco Name IBM Name
Cisco MDS 9710 SAN384C-6
MDS 9706 SAN192C-6 NX-OS 8.4(2b) or NX-OS 8.4(2c)
MDS 9250i SAN50C-R

Note: for up-to-date hardware support and service dates, please visit the End-of-Life pages for Cisco and Broadcom.

IBM z16 Technical Overview_62 © 2022 IBM Corporation

 IBM zSystems
Network connectivity: OSA

New Build Maximum Feature

Description Feature Code ⎼⎼⎼⎼⎼⎼⎼⎼⎼⎼⎼⎼⎼⎼⎼⎼⎼⎼⎼⎼ Ports
Carry Forward Quantity

OSA Express6S GbE LX 0422 Carry Forward 2 48

OSA Express6S GbE SX 0423 Carry Forward 2 48
OSA Express6S 10GbE LR 0424 Carry Forward 1 48

OSA Express6S 10GbE SR 0425 Carry Forward 1 48

OSA Express6S 1000BASE-T 0426 Carry Forward 2 48
OSA Express7S GbE LX 0442 Carry Forward 2 48
OSA Express7S GbE SX 0443 Carry Forward 2 48
OSA Express7S 10GbE LR 0444 Carry Forward 1 48

OSA Express7S 10GbE SR 0444 Carry Forward 1 48

OSA Express7S 1000BASE-T 0446 Carry Forward 2 48
OSA Express7S 1.1 25GbE SR 0449 Carry Forward 1 48

IBM z16 Technical Overview_66 © 2022 IBM Corporation

 IBM zSystems
Network connectivity: OSA (continued)

New Build Maximum Feature

Description Feature Code ⎼⎼⎼⎼⎼⎼⎼⎼⎼⎼⎼⎼⎼⎼⎼⎼⎼⎼⎼⎼ Ports
Carry Forward Quantity

OSA Express7S 1.2 GbE LX 0454 New Build 2 48

OSA Express7S 1.2 GbE SX 0455 New Build 2 48
OSA Express7S 1.2 10GbE LR 0456 New Build 1 48

OSA Express7S 1.2 10GbE SR 0457 New Build 1 48

OSA Express7S 1.2 1000BASE-T 0458 New Build 2 48
OSA Express7S 1.2 25GbE SR 0459 New Build 1 48
OSA Express7S 1.2 25GbE LR 0460 New Build 1 48

IBM z16 Technical Overview_67 © 2022 IBM Corporation

 IBM zSystems
Network connectivity: RoCE

New Build Maximum Feature

Description Feature Code ⎼⎼⎼⎼⎼⎼⎼⎼⎼⎼⎼⎼⎼⎼⎼⎼⎼⎼⎼⎼ Ports
Carry Forward Quantity

10GbE RoCE Express2 0412 Carry Forward 2 16

10GbE RoCE Express2.1 0432 Carry Forward 2 16
25GbE RoCE Express2 0430 Carry Forward 1 16

25GbE RoCE Express2.1 0450 Carry Forward 1 16

10GbE RoCE Express3 SR 0440 New Build 2 16
10GbE RoCE Express3 LR 0441 New Build 2 16
25GbE RoCE Express3 SR 0452 New Build 2 16
25GbE RoCE Express3 LR 0453 New Build 2 16

IBM z16 Technical Overview_71 © 2022 IBM Corporation

 IBM zSystems
Crypto Express8S
• Two new adapters designed for the IBM z16:
• New cards provide Quantum-Safe Root of Trust
! Feature code 0909 (one HSM)
• Maximum of 16 per A01 ! Designed for 2X performance improvement
! Feature code 0908 (two HSMs) ! Performs AES, DES/TDES, RSA, ECC
• Maximum of 30 per A01 (60 HSMs) SHA-1, SHA-2, & other crypto operations
! Supports new Quantum-Safe Dilithium and
• A mix of adapters can be ordered for new build Kyber algorithms
and carry forward; maximum combined total: 16

• Supports up to 85 domains and 5100

virtual HSMs

Dual-HSM FC 0908

IBM z16 Technical Overview_74 © 2022 IBM Corporation

 IBM zSystems

IBM z16 Coupling

IBM z16 Technical Overview_77 © 2022 IBM Corporation

 IBM zSystems
Coupling connectivity

Feature New Build Maximum Feature

Description ⎼⎼⎼⎼⎼⎼⎼⎼⎼⎼⎼⎼⎼⎼⎼⎼⎼⎼⎼⎼ Ports
Code Carry Forward Quantity

Integrated Coupling Adapter Short Reach (ICA SR) 0172 Carry Forward 2 48
Integrated Coupling Adapter Short Reach 1.1 (ICA 0176 New Build / Carry Forward 2 48
SR1.1)
Coupling Express2 LR 0434 New Build 2 32

IBM z16 Technical Overview_78 © 2022 IBM Corporation

 IBM zSystems
IBM z16 coupling connectivity

IBM z16
No InfiniBand
CF
Coupling Express2 LR

ICA SR 1.1

z15 T01 z15 T02 z14 ZR1 z14

Coupling Express LR Coupling Express LR Coupling Express LR

ICA SR 1.1 ICA SR ICA SR

CF CF CF
IBM z16 Technical Overview_80 © 2022 IBM Corporation
 IBM zSystems

Power and Cooling

IBM z16 Technical Overview_84 © 2022 IBM Corporation

 IBM zSystems
Power options Feature iPDU BPA

• Two power options with the IBM z16: 2, 4, 6, or

Number of line cords 2 or 4
8
! Intelligent Power Distribution Unit
(iPDU) Max. PCIe+ I/O drawers 12 10
! Bulk Power Assembly (BPA)
200-240 VAC (4 wire), 60A Yes Yes
• All cabling routed to back of frame; top and
bottom power and I/O exit available 380-415 VAC (5 wire),
Yes Yes
30/32A
• The IBM z16 is the last system to support
BPA power 480 VAC (5 wire Wye) No Yes
• BPA-powered IBM z16 systems will not be
available to order at GA Phase loss immunity No Yes

• BPA-powered systems running at Internal Battery Feature No No

temperatures above the recommended
range may experience performance throttling Water Cooling Unit No No

• Balanced Power Plan Ahead feature Balanced Power No Yes

eliminates downtime for system upgrades
IBM z16 Technical Overview_85 © 2022 IBM Corporation
 IBM zSystems
Power line cords (rear view)

IBM z16 Technical Overview_86 © 2022 IBM Corporation

 IBM zSystems

IBM z16 (3931-A01)

Physical Planning and Configuration

IBM z16 Technical Overview_89 © 2022 IBM Corporation

 IBM zSystems
Configuration Overview
§ IBM z16 is designed with flexibility built into the configuration
§ System can only come with internal radiator cooling
§ Customer has the option to use Bulk Power Assembly (BPA) or
Power distribution Unit (iPDU) based power for operation.
(configuration dependent)
§ SOD Fulfilled: IBF feature not available on IBM z16.
§ SOD Issued: This is the last system to support BPA power

§ Up to four frames possible depending on the amount of CP and

I/O cards ordered
§ Allowing up to a max of 4 CPC drawers and 12 I/O drawers
§ By default, systems reserve space for up to 2 additional
CPC drawers in the A Frame Reserve CPC FCs: 2981/2982
§ Clients may not be able to add additional CPC
drawers if they override plan ahead features.
IBM z16 Technical Overview_90 © 2022 IBM Corporation
 IBM zSystems
IBM z16 Configuration: PDU based single frame Rear View

Max 39 Max 82 Max 125

• 2 line cords required • 4 line cords required • 4 line cords required
• Up to 39 CPs • Up to 82 CPs • Up to 125 CPs
• Up to 3 I/O Drawers • Up to 2 I/O Drawers • 1 I/O Drawers (16 I/O
(48 I/O Cards) (32 I/O Cards) Cards)
without CPC Reserve without CPC • Default A-Frame
FCs 2981 and 2982 Reserve FC 2982 configuration with
CPC Reserve FCs
2981 and/or 2982

IBM z16 Technical Overview_91 © 2022 IBM Corporation

 IBM zSystems
IBM z16 Configuration: PDU based I/O Expansion Rear View

Max 39/82/125
• 4 line cords required
• From 39 to 125 CPs
• 2-7 I/O Drawers (112 I/O
Cards Max)

Max 82/125
• 6 line cords required
• Up to 125 CPs
• 7-12 I/O Drawers (192 I/O
Cards Max)

Max39 can only plug

6 I/O drawers

IBM z16 Technical Overview_92 © 2022 IBM Corporation

 IBM zSystems
IBM z16 Configuration: PDU based CP Expansion Rear View

Max 168/200
• 6 line cords required
• 168 or 200 CPs (Factory Build Only)
• 1-4 I/O Drawers (64 I/O Cards Max)

IBM z16 Technical Overview_93 © 2022 IBM Corporation

 IBM zSystems
IBM z16 Configuration: PDU base I/O and CP Expansion

Max 168/200
• 4 frame expansion
• 8 line cords required Max 168/200
• 168-200 CPs • 3 Frame Expansion
(Factory Build Only) • 6 line cords required
• 9-12 I/O Drawers • 168-200 CPs
(192 I/O Cards Max) (Factory Build Only)
• 4-9 I/O Drawers
(144 I/O Cards Max)

IBM z16 Technical Overview_94 © 2022 IBM Corporation

 IBM zSystems
Cabling Design and Management
§ I/O Cable Management
§ Clients should plan for extra slack in I/O cables for the IBM z16

§ Upgrades from the z15

§ Some cables may move due to new I/O drawer placement

§ Upgrades from the z14

§ All cables will move to the rear of the system
§ Cables may move to different frame locations

Note: No Fibre Trunking Service (FTS)

Contact approved trunking vendors

IBM z16 Technical Overview_104 © 2022 IBM Corporation

 IBM zSystems
Power and I/O cabling management
• Three top & bottom exit feature codes available
to support power and I/O cabling:

• FC 7898 – Top Exit Cabling with Top Hat • FC 7899 – Bottom Exit Cabling
– Includes additional “Top Hat” hardware for strain ! Must be ordered to allow cabling or power in and out
relief, cable organization, or flat sealing surface if of the bottom of the frame for raised floor installation
required for hot/cold data center aisle containment ! Can be used with Fiber Quick Connect brackets at
– Must be ordered when planning to use Fiber Quick bottom of the frame
Connect brackets egressing out the top of the system ! If not ordered, bottom seal plate will ship with system
and I/O and power cabling cannot exit bottom of frame

• FC 7816 – Top Exit Cabling without Top Hat • FC 5827 – Fiber Quick Connect
– Ordered for clients intending to egress cables out of ! Optional feature provides brackets at top and/or bottom
the top of system without Top Hat hardware of system for cable organization and structured cabling
– Does not support Fiber Quick Connect Brackets on ! Does not ship trunking cables; clients will have to work
top of frame with third-party providers to acquire and install cables

IBM z16 Technical Overview_108 © 2022 IBM Corporation

 IBM zSystems
Cabling feature code combinations

Customer Bottom Exit Top Exit Cabling Feature Codes Additional Comments
Environment Cabling to be Ordered
Raised Floor Yes No 7899 only Bottom FQC support only
Raised Floor Yes Yes, no Top Hat 7899 & 7816 Bottom FQC support only
Raised Floor Yes Yes, with Top Hat 7899 & 7898 Top & bottom FQC support
Raised Floor No Yes, no Top Hat 7816 only No FQC support;
ships bottom seal plate
Raised Floor No Yes, with Top Hat 7898 only Top FQC support only;
ships bottom seal plate
Non-Raised Floor No (not supported) Yes, no Top Hat 7998 & 7816 No FQC support;
ships bottom seal plate
Non-Raised Floor No (not supported) Yes, with Top Hat 7998 & 7898 Top FQC support only;
ships bottom seal plate

IBM z16 Technical Overview_109 © 2022 IBM Corporation

 IBM zSystems

IBM z16
HMC/SE

IBM z16 Technical Overview_110 © 2022 IBM Corporation

 IBM zSystems
HMC/SE Changes
§ Not offered with IBM z16 2.16.0 § IBM Z Certificate
§ Stand alone HMCs § HMC task will by default set expiration of system
§ Carry forward of old standalone HMCs certificates to 398 days
Allowed § Users will need to refresh these certificates if used
§ TLS 1.0 and 1.1 § HMC will post hardware messages warning when
§ UserIDs: ADVANCED, OPERATOR, it will expire
STORAGEADMIN, and SYSPROG
§ TLS 1.3 support added
§ Default UserIDs § Clients will be able to use 1.2 or 1.3
§ Reducing the number of IDs to ACSADMIN and
SERVICE § Multi-Factor Authentication support
§ Requiring that all the IDs to have unique § Added support for z/VM and Linux on Z
password at installation.
§ Channel Pending state
§ HMC Logon Enhancements for PCI-DSS § New functionality will configure selected adapters
off then on, one at a time.
§ STP n-Mode power imminent disruption § As long as adapters are defined redundantly to a
signal/fail over option. LPAR this can execute without LPAR interruption
§ New option to configure for n-mode power PTS
(Primary Time Server) to BTS (Backup Time § Report a Problem
Server) failover § Individual LPAR targets can be used for task
IBM z16 Technical Overview_111 © 2022 IBM Corporation
 IBM zSystems
Hardware Management Appliance (HMA)
§ The HMC code runs as an appliance on two
high performance top of rack servers. One z15 z15 z14 z14 IBM
HMA feature code provides two HMAs. z16

§ Logon to HMC remotely from your browser. SE HMA SE SE HMA HMC/SE

§ Logon to Support Element from the HMC. SE HMA SE SE HMA HMC/SE

§ FC0129 (new feature code)

Switch Switch HMC’s are peers and
§ Optional feature code
support data replication.
§ No external HMCs unless carried forward SE’s are primary/alt
§ Last machine to support carry forward HMC
§ One HMA feature code provides two HMAs
§ New MES available for HMA

Add V2.16.0 code to existing HMCs.

No charge.
Obtain from the SSR at GA.

IBM z16 Technical Overview_112 © 2022 IBM Corporation

 IBM zSystems

IBM z16
Operating Systems

Core WAS

Core ERP WAS Native Linux

Secure
Java Appliances Linux and consolidation:
Appl Efficiency and reliability
Java Test Dev
CICS C++
Appl DB2
DB2 DB2 Java
IMS JVM Linux on z Linux on z
SSC
Systems Systems
JVM
z/OS z/OS z/OS Linux on z Linux on z
Systems Systems
z/OS z/VM z/VM KVM* for IBM z

PR/SM
Virtualized I/O

CP 1 CP n zIIPn IFL 1 IFL n

IBM z16 Technical Overview_117 © 2022 IBM Corporation

 IBM zSystems
IBM z16 operating system support

z/OS Linux on IBM Z

• z/OS 2.5 with PTFs Minimum Distributions:
• z/OS 2.4 with PTFs •SUSE SLES 15 SP3
• z/OS 2.3 with PTFs •SUSE SLES 12 SP5
• z/OS 2.2 (compatibility only) •Red Hat RHEL 8.4
–IBM Software Support •Red Hat RHEL 7.9
Services purchase •Canonical Ubuntu 20.04.0x LTS

z/VM
•z/VM 7.2 with PTFs IBM cannot legally discuss
•z/VM 7.1 with PTFs IBM z16 exploitation prior
to GA from distributors.

Officially Tested list here.

z/VSE
•z/VSE 6.2
z/TPF
•z/TPF 1.1 with PTFs

IBM z16 Technical Overview_118 © 2022 IBM Corporation

 IBM zSystems

#_Statements of Direction

IBM's statements regarding its plans, directions, and intent are subject to change or
withdrawal without notice at IBM's sole discretion. Information regarding potential future
products is intended to outline our general product direction and it should not be relied on
in making a purchasing decision. The information mentioned regarding potential future
products is not a commitment, promise, or legal obligation to deliver any material, code, or
functionality. Information about potential future products may not be incorporated into any
contract. The development, release, and timing of any future features or functionality
described for our products remain at our sole discretion.

IBM z16 Technical Overview_123 © 2022 IBM Corporation

 IBM zSystems
Statements of General Direction
• Removal of support for OSE CHPID type: IBM z16 will be the last IBM Z server to support OSE
networking channels. IBM Z support for the Systems Network Architecture (SNA) protocol being
transported natively out of the server using OSA-Express 1000BASE-T adapters configured as
channel type OSE will be eliminated after IBM z16. Client applications that rely on the SNA
protocol and use OSE networking channels as the transport, as opposed to FICON CTC, must
either migrate to TCP/IP, or the networking configuration of the operating system image must be
updated to make use of some form of SNA over IP technology, where possible, such as z/OS
Enterprise Extender.

• Removal of support for OSA-Express 1000BASE-T hardware adapters: IBM z16 will be the
last IBM Z server to support OSA Express 1000BASE-T hardware adapters (FC 0426, FC 0446,
and FC 0458). Definition of all valid OSA CHPID types will be allowed only on OSA-Express GbE
adapters, and potentially higher bandwidth fiber Ethernet adapters, on future servers.

IBM z16 Technical Overview_124 © 2022 IBM Corporation

 IBM zSystems
Statements of General Direction
• Removal of support for Linux on IBM Z direct access of the OSA-Express family of Ethernet
adapters: In the future, IBM plans to shift from OSA-Express to PCIe-based networking devices
like RoCE Express as the target strategic adapter type for IBM Z direct access networking
connection to Linux operating systems. MES updates between generations are planned to be
supported. Linux on IBM Z clients that indirectly access the OSA-Express adapter family through
the z/VM Virtual Switch (VSwitch) will be unaffected by this change. Linux on IBM Z networking
currently supports two Ethernet networking connectivity options: the OSA-Express adapter family
and the RoCE Express adapter family. Use of PCIe-based networking devices as provided by the
RoCE Express adapter family is aligned with the deployment model for Linux on other architectural
platforms, facilitates use of broader existing Linux ecosystem tooling, and eases the effort to
enable exploitation of industry hardware optimizations and integrate into industry software-defined
networking models and tools, including Red Hat OpenShift Container Platform (OCP). Clients are
strongly encouraged to plan accordingly for their adoption of RoCE Express adapters for IBM Z
networking connectivity. IBM plans to continue to work toward common networking adapters for all
operating systems on IBM Z, IBM LinuxONE, and Linux on IBM Z.

IBM z16 Technical Overview_125 © 2022 IBM Corporation

 IBM zSystems
Statements of General Direction
• Capacity on Demand (CoD) legacy automation: IBM z16 is planned to be the last server family
to support Legacy CoD unique/record type automation interfaces. Clients should begin migrating
to the new CoD flexible record structure interface. Prior to the IBM z10, automation interfaces for
CoD were unique for each record type. The IBM z10 introduced new automation interfaces for
CoD, which used flexible record structures that could apply to any CoD temporary record, and
attributes of temporary capacity records are returned as an XML structure.

• Firmware update process: IBM z16 is planned to be the last server family to support IBM service
support representatives (SSRs) on-site performing firmware updates without an additional
premium service contract. The IBM Z Remote Code Load (RCL) option, which was introduced on
the IBM z15, is available without an additional premium service contract. With the IBM z15, and
now with IBM z16, clients can request an RCL or they can choose the SSR onsite method for their
firmware update. IBM recommends clients to try the RCL option on the IBM z15 or IBM z16 to see
that IBM provides the same quality service through RCL.

IBM z16 Technical Overview_126 © 2022 IBM Corporation

 IBM zSystems
Statements of General Direction
• Removal of support of the transactional execution and constrained transactional
execution facility: In a future IBM Z hardware system family, the transactional execution and
constrained transactional execution facility will no longer be supported. Users of the facility on
current servers should always check the facility indications before use.

• z/OS Containers and Kubernetes orchestration support for IBM z/OS applications and
workloads: IBM has previously announced the intention to provide clients with capabilities that will
help accelerate their transformation to greater portability and agility in a hybrid cloud environment
by delivering z/OS Containers and Kubernetes orchestration support for IBM z/OS applications
and workloads. To deliver on this capability, IBM intends to provide a beta program for z/OS 2.5
clients to begin their container journey with z/OS UNIX applications. These capabilities are
designed to support architecture-independent standards and new containerized deployment
options. The intention is to empower agile development teams to incorporate z/OS applications
into a Kubernetes-based orchestration model utilizing industry standard operations. Future z/OS
container use cases are planned to promote application modernization, new application
development, and API creation with tight integration to core z/OS applications.

IBM z16 Technical Overview_127 © 2022 IBM Corporation

 IBM zSystems
Statements of General Direction
• Removal of support for Bulk Power Assembly (BPA): IBM z16 is planned to be the last
generation of IBM Z server to support BPA.

• IBM LinuxONE Next release: In addition to the Linux on IBM Z functionality described in
this RFA, which will be available on IBM z16, IBM plans to announce and release a new
generation of LinuxONE systems in the second half of 2022, designed to help enterprises
in their hybrid cloud and AI journey.

IBM z16 Technical Overview_128 © 2022 IBM Corporation

 IBM zSystems

IBM z16 Technical Overview_129 © 2022 IBM Corporation