SlideShare a Scribd company logo
Red Hat on System z
Performance Considerations
Updated 27-JAN-2009
Agenda & IntroductionAgenda & Introduction
● Networking
● Storage
● Memory Management
Much of this presentation is a collection of IBM
reports, SHARE presentations, and Red Hat data.
This presentation puts it in one place.
Agenda & IntroductionAgenda & Introduction
Shawn Wells <swells@redhat.com>
Global System z Alliance Manager
(+1) 443 534 0130
● Based in Washington, D.C.
● Global responsibility for Red Hat's System z activities
Who's seen this before?Who's seen this before?
Network PerformanceNetwork Performance
ConsiderationsConsiderations
The EnvironmentThe Environment
● HiperSockers
– Four Linux LPARs (2 IFLs ea.) to one z/OS Server
LPAR (4 & 8 Cps)
– z/OS V1R2
– TCP buffer sizes increased from 65335B to
131071B, allowing for more unacknowledged data
– L3 traffic only
– IPv4, z990, Large Send (requires OSA, card-to-card,
and IPv4)
The EnvironmentThe Environment
● Throughput & Response time charts
– Transactions per second for interactive workloads in
milliseconds
– Megabytes per second for streams-type workloads
● 1MB = 1,048,576 bytes/sec
● Throughput & CPU-Milliseconds Charts
– # of milliseconds of processing per transaction
– Streams-type workloads, # milliseconds of
processing per megabyte
The EnvironmentThe Environment
WORKLOAD DESCRIPTION
cra CRR 200B/15000B (A 200-byte Request-message from the client to the
server followed by a 15000-byte Response-message from the server to
the client. A TCP-connection is established for each RR.)
rra RR 200B/1000B (A 200-byte Request-message from the client to the
server followed by a 1000-byte Response-message from the server to the
client. All RRs operate under that same TCP-connection.)
rrb RR 200B/15000B
rr1 RR 1B/1B
rr64k RR 64KB/64KB
sor Streams Outbound (20B from the client to the server, followed by 20MB
from the server to the client)
sir Streams Inbound (20MB/20B)
mix Mixe of sor and sir streams
OSA Response TimeOSA Response Time
200 byte request, 15000 byte response, same tcp session200 byte request, 15000 byte response, same tcp session
OSA Response TimeOSA Response Time
Transactions per Second vs CPU TimeTransactions per Second vs CPU Time
OSA Response TimeOSA Response Time
OSA Response TimeOSA Response Time
Streaming Data @ 57344B/secStreaming Data @ 57344B/sec
OSA Response TimeOSA Response Time
Streaming Data @ 57344B/secStreaming Data @ 57344B/sec
Storage PerformanceStorage Performance
ConsiderationsConsiderations
The EnvironmentThe Environment
● Configuration for 4Gbps disk I/O measurements
Disk I/O Performance with 4Gbps links –Disk I/O Performance with 4Gbps links –
FICON vs FCPFICON vs FCP
● Throughput for sequential write is simular
● FCP throughput for random I/O is 40% higher
Disk I/O Performance with 4Gbps links –Disk I/O Performance with 4Gbps links –
FICON vs FCP / direct I/OFICON vs FCP / direct I/O
● Bypassing RHEL page cache improves throughput for FCP by 2x,
FICON up to 1.6x
● Read operations much faster on FCP
FCP/SCSI single path vs multipath LVMFCP/SCSI single path vs multipath LVM
● Use failover instead of multibus
StripingStriping
● Results with SCSI disks
– LVM striped logical volumes are fast, but LVM takes
up % more CPU
● Results with ECKD disks
– Fairly the same outcome as with SCSI disks.
Performance differences with storage pool striping
were small
– The load balancing over a FICON path group
performs better than dm-multipath (RHEL
multipathing)
Crypto PerformanceCrypto Performance
ConsiderationsConsiderations
Crypto Express2 Accelerator (CEX2A)Crypto Express2 Accelerator (CEX2A)
SSL handshakesSSL handshakes
● The number of handshakes is up to 4x higher with h/w assist
● In 32 connections case, we save 50% of CPU
Crypto Performance – WebSEAL SSLCrypto Performance – WebSEAL SSL
AccessAccess
● Improvement by h/w support
Memory ManagementMemory Management
Performance ConsiderationsPerformance Considerations
CMM1 & CMMACMM1 & CMMA
● Cooperative Memory Management (CMM1)
– Ballooning technique
– When z/VM detects memory constraints, it tells
RHEL guests to release page frames (done by
issuing a DIAG X'10')
– When memory is freed, it alerts requesting RHEL
guest
CMM1 & CMMACMM1 & CMMA
● Collaborative Memory Management Assist
(CMMA)
– Page status technique
● Stable (S)
page has essential content
● Unused (U)
no useful content and any access to the page will
cause an addressing exception
● Volatile (V
page has useful content. CP can discard the page
anytime.
CMM & CMMA PerformanceCMM & CMMA Performance
CMM & CMMA PerformanceCMM & CMMA Performance
Open Discussion / Q&AOpen Discussion / Q&A

More Related Content

PDF
2008-10-14 Red Hat Update for IBM System z
PPTX
Disaggregation a Primer: Optimizing design for Edge Cloud & Bare Metal applic...
PDF
ă‚œăƒ•ăƒˆă‚Šă‚§ă‚ąă§ăźăƒ‘ă‚±ăƒƒăƒˆć‡Šç†ă‚ă‚Œă“ă‚Œă€œäœ•æ•…æˆ‘ă€…ăŻăƒ­ăƒŒăƒ‰ăƒăƒ©ăƒłă‚”ă‚’è‡Șäœœă™ă‚‹ă«è‡łăŁăŸăźă‹ă€œ
PDF
OSă‚€ăƒłă‚čăƒˆăƒŒăƒ©ăƒŒăźè‡Ș䜜æ–čæł•
PPT
Title Subtitle
PDF
Munich 2016 - Z011601 Martin Packer - Parallel Sysplex Performance Topics topics
PDF
Rdma presentation-kisti-v2
PDF
Unifying Network Filtering Rules for the Linux Kernel with eBPF
2008-10-14 Red Hat Update for IBM System z
Disaggregation a Primer: Optimizing design for Edge Cloud & Bare Metal applic...
ă‚œăƒ•ăƒˆă‚Šă‚§ă‚ąă§ăźăƒ‘ă‚±ăƒƒăƒˆć‡Šç†ă‚ă‚Œă“ă‚Œă€œäœ•æ•…æˆ‘ă€…ăŻăƒ­ăƒŒăƒ‰ăƒăƒ©ăƒłă‚”ă‚’è‡Șäœœă™ă‚‹ă«è‡łăŁăŸăźă‹ă€œ
OSă‚€ăƒłă‚čăƒˆăƒŒăƒ©ăƒŒăźè‡Ș䜜æ–čæł•
Title Subtitle
Munich 2016 - Z011601 Martin Packer - Parallel Sysplex Performance Topics topics
Rdma presentation-kisti-v2
Unifying Network Filtering Rules for the Linux Kernel with eBPF

What's hot (18)

PDF
LF_DPDK17_mediated devices: better userland IO
PDF
FD.io - The Universal Dataplane
PPT
Oracle RAC Presentation at Oracle Open World
PDF
Generic Resource Manager - LĂĄszlĂł Vadkerti, AndrĂĄs KovĂĄcs
PDF
LF_DPDK17_Implementation and Testing of Soft Patch Panel
PPT
Ds8000 Practical Performance Analysis P04 20060718
PPT
slides
PDF
DPDK Integration: A Product's Journey - Roger B. Melton
PDF
DPDK Summit - 08 Sept 2014 - Ericsson - A Multi-Socket Ferrari for NFV
PPT
IBM SAN Volume Controller Performance Analysis
PDF
Overview of HPC Interconnects
PDF
SHARE.ORG in Boston Aug 2013 RHEL update for IBM System z
PDF
Host Data Plane Acceleration: SmartNIC Deployment Models
PDF
Spectrum Scale Best Practices by Olaf Weiser
PDF
Phytium 64 core cpu preview
PDF
Design installation-commissioning-red raider-cluster-ttu
PDF
Intro to Cell Broadband Engine for HPC
PPTX
Linux rt in financial markets
LF_DPDK17_mediated devices: better userland IO
FD.io - The Universal Dataplane
Oracle RAC Presentation at Oracle Open World
Generic Resource Manager - LĂĄszlĂł Vadkerti, AndrĂĄs KovĂĄcs
LF_DPDK17_Implementation and Testing of Soft Patch Panel
Ds8000 Practical Performance Analysis P04 20060718
slides
DPDK Integration: A Product's Journey - Roger B. Melton
DPDK Summit - 08 Sept 2014 - Ericsson - A Multi-Socket Ferrari for NFV
IBM SAN Volume Controller Performance Analysis
Overview of HPC Interconnects
SHARE.ORG in Boston Aug 2013 RHEL update for IBM System z
Host Data Plane Acceleration: SmartNIC Deployment Models
Spectrum Scale Best Practices by Olaf Weiser
Phytium 64 core cpu preview
Design installation-commissioning-red raider-cluster-ttu
Intro to Cell Broadband Engine for HPC
Linux rt in financial markets
Ad

Viewers also liked (20)

PDF
2008-07-30 IBM Teach the Teacher (IBM T3), Red Hat Update for System z
PDF
2009-03-03 SHARE Conference, Current & Future State of Linux on System z
PDF
2008 08-12 SELinux: A Key Component in Secure Infrastructures
PDF
2009-03-13 Atlanda System z Council Meeting
PDF
2008-06-25 Marist System z Summer Professors Series
PDF
2009-12-04 New York City System z Executive Council
PDF
2008-03-06 Harris Corp Security Seminar
PDF
2009-06-18 CAVMEN System z Users Group Update
PDF
2009-05-05 A Customer's Perspective on Making Enterprise Linux Deployable, Sc...
PDF
2008-11-13 CAVMEN RHEL for System z Deep Dive
PDF
2008-10-15 Red Hat Deep Dive Sessions: SELinux
PDF
2009-01-20 RHEL 5.3 for System z
PDF
2008-12-2 System z Partners Field Call
PDF
2008-01-23 Red Hat Overview to CUNY Information Managers Forum
PDF
2010-03-30 Red Hat Identity Management, Certificate System Technical Overview
PDF
2010-01-28 NSA Open Source User Group Meeting, Current & Future Linux on Syst...
PDF
2009-08-24 Managing your Red Hat Enterprise Linux Guests with RHN Satellite
PDF
2009-08-24 The Linux Audit Subsystem Deep Dive
PDF
2008-09-09 IBM Interaction Conference, Red Hat Update for System z
PDF
2008-01-22 Red Hat (Security) Roadmap Presentation
2008-07-30 IBM Teach the Teacher (IBM T3), Red Hat Update for System z
2009-03-03 SHARE Conference, Current & Future State of Linux on System z
2008 08-12 SELinux: A Key Component in Secure Infrastructures
2009-03-13 Atlanda System z Council Meeting
2008-06-25 Marist System z Summer Professors Series
2009-12-04 New York City System z Executive Council
2008-03-06 Harris Corp Security Seminar
2009-06-18 CAVMEN System z Users Group Update
2009-05-05 A Customer's Perspective on Making Enterprise Linux Deployable, Sc...
2008-11-13 CAVMEN RHEL for System z Deep Dive
2008-10-15 Red Hat Deep Dive Sessions: SELinux
2009-01-20 RHEL 5.3 for System z
2008-12-2 System z Partners Field Call
2008-01-23 Red Hat Overview to CUNY Information Managers Forum
2010-03-30 Red Hat Identity Management, Certificate System Technical Overview
2010-01-28 NSA Open Source User Group Meeting, Current & Future Linux on Syst...
2009-08-24 Managing your Red Hat Enterprise Linux Guests with RHN Satellite
2009-08-24 The Linux Audit Subsystem Deep Dive
2008-09-09 IBM Interaction Conference, Red Hat Update for System z
2008-01-22 Red Hat (Security) Roadmap Presentation
Ad

Similar to 2009-01-28 DOI NBC Red Hat on System z Performance Considerations (20)

PPT
Oow2007 performance
PDF
Rac on NFS
PPTX
Collaborate nfs kyle_final
PDF
Fastsocket Linxiaofeng
PPTX
Ceph Performance Profiling and Reporting
PDF
Common Sense Performance Indicators in the Cloud
PDF
Shak larry-jeder-perf-and-tuning-summit14-part2-final
PDF
Challenges with high density networks
PDF
CLFS 2010
PPT
Servers and Processes: Behavior and Analysis
PPTX
Oracle Open World 2014: Lies, Damned Lies, and I/O Statistics [ CON3671]
PDF
Much Faster Networking
PDF
Ceph Object Storage Performance Secrets and Ceph Data Lake Solution
ODP
Performance: Observe and Tune
PDF
Kernel Recipes 2019 - Metrics are money
ODP
Dpdk performance
PPTX
Cloud Performance Benchmarking
PPTX
RDMA at Hyperscale: Experience and Future Directions
PPTX
"FCoE vs. iSCSI - Making the Choice" from Interop Las Vegas 2011
PDF
Container Performance Analysis Brendan Gregg, Netflix
Oow2007 performance
Rac on NFS
Collaborate nfs kyle_final
Fastsocket Linxiaofeng
Ceph Performance Profiling and Reporting
Common Sense Performance Indicators in the Cloud
Shak larry-jeder-perf-and-tuning-summit14-part2-final
Challenges with high density networks
CLFS 2010
Servers and Processes: Behavior and Analysis
Oracle Open World 2014: Lies, Damned Lies, and I/O Statistics [ CON3671]
Much Faster Networking
Ceph Object Storage Performance Secrets and Ceph Data Lake Solution
Performance: Observe and Tune
Kernel Recipes 2019 - Metrics are money
Dpdk performance
Cloud Performance Benchmarking
RDMA at Hyperscale: Experience and Future Directions
"FCoE vs. iSCSI - Making the Choice" from Interop Las Vegas 2011
Container Performance Analysis Brendan Gregg, Netflix

More from Shawn Wells (20)

PDF
2017-10-10 AUSA 2017: Repeatable DCO Platforms
PDF
2017-07-12 GovLoop: New Era of Digital Security
PDF
2017-07-11 GovLoop: Changing the Open Hybrid Cloud Game (Deploying OpenShift ...
PDF
2017 02-17 rsac 2017 tech-f02
PDF
2017-02-21 AFCEA West Building Continuous Integration & Deployment (CI/CD) Pi...
PDF
2016 -11-18 OpenSCAP Workshop Coursebook
PDF
2016-08-29 AFITC Security Automation
PDF
2016-08-24 FedInsider Webinar with Jennifer Kron - Securing Intelligence in a...
PPT
2016-08-18 Red Hat Partner Security Update
PDF
2015-11-15 - Supercomputing 2015 - Applied Cross Domain
PDF
2015-10-05 Fermilabs DevOps Alone in the Dark
PDF
2015-06-25 Red Hat Summit 2015 - Security Compliance Made Easy
PPTX
2015 06-12 DevOpsDC 2015 - Consumer to Collaborator
PDF
2015-01-27 ssa opening remarks
PDF
2014-12-16 defense news - shutdown the hackers
PDF
2014-07-31 customer convergence applied scap
PDF
2014-07-30 defense in depth scap workbook
PDF
2014-05-08 IT Craftsmanship to IT Manufacturing
PDF
2014-04-28 cloud security frameworks and enforcement
PDF
2014 04-17 Applied SCAP, Red Hat Summit 2014
2017-10-10 AUSA 2017: Repeatable DCO Platforms
2017-07-12 GovLoop: New Era of Digital Security
2017-07-11 GovLoop: Changing the Open Hybrid Cloud Game (Deploying OpenShift ...
2017 02-17 rsac 2017 tech-f02
2017-02-21 AFCEA West Building Continuous Integration & Deployment (CI/CD) Pi...
2016 -11-18 OpenSCAP Workshop Coursebook
2016-08-29 AFITC Security Automation
2016-08-24 FedInsider Webinar with Jennifer Kron - Securing Intelligence in a...
2016-08-18 Red Hat Partner Security Update
2015-11-15 - Supercomputing 2015 - Applied Cross Domain
2015-10-05 Fermilabs DevOps Alone in the Dark
2015-06-25 Red Hat Summit 2015 - Security Compliance Made Easy
2015 06-12 DevOpsDC 2015 - Consumer to Collaborator
2015-01-27 ssa opening remarks
2014-12-16 defense news - shutdown the hackers
2014-07-31 customer convergence applied scap
2014-07-30 defense in depth scap workbook
2014-05-08 IT Craftsmanship to IT Manufacturing
2014-04-28 cloud security frameworks and enforcement
2014 04-17 Applied SCAP, Red Hat Summit 2014

Recently uploaded (20)

PPTX
Lecture 3: Operating Systems Introduction to Computer Hardware Systems
 
PPTX
L1 - Introduction to python Backend.pptx
PDF
How to Migrate SBCGlobal Email to Yahoo Easily
PDF
Wondershare Filmora 15 Crack With Activation Key [2025
PPTX
Agentic AI Use Case- Contract Lifecycle Management (CLM).pptx
PDF
Audit Checklist Design Aligning with ISO, IATF, and Industry Standards — Omne...
PPTX
Oracle E-Business Suite: A Comprehensive Guide for Modern Enterprises
PDF
Design an Analysis of Algorithms II-SECS-1021-03
PDF
Claude Code: Everyone is a 10x Developer - A Comprehensive AI-Powered CLI Tool
PDF
Flood Susceptibility Mapping Using Image-Based 2D-CNN Deep Learnin. Overview ...
PDF
How Creative Agencies Leverage Project Management Software.pdf
PPTX
ai tools demonstartion for schools and inter college
PPTX
ManageIQ - Sprint 268 Review - Slide Deck
PPTX
Transform Your Business with a Software ERP System
PDF
Nekopoi APK 2025 free lastest update
PDF
Understanding Forklifts - TECH EHS Solution
PDF
Softaken Excel to vCard Converter Software.pdf
PPTX
history of c programming in notes for students .pptx
PDF
Raksha Bandhan Grocery Pricing Trends in India 2025.pdf
PPT
Introduction Database Management System for Course Database
Lecture 3: Operating Systems Introduction to Computer Hardware Systems
 
L1 - Introduction to python Backend.pptx
How to Migrate SBCGlobal Email to Yahoo Easily
Wondershare Filmora 15 Crack With Activation Key [2025
Agentic AI Use Case- Contract Lifecycle Management (CLM).pptx
Audit Checklist Design Aligning with ISO, IATF, and Industry Standards — Omne...
Oracle E-Business Suite: A Comprehensive Guide for Modern Enterprises
Design an Analysis of Algorithms II-SECS-1021-03
Claude Code: Everyone is a 10x Developer - A Comprehensive AI-Powered CLI Tool
Flood Susceptibility Mapping Using Image-Based 2D-CNN Deep Learnin. Overview ...
How Creative Agencies Leverage Project Management Software.pdf
ai tools demonstartion for schools and inter college
ManageIQ - Sprint 268 Review - Slide Deck
Transform Your Business with a Software ERP System
Nekopoi APK 2025 free lastest update
Understanding Forklifts - TECH EHS Solution
Softaken Excel to vCard Converter Software.pdf
history of c programming in notes for students .pptx
Raksha Bandhan Grocery Pricing Trends in India 2025.pdf
Introduction Database Management System for Course Database

2009-01-28 DOI NBC Red Hat on System z Performance Considerations

  • 1. Red Hat on System z Performance Considerations Updated 27-JAN-2009
  • 2. Agenda & IntroductionAgenda & Introduction ● Networking ● Storage ● Memory Management Much of this presentation is a collection of IBM reports, SHARE presentations, and Red Hat data. This presentation puts it in one place.
  • 3. Agenda & IntroductionAgenda & Introduction Shawn Wells <swells@redhat.com> Global System z Alliance Manager (+1) 443 534 0130 ● Based in Washington, D.C. ● Global responsibility for Red Hat's System z activities
  • 4. Who's seen this before?Who's seen this before?
  • 6. The EnvironmentThe Environment ● HiperSockers – Four Linux LPARs (2 IFLs ea.) to one z/OS Server LPAR (4 & 8 Cps) – z/OS V1R2 – TCP buffer sizes increased from 65335B to 131071B, allowing for more unacknowledged data – L3 traffic only – IPv4, z990, Large Send (requires OSA, card-to-card, and IPv4)
  • 7. The EnvironmentThe Environment ● Throughput & Response time charts – Transactions per second for interactive workloads in milliseconds – Megabytes per second for streams-type workloads ● 1MB = 1,048,576 bytes/sec ● Throughput & CPU-Milliseconds Charts – # of milliseconds of processing per transaction – Streams-type workloads, # milliseconds of processing per megabyte
  • 8. The EnvironmentThe Environment WORKLOAD DESCRIPTION cra CRR 200B/15000B (A 200-byte Request-message from the client to the server followed by a 15000-byte Response-message from the server to the client. A TCP-connection is established for each RR.) rra RR 200B/1000B (A 200-byte Request-message from the client to the server followed by a 1000-byte Response-message from the server to the client. All RRs operate under that same TCP-connection.) rrb RR 200B/15000B rr1 RR 1B/1B rr64k RR 64KB/64KB sor Streams Outbound (20B from the client to the server, followed by 20MB from the server to the client) sir Streams Inbound (20MB/20B) mix Mixe of sor and sir streams
  • 9. OSA Response TimeOSA Response Time 200 byte request, 15000 byte response, same tcp session200 byte request, 15000 byte response, same tcp session
  • 10. OSA Response TimeOSA Response Time Transactions per Second vs CPU TimeTransactions per Second vs CPU Time
  • 11. OSA Response TimeOSA Response Time
  • 12. OSA Response TimeOSA Response Time Streaming Data @ 57344B/secStreaming Data @ 57344B/sec
  • 13. OSA Response TimeOSA Response Time Streaming Data @ 57344B/secStreaming Data @ 57344B/sec
  • 15. The EnvironmentThe Environment ● Configuration for 4Gbps disk I/O measurements
  • 16. Disk I/O Performance with 4Gbps links –Disk I/O Performance with 4Gbps links – FICON vs FCPFICON vs FCP ● Throughput for sequential write is simular ● FCP throughput for random I/O is 40% higher
  • 17. Disk I/O Performance with 4Gbps links –Disk I/O Performance with 4Gbps links – FICON vs FCP / direct I/OFICON vs FCP / direct I/O ● Bypassing RHEL page cache improves throughput for FCP by 2x, FICON up to 1.6x ● Read operations much faster on FCP
  • 18. FCP/SCSI single path vs multipath LVMFCP/SCSI single path vs multipath LVM ● Use failover instead of multibus
  • 19. StripingStriping ● Results with SCSI disks – LVM striped logical volumes are fast, but LVM takes up % more CPU ● Results with ECKD disks – Fairly the same outcome as with SCSI disks. Performance differences with storage pool striping were small – The load balancing over a FICON path group performs better than dm-multipath (RHEL multipathing)
  • 21. Crypto Express2 Accelerator (CEX2A)Crypto Express2 Accelerator (CEX2A) SSL handshakesSSL handshakes ● The number of handshakes is up to 4x higher with h/w assist ● In 32 connections case, we save 50% of CPU
  • 22. Crypto Performance – WebSEAL SSLCrypto Performance – WebSEAL SSL AccessAccess ● Improvement by h/w support
  • 23. Memory ManagementMemory Management Performance ConsiderationsPerformance Considerations
  • 24. CMM1 & CMMACMM1 & CMMA ● Cooperative Memory Management (CMM1) – Ballooning technique – When z/VM detects memory constraints, it tells RHEL guests to release page frames (done by issuing a DIAG X'10') – When memory is freed, it alerts requesting RHEL guest
  • 25. CMM1 & CMMACMM1 & CMMA ● Collaborative Memory Management Assist (CMMA) – Page status technique ● Stable (S) page has essential content ● Unused (U) no useful content and any access to the page will cause an addressing exception ● Volatile (V page has useful content. CP can discard the page anytime.
  • 26. CMM & CMMA PerformanceCMM & CMMA Performance
  • 27. CMM & CMMA PerformanceCMM & CMMA Performance
  • 28. Open Discussion / Q&AOpen Discussion / Q&A