Db2 for z os trends

Db2 for z/OS – Trends and Directions
Cüneyt Göksu, Lab Advocate
IBM Germany
2020 IBM Systems Technical University
7.2.2020 | Istanbul

Agenda
— Db2 for z/OS technical strategy
— Db2 12 for z/OS GA Highlights & Recent Deliveries
— Potential Future Db2 12 Features
— Db2 AI for z/OS
IBM Systems Technical University © Copyright IBM Corporation 2020

Db2 for z/OS Strategy
Db2 for z/OS is investing for leadership in the AI, cloud, and analytics era, extending our Z
platform heritage of 24x7 availability, security, scalability & performance, while simplifying &
modernizing to maintain Db2 as a top choice for next-gen IT professionals without requiring
deep Z skills
IBM Systems Technical University © Copyright IBM Corporation 2020 3

Data in-place Tooling
• Virtualization
• Visualization
• …
Cloud Pak for
Data
Container
platform and
operational services
Organize
Analyze
Collect
Infuse
Other data sources
Operational Tooling
• Optimization
• Monitoring
• Automation
Application Tooling
• Administration
• Object handling
• Dev Ops
Data Movement Tooling
• Cloning
• Data Gate
• Replication
Table
Data
…
Machine Learning

Db2 for z/OS Strategy
New Application Development ; Simplification & modernization for application development .
Embed AI to make Db2 even smarter.
• Db2aaS, cloud provisioning
• DevOps, CI/CD automation
• Enhanced REST services
• SQL improvements
• Db2ZAI
Core Database Leadership; Leadership in resiliency, availability, security, performance,
scalability. Simplification for administration.
• Z platform optimization
• AlwaysOn for System
• Enhanced compression
• In-memory, performance
• Eliminate administrative complexity
• Utility improvements

Continuous Delivery z15
Z Data and AI

Db2 for z/OS: Availability summary
Version PID General
Availability
Marketing
Withdrawal
End of
Service
8 5625-DB2 March 2004 September 2009 April 2012
9 5635-DB2 March 2007 December 2012 June 2014
10 5605-DB2 October 2010 July 2015 September
2017
11 5615-DB2 October 2013 July 2018 September
2020
12 5650-DB2 October 2016
http://www-01.ibm.com/software/data/support/lifecycle/

Continuous Delivery
What is the motivation ?
Db2 for z/OS Market is demanding faster
reaction to requirements
V11 V12
3 years

How Db2 for z/OS handles continuous delivery
— Continuous delivery for Db2 starts after migration to V12
• Migration to V12 may still be in the future for you, but preparation for this new concept
is strongly recommended
— New features come in with “function levels“ delivered in the normal PTF service
stream
— Function levels are counted up consecutively
• Some day there may be a new version
— To go to new function levels is voluntary
• Also skipping one or more function levels is possible, but consider:
o E.g. activation of level n+2 includes activation of level n as well as level n+1
• The same rule applies to catalog levels (catalog changes)
o Catalog changes are only one direction (no fallback)
— http://ibm.biz/db2z12functionlevels

Continuous Delivery – four levels are important
— System level:
• Module or code level (ML)
SDSNLOAD, ...
• Catalog level (CL)
CATALOG & DIRECTORY structure
• Function level (FL)
Which new functionalities are enabled
— Application level:
• Application compatibility level (AC)
APPLCOMPAT re-bind parameter
• Precompiler/Coprocessor
SQLLEVEL (replaces NEWFUN) in DSNHDECP

Some facts about continuous delivery in Db2 for z/OS
• There are four different levels
o Module or code level (ML), Db2 catalog/directory level (CL), function level (FL),
application compatibility level (AC)
• ML is always the highest level
• FL and AC have fallback during Db2 is active
o There is no fallback for CL

Function levels - Current status
• V12R1M501 – PI70535 – March 2017
• V12R1M502 – PI95511 – April 2018
• V12R1M503 – PH00506 – September 2018
• V12R1M504 – PH07672 – March 2019
• V12R1M505 – PH09191 – June 2019
• V12R1M506 – PH16829 – October 2019

Function levels by time
New functionality by function levels
Db2 for z/OS Market is demanding faster
reaction to requirementsV12
2016 2017 2018 2019 2020

Function level V12R1M501 (or M501) – PI70535
—March 2017
• New BIF LISTAGG
• New ClientApplCompat property for data clients if data driver
packages are bound with APPLCOMPAT(V12R1M501)

Function level 501 (activation enabled by APAR PI70535—March, 2017)
— The LISTAGG built-in function
The LISTAGG built-in function produces a list of all values in a group. An optional separator argument can delimit
items in the result list. For example, specifying a comma as the separator produces a comma-separated list. An
optional ordering can also be specified for the items within the group.
SELECT WORKDEPT, LISTAGG(LASTNAME, ', ') WITHIN GROUP(ORDER BY
LASTNAME) AS EMPLOYEES FROM EMP GROUP BY WORKDEPT;

Data driver packages bound with APPLCOMPAT(V12R1M501)
Web User
Db2 for z/OS
direct connection
clientApplCompat
property is required
PH08482
Web User
Client needs Db2
connect 11.5+
connect server
Server needs Db2
connect 11.5+
PH15092

Function level V12R1M502 (or M502) – PI95511
—April 2018
• Transparent data set encryption (TDE)
• Secure data on Db2 tables and log
• Explicit casting of numeric values to (VAR-) GRAPHIC

Function level 502 (activation enabled by APAR PI95511—April, 2018)
— Key label management for z/OS DFSMS data set encryption
• Function level 502 introduces management of key labels for z/OS DFSMS data set encryption to
transparently encrypt Db2 data sets. DFSMS can be used to encrypt various types of Db2 data sets
including Db2-managed table space and index space data sets, data sets that are used by Db2 utilities,
and sequential input and output data sets.
• Catalog / directory objects and archive log data sets
— Explicit casting of numeric values to GRAPHIC or VARGRAPHIC
• Previously, in Db2 for z/OS, no way to directly cast numeric value (e.g., decimal or integer) to data type
GRAPHIC or VARGRAPHIC (double-byte character string)

Function level V12R1M503 (or M503) – PH00506
—September 2018
• Db2 AI for z/OS (Db2ZAI)
o Optimize Db2 operation with machine learning
o Only requires code level is at V12R1M503 and above
• Replication of system-period temporal tables and generated
expression columns

Function level 503 (activation enabled by APAR PH00506)
— IBM Db2 AI for z/OS support
• Function level 503 introduces support for IBM Db2 AI for z/OS, which leverages machine learning
technology to empower the Db2 for z/OS optimizer to determine the best-performing query access paths,
based on your workload characteristics.
— Enablement for replication of system-period temporal tables and generated expression
columns
• Function level 503 provides support needed by replication programs to replicate Db2 for z/OS data in
system-period temporal tables and in tables that contain generated expression columns.
— Console message for catalog level or function level change
• Function level 503 introduces console message DSNG014I. It is issued to the console whenever the
function level or catalog level of a Db2 subsystem or data sharing group changes. See DSNG014I.

—March 2019
• Deprecated objects for simplification
• Huffman Compression
• Pass-through BIF (IDAA)
• New SQL syntax for special registers and NULL predicate

Function level 504 (activation enabled by APAR PH07672—March, 2019)
— IBM z14 Huffman compression
• Function level 504 introduces support for compression of Db2 data with IBM Z hardware-based entropy
encoding (Huffman) compression with the IBM z14™ Compression Coprocessor (CMPSC). The
TS_COMPRESSION_TYPE subsystem parameter controls the compression method for Db2 subsystems on
IBM z14 hardware
— Prevent creation of new deprecated objects
• Certain Db2 capabilities are deprecated. Function level 504 introduces capability to prevent the creation of
certain deprecated objects such as Synonyms, Segmented (non-UTS) or partitioned (non-UTS) tables,
Hash-organized tables spaces
— Newly supported built-in functions with IBM Db2 Analytics Accelerator
• Function level 504 introduces support for the following passthrough-only built-in functions, which are
passed through from Db2 for z/OS to IBM Db2 Analytics Accelerator
https://www.ibm.com/support/knowledgecenter/SSEPEK_12.0.0/idaa/src/tpc/db2z_determineaccelqueries.
html#accel-passthrough-only
— New SQL syntax alternatives for special registers and NULL predicates
CURRENT CLIENT_USERID  CLIENT USERID
IS NULL  ISNULL

—June 2019
• Rebind phase-in
• New BIF for Transparent Column Encryption
• RUNSTATS sampling simplification
• Indexes for DECFLOAT
• Temporal and archive enhancements on WHEN clause of triggers

—October 2019
• Drop of table automatically drops underlying explicitly created UTS or
LOB TS
• New SQL syntax alternatives (existing BIFs): Compatibility reason to
other platforms
o CHARACTER_LENGTH can be CHAR_LENGTH
o CLOB can be TO_CLOB
o …

Selected Recent Deliveries Not Tied to Function Levels
— New Application Development
• Db2ZAI V1.2 (Db2 System Assessment and Optimizer improvements)
• Db2aaS integration with IBM CloudPak for Data
• ALTER concurrency with dynamic SQL
• ODBC support for node.js on z/OS
• Query performance improvements for join predicate pushdown
• RESTful services enhancements (New start/stop/display service commands, Service versioning support)
— DBMS Technology Leadership
• z14 zHyperLink support for log writes
• z14 zHyperLink read support rolled back to V11
• Db2 system provisioning services
• Insert algorithm 2 improvements
• z14 Asynch CF cross-invalidation
• Simplified application compatibility for IBM Data Server Drivers and Db2 12 function levels
https://www.ibm.com/support/knowledgecenter/en/SSEPEK_12.0.0/wnew/src/tpc/db2z_minorenhanceme
ntsinapars.html

Purpose-built for mission-critical applications
33Introducing IBM z15 / September 2019 / © 2019 IBM Corporation
Processor
• Up to 190 client configurable cores
• 14% single-thread performance improvement
• 25% maximum system capacity growth over
IBM z14™
• New on-chip acceleration of compression for
faster processing and more efficient storage of data
• More investments in pause-less garbage collection, 30+
new instructions codesigned and exploited by Java™, and
vector enhancements for analytics applications
Memory
• 40 TB maximum per system — RAIM memory design
To the data
• Significant scalability improvements — up to 20% more I/O
channels and 50% more logical
Coupling Facility connections over z14
• Faster SSL/TLS handshake performance on IBM z15 with
Crypto Express7S compared to z14 with Crypto Express6S
IBM z15
Machine type: 8561
Model T01
15.6 miles of wires, 9.2
billion transistors and 26.2
billion wiring connections
CPC
drawer
Customer
PUs
Max
memory
5 190 40 TB
4 145 32 TB
3 108 24 TB
2 71 16 TB
1 34 8 TB
Feature-based sizing

IBM Z Instant Recovery
Unleash your capacity with IBM System Recovery Boost to maximize your availability
Diminish the impact of any event, planned or unplanned, so you can achieve service
level excellence with zero increase in IBM software licensing costs.
Recover workloads substantially faster than on prior IBM Z platforms by unleashing
additional processing capacity during a fixed-period performance increase on an
LPAR-by-LPAR basis.
With System Recovery Boost you can achieve up to:
2.0x faster
Return to
pre-shutdown
service levels1
2.0x faster
Processing of
transactional
backlog2
2.5x faster
Processing
of batch
backlog3
4x faster
GDPS-automated
startup, shutdown,
site switches4
Introducing IBM z15 / September 2019 / © 2019 IBM Corporation
Db2 restart might have benefit

Protection of data that must be shared
New IBM Z Data Privacy for Diagnostics is a z/OS
capability exclusive to z15 to control access to data shared
with business partners and ecosystems
Challenges Client value
• Protect from the accidental
sharing of sensitive data when
sending diagnostic information to
vendors.
• Comply with GDPR laws, data
privacy laws, and company or
industry mandates.
35Introducing IBM z15 / September 2019 / © 2019 IBM Corporation
• Sensitive data-tagging APIs are combined with
machine learning to detect, tag and redact all tagged
data from diagnostic dumps.
• The first set of exploiters (Db2, IMS and some
DFSMS™ components) provide the infrastructure
to tag sensitive data in z/OS.
• Tagging does not impact dump times.
• IBM Z Data Privacy for Diagnostics is supported on
IBM z15 running z/OS 2.3 or 2.4.
Db2 – PH15940
IMS – PH14059
VSAM – OA58730
OAM – OA58431
BAM – OA58712
z/OS – OA57570 (z/OS 2.3)

LOB compression
• Compression prior to Db2 12
o Table space and XML use Lempel-Ziv and compression dictionary
o Compressed using z System processor chip (CMPSC)
o Optimized for small data objects, such as row data
o Index compression uses prefix compression and uses normal CPs
• Db2 12 provides LOB table space compression
o zEDC processor optimized for large data objects, data compressed in 1MB blocks
o Db2 automatically utilizes the on-chip accelerated compression in z15

Max memory on System Z processors in TB
0,5 1,5
3 3
10
32
40
ZEC9 Z10 Z196 ZEC12 Z13 Z14 Z15
Memory in TB
z/OS 2.4 supports 4TB per LPAR

Selective opportunities for real storage exploitation
• Buffer pools
o Contiguous Buffer Pools
o Buffer Pool Simulation Larger Buffer Pools
• Fast Traversal Block (zPARM INDEX_MEMORY_CONTROL)
• Dynamic Statement Cache
• Sortpool and sparse index (zPARMs SRTPOOL and
MXDTCACH)

IBM Db2 AI for z/OS (Db2ZAI)
• Learns patterns from workload data collected in an organization’s unique operating environment
and uses derived insight to help determine optimal access paths for SQL statements
• Detects anomalies from Db2 Statistics and provides performance tuning recommendations
• Built on top of the IBM Watson Machine Learning for z/OS (WML on Z) Technology stack
• Leverages WML on Z services without requiring data scientist support
• Db2 generates model training data
• Deploys, monitors and retrains models via WML on Z services
• Internal IBM benchmarks have shown up to 25% reduction in CPU time
Db2ZAI product ID: 5698-CGN
Requires Db2 12 for z/OS FL500
IBM Db2 AI for z/OS (Db2ZAI)

What is the Db2 Optimizer? An analogy….
• The optimizer is responsible for
• Choosing the most efficient method of accessing the data for a given SQL statement
• Think of your transportation choices
• Start/end location, time of day, construction, traffic, available options/routes
• All can impact the “quickest” route
?
?
?
?

Db2ZAI: customizing access paths for a workload
— Db2ZAI is focused on two optimizer “blind spots:”
• What values will be provided for host variables or parameter markers in query predicates?
• How many rows of a query result set will actually be fetched?
— Without Db2ZAI:
• Db2 uses default filter factors for predicates with host variables or parameter markers
• Db2 assumes entire result set will be fetched (absent OPTIMIZE FOR n ROWS clause)
— With Db2ZAI:
• Db2 stores actual host variable/parameter marker values used for queries, actual number of result
set rows fetched
• Data is used to train models that more accurately predict these values
o Result: better filter factors, leading to better-performing access paths
Example: WHERE BIRTHDATE < ?

Potential Db2 for z/OS Content to Support new Z Server
— Evaluating performance
• General performance improvement with Db2 workloads
• System Recovery Boost
• TBs of buffer pool
• zHyperLink improvement with latest IBM storage
— Db2 Exploitation
• Enhanced Sort Facility: Db2 query speedup
• Micro Trend Analysis: System performance trending
• Encryption of Db2 dump to protect buffer pool
• Exploiting large memory with contiguous buffer pool

Notices and disclaimers
— © 2019 International Business Machines Corporation. No part of
this document may be reproduced or transmitted in any form
without written permission from IBM.
— U.S. Government Users Restricted Rights — use, duplication or
disclosure restricted by GSA ADP Schedule Contract with IBM.
— Information in these presentations (including information
relating to products that have not yet been announced by IBM)
has been reviewed for accuracy as of the date of
initial publication and could include unintentional technical or
typographical errors. IBM shall have no responsibility to update
this information. This document is distributed “as is” without
any warranty, either express or implied. In no event, shall IBM
be liable for any damage arising from the use of this
information, including but not limited to, loss of data, business
interruption, loss of profit or loss of opportunity.
IBM products and services are warranted per the terms and
conditions of the agreements under which they are provided.
— IBM products are manufactured from new parts or new and used
parts.
In some cases, a product may not be new and may have been
previously installed. Regardless, our warranty terms apply.”
— Any statements regarding IBM's future direction, intent or
product plans are subject to change or withdrawal without
notice.
— Performance data contained herein was generally obtained in a
controlled, isolated environments. Customer examples are
presented as illustrations of how those
— customers have used IBM products and the results they may have
achieved. Actual performance, cost, savings or other results in
other operating environments may vary.
— References in this document to IBM products, programs, or
services does not imply that IBM intends to make such products,
programs or services available in all countries in which
IBM operates or does business.
— Workshops, sessions and associated materials may have been
prepared by independent session speakers, and do not necessarily
reflect the views of IBM. All materials and discussions are provided
for informational purposes only, and are neither intended to, nor
shall constitute legal or other guidance or advice to any individual
participant or their specific situation.
— It is the customer’s responsibility to insure its own compliance
with legal requirements and to obtain advice of competent legal
counsel as to the identification and interpretation of any
relevant laws and regulatory requirements that may affect the
customer’s business and any actions the customer may need to
take to comply with such laws. IBM does not provide legal advice
or represent or warrant that its services or products will ensure that
the customer follows any law.

Notices and disclaimers continued
— Information concerning non-IBM products was obtained from the suppliers
of those products, their published announcements or other publicly
available sources. IBM has not tested those products about this publication
and cannot confirm the accuracy of performance, compatibility or any other
claims related to non-IBM products. Questions on the capabilities of non-
IBM products should be addressed to the suppliers of those products.
IBM does not warrant the quality of any third-party products, or the ability of
any such third-party products to interoperate with IBM’s products. IBM
expressly disclaims all warranties, expressed or implied, including but
not limited to, the implied warranties of merchantability and fitness for a
purpose.
— The provision of the information contained herein is not intended to, and
does not, grant any right or license under any IBM patents, copyrights,
trademarks or other intellectual property right.
— IBM, the IBM logo, ibm.com and [names of other referenced
IBM products and services used in the presentation] are
trademarks of International Business Machines Corporation,
registered in many jurisdictions worldwide. Other product and
service names might be trademarks of IBM or other
companies. A current list of IBM trademarks is available on
the Web at "Copyright and trademark information" at:
www.ibm.com/legal/copytrade.shtml

Db2 for z os trends

More Related Content

What's hot (20)

Similar to Db2 for z os trends (20)

More from Cuneyt Goksu (20)

Recently uploaded (20)

Db2 for z os trends