IBM MQ V9 Overview
5 likes6,911 views
IBM MQ V9 provides a new optional delivery model with two streams: a long-term support stream for stability and a rapid function delivery stream. It includes features like central provisioning of client configuration, a new quality of service for Advanced Message Security called Confidentiality, and LDAP authorization support for Windows clients. Activity trace information can now be subscribed to via publish/subscribe without additional configuration.
IBM MQ V9 Overview
- 1. © Copyright IBM Corporation 2016 MQ V9 Overview Mark Taylor marke_taylor@uk.ibm.com IBM Hursley
- 2. © Copyright IBM Corporation 2016 MQ Vision • MQ provides the underlying connectivity mechanism for the increasingly connected world – Messaging-based enterprise nervous system – First responder to every business event • Reduced burden of administration – Infrastructure team can focus on more complex issues – Simplifies task of connecting together disparate applications • Deploy and connect anything, anywhere with security – The same messaging environment, the same messaging applications – On-premise, in cloud, on appliance – Adapting to new business drivers
- 3. © Copyright IBM Corporation 2016 Our messaging focus areas Our users include application developers, cloud application developers. system administrators and operators, enterprise architects Want to build business critical messaging applications quickly; be able to operate and manage resulting systems. Expect fast time-to-value, simplicity, flexibility, clear documentation, Extending today’s messaging •Deploy messaging everywhere needed, to enable the hybrid enterprise with simplicity and fast time to value •Connect hybrid applications in clouds, virtualized systems and containers, with choices of messaging styles and APIs Delivering additional and new capabilities for messaging • Streamline messaging deployment and operation with self-service administration, location transparency and elastic scaling • User driven updates to core messaging capabilities to extend the value of IBM MQ across multiple use cases Increasing usability and enhancing value of messaging deployments • Additional flexibility for configuration and management for MQ to meet individual business needs • Extend the value of MQ deployments through improvements to further use cases such as MQ MFT
- 4. © Copyright IBM Corporation 2016 MQ V9 now announced • Announcement on April 19 2016 • Availability 2 June for Distributed platforms • Availability 17 June for z/OS
- 5. © Copyright IBM Corporation 2016 New Approach to Delivery
- 6. © Copyright IBM Corporation 2016 A new OPTIONAL delivery model • Customers want new features faster – But they also want stability of existing function • V8 has delivered a range of new capability in the service stream – But that has some constraints – And not everyone wants those new features – Many lessons learned on practical aspects • And so MQ V9 starts the move to a 2-stream mechanism – "Long-term support" aka "stable delivery" – Rapid function delivery – For both z/OS and Distributed products • You get to choose which stream to follow
- 7. © Copyright IBM Corporation 2016 Version 9, MQ long term service 9.0.0.1 9.0.0.2 9.0.0.3 9.0.0.4 9.0.0.5 9.0.0.6 …… Stable Delivery (traditional support model) Version X, MQ long term service Fixes only. No mid-service function. Same 5+3 service lifetime LTS releases every couple of years
- 8. © Copyright IBM Corporation 2016 Version 9, MQ long term service 9.0.0.1 9.0.0.2 9.0.0.3 9.0.0.4 9.0.0.5 9.0.0.6 …… Stable and Rapid Delivery Version X, MQ long term service 9.0.1 9.0.2 9.0.3 9.0.n X.0.1 X.0.2 X.0.3 Fixes only. No mid-service function. Same 5+3 service lifetime LTS releases every couple of years Fixes, plus new function New delivery every few months Fixes on latest mod only
- 9. © Copyright IBM Corporation 2016 Product Features
- 10. © Copyright IBM Corporation 2016 Platforms & Standards Security Scalability System z exploitation 64-bit for all platforms Userid authentication via OS & LDAP Multiplexed client performance 64-bit buffer pools in MQ for z/OS means less paging, more performance Multiple Cluster Transmit Queue on all platforms User-based authorisation for Unix Queue manager vertical scaling Performance and capacity Support for JMS 2.0 AMS for IBM i & z/OS Publish/Subscribe improvements Performance enhancements for IBM Information Replicator (QRep) Improved support for .Net and WCF DNS Hostnames in CHLAUTH records Routed publish/subscribe Exploit zEDC compression accelerator SHA-2 for z, i & NSS Multiple certificates per queue manager SMF and shared queue enhancements Starting from MQ V8 base • Availability: – May 2014 (eGA Distributed) – June 2014 (z/OS and pGA Distributed) • FixPack 4 on Distributed platforms now available • FixPack 5 on Distributed platforms due in 2Q16 – No new function!
- 11. © Copyright IBM Corporation 2016 Incremental feature delivery • Features delivered since V8 GA on Distributed include • FP2: LDAP authorisation, Activity Trace • FP3: PAM, Updates to TLS ciphers, channel exit extension • FP4: Message Expiry Cap, Redistributable clients, Event formatter, Command/config events for security, mqcertck, TLS config verification, XA password obfuscation, MQ Light integration • And on z/OS • Message Expiry Cap, channel exit extension, CICS and IMS support for JMS, increased active logs • For more info, see youtube.com/marktaylorhursley
- 12. © Copyright IBM Corporation 2016 New environments for MQ since V8 GA • Support added for new environments to support simplified deployment • MQ 8.0.0.4 supported to run inside a Docker image. – Details: https://ibm.biz/mqdocker – Runs a queue manager inside a container, isolated from the rest of your system • MQ Support in IBM PureApplication V2.0 from MQ V8.0.0.3 onwards – Concept similar to hypervisor but software components separated from O/S – Drag and drop MQ onto Core O/S image to compose VM configuration • Sample cookbook for installing and configuring MQ using Chef – See https://github.com/ibm-messaging/mq-chef RFE 61962
- 13. © Copyright IBM Corporation 2016 Using MQ as a service • Not an environment, more a lifestyle choice! • Addresses the increasing demands on agility and scale of messaging infrastructures • As a service goes hand in hand with self service • Many clients have built MQ as a service today – Orchestration and automation of MQ resources • E.g. IBM Urbancode Deploy, Chef, Puppet, etc. – Running on bare metal or in a cloud • Redpaper now available http://ibm.biz/mqaas_red
- 14. © Copyright IBM Corporation 2016 MQ V9 Features
- 15. © Copyright IBM Corporation 2016 Overview • MQ V9 includes all of the MQ V8 FixPack/PTF features • A convenient roll-up, single install • And V9.0 is the starting-point for the new delivery streams
- 16. © Copyright IBM Corporation 2016 Central provisioning of CCDT • Client Channel Definition Table is method to configure MQ client connectivity – Usually pushed out to client machines from a central point to local filesystems • Java and .Net clients have been able to refer to CCDT via URI – Automatically retrieved from http or ftp address • Now also available for C clients to simplify provisioning – export MQCCDTURL="ftp://ccdt.example.com/ccdt/MyApp.ccdt" MQ Client MQCONN() ftp server: CCDT QMgr MQ Client MQCONN()
- 17. © Copyright IBM Corporation 2016 AMS – high performance policy • New quality of service for Advanced Message Security feature – We have Integrity to prove authenticity through signing – And Privacy which adds encryption to the authenticity • We are adding Confidentiality to provide encryption without the digital signing – Significant performance gains over Integrity and Privacy – Especially with key reuse • Available for Distributed and z/OS
- 18. © Copyright IBM Corporation 2016 AMS Confidentiality performance 0 5000 10000 15000 20000 25000 RoundTrips/sec Quality of Protection AMS Throughput Comparison AMS Off AMS Privacy AMS Confidential 0 AMS Confidential 2 AMS Confidential 16 AMS Confidential Unlimited 0 5 10 15 20 25 30 35 ClientCPU% Quality of Protection AMS CPU Comparison AMS Off AMS Privacy AMS Confidential 0 AMS Confidential 2 AMS Confidential 16 AMS Confidential Unlimited 2K Persistent Message 20 Requesters
- 19. © Copyright IBM Corporation 2016 AMS support for non-IBM JREs • AMS interceptor for Java programs relied on IBM-provided encryption packages – Included in the JRE/JSSE shipped with MQ and other IBM products – But not available separately for integration with other JREs • With V9, AMS layer has been redesigned to use an alternative crypto library – The open source Bouncy Castle implementation – Built into the MQ Java classes, not the Java Runtime Environment • Can now use alternative JREs with no need to install additional libraries RFE 45817, 72893
- 20. © Copyright IBM Corporation 2016 LDAP Authorisation for Windows • V9 for Windows includes direct LDAP-based authorisation model – Same implementation as 8.0.0.2 on other Distributed platforms • Enables use of a common repository for userid and group information • New attributes on AUTHINFO/IDPWLDAP object show how to discover groups – Very similar to the authentication attributes for discovery of identities setmqaut –t qmgr –p "cn=User 1,ou=users,o=ibm,c=uk" +connect setmqaut –t qmgr –g "cn=Group 1,ou=groups,o=ibm,c=uk" +connect RFE 32813
- 21. © Copyright IBM Corporation 2016 Activity Trace • Application Activity Trace now available via pub/sub without additional config – Can have multiple consumers of information • Subscribe to special topics – $SYS/MQ/INFO/QMGR/<qmgr>/ActivityTrace/ApplName/amqsputc • Filter by application name, channel or connection id • Previous configuration only allowed program name filters – Wildcards supported • Once subscription is created, PCF messages flow to subscriber • Distributed platforms only RFE 55753
- 22. © Copyright IBM Corporation 2016 Activity Trace Example $ amqsact -m V9000_A -a amqsput -w 60 Subscribing to the activity trace topic: '$SYS/MQ/INFO/QMGR/V9000_A/ActivityTrace/ApplName/amqsput' MonitoringType: MQI Activity Trace … QueueManager: 'V9000_A' ApplicationName: 'amqsput' Application Type: MQAT_UNIX … ============================================================================= Tid Date Time Operation CompCode MQRC HObj (ObjName) 001 2016-04-14 09:56:53 MQXF_CONNX MQCC_OK 0000 - 001 2016-04-14 09:56:53 MQXF_OPEN MQCC_OK 0000 2 (SYSTEM.DEFAULT.LOCAL.QUEUE) 001 2016-04-14 09:56:53 MQXF_PUT MQCC_OK 0000 2 (SYSTEM.DEFAULT.LOCAL.QUEUE) 001 2016-04-14 09:56:53 MQXF_CLOSE MQCC_OK 0000 2 (SYSTEM.DEFAULT.LOCAL.QUEUE) 001 2016-04-14 09:56:53 MQXF_DISC MQCC_OK 0000 - =============================================================================
- 23. © Copyright IBM Corporation 2016 System Monitoring • More statistics available via a pub/sub model • Includes CPU and Disk usage – As well as MQ statistics • Subscribe to meta-topic to learn which classes of statistics are available – $SYS/MQ/INFO/QMGR/<qmgr>/Monitor/METADATA/CLASSES – Then subscribe to specific topics – See amqsrua sample program • Distributed platforms only RFE 71123
- 24. © Copyright IBM Corporation 2016 System Monitoring Example $ amqsrua -m V9000_A CPU : Platform central processing units DISK : Platform persistent data stores STATMQI : API usage statistics STATQ : API per-queue usage statistics Enter Class selection ==> CPU SystemSummary : CPU performance - platform wide QMgrSummary : CPU performance - running queue manager Enter Type selection ==> SystemSummary Publication received PutDate:20160411 PutTime:10465573 User CPU time percentage 0.01% System CPU time percentage 1.30% CPU load - one minute average 8.00 CPU load - five minute average 7.50 CPU load - fifteen minute average 7.30 RAM free percentage 2.02% RAM total bytes 8192MB
- 25. © Copyright IBM Corporation 2016 Command recall and editing for runmqsc on Unix • When running runmqsc on Unix/Linux platforms you can now use cursor keys – And common editing control sequences (emacs/vi modes) – Much easier to fix bad typing • Similar to what has always been available on Windows • With a new capability of command completion – Hit TAB to cycle through and accept possible keywords
- 26. © Copyright IBM Corporation 2016 Command completion example
- 27. © Copyright IBM Corporation 2016 Command completion example
- 28. © Copyright IBM Corporation 2016 Command completion example
- 29. © Copyright IBM Corporation 2016 Updated MQ Unicode support • MQ now supports CCSIDs which contain "upper plane" Unicode characters – Both z/OS and Distributed platforms • This includes requirements for Chinese characters • Support added for input and output in – UTF-16 surrogate pairs – UTF-32 (on distributed platforms only) – Extending UTF-8 support for 4 byte characters. RFE 35637, 58573
- 30. © Copyright IBM Corporation 2016 SMF statistics for pageset usage • New SMF information – capacity planning: eg how much is my pageset utilization increasing? – problem resolution: eg why are private messages slow? – system management: eg which pageset should I move into a different buffer pool? • This allows you to see early indicators of pageset storage shortage • Same data as returned by the DISPLAY USAGE TYPE(PAGESET) command – SMF makes it easier for automation tools to analyse RFE 79681
- 31. © Copyright IBM Corporation 2016 Sample z/OSMF Workflows • z/OSMF allows you to manage aspects of z/OS systems through a browser – Workflows can be implemented to automate tasks • MQ V9 for z/OS provides sample workflows to provision MQ resources – The end user needs little or no z/OS Skills • Workflows can be used to: – Automate the provisioning/de-provisioning of MQ resources – Rapidly stand-up/down MQ resources for development/test purposes – Create (pools of) resources for use in an on-premise cloud environment – Address future z/OS skills shortage • Workflows can be customized to meet user needs – Run via the z/OSMF Web UI or via REST APIs
- 32. © Copyright IBM Corporation 2016 Managed File Transfer • Enhanced FTP diagnostics and problem handling – Comprehensive fine grain coverage of FTP errors – Enhanced logging of FTP communications for post diagnosis RFE 66425
- 33. © Copyright IBM Corporation 2016 IBM MQ Summary • IBM MQ has been regularly delivering significant new function since MQ V8 – Through major releases and fix packs – V9 builds on those updates • Future releases will see a true continuous delivery of new function MQ V9.0.3 20172014 2015 2016 MQ V8.0.0 MQ V8.0.0.2 MQ V8.0.0.3 MQ V8.0.0.4 MQ V9.0.0 (announced) MQ V9.0.1 MQ V9.0.2 You are here (statement of direction) IBM MQ Appliance M2000 IBM MQ Appliance M2001 (announced) IBM MQ Appliance firmware update 4