Discover the Linux on z Systems Effect
1 like2,455 views
This document provides an overview of Linux on z Systems and IBM's efforts to enable the Linux on z Systems open source ecosystem. It discusses IBM's work porting popular open source software to run on Linux on z Systems, including languages, databases, messaging, and cloud infrastructure packages. It also outlines plans to provide tools and resources to help developers access Linux on z Systems hardware and obtain ported packages. The goal is to simplify and encourage open source software development for the Linux on z Systems platform.
Discover the Linux on z Systems Effect
- 1. © 2014 IBM Corporation 1 OSCON Jim Wasko, Vice President, Open Systems Development Dale Hoffman Marcel Mitran July 23, 2015 Discover the Linux on z Systems Effect: Open-source Ecosystem Enablement for Linux on z Systems
- 2. © 2014 IBM Corporation 2 © 2015 IBM Corporation 2 Agenda Linux on z Systems Overview Linux on z Systems Open Source Content HW access to z Systems Hardware Enabling access to the Open Source Products Future Directions The following content is not fully baked, but is intended for discussion for critique and input. We are still working through this and learning along the way… and will continue to seek guidance & prioritization from our customers!
- 3. © 2015 IBM Corporation 3 92 of the top 100 worldwide banks 23 of the top 25 US retailers 10 out of 10 of the world’s largest insurers 23 out of 25 of the world’s largest airlines O Processing the world’s transactions & data 55 percent of all enterprise applications need the mainframe to complete transactions 91 percent of surveyed CIOs said that new customer-facing applications are accessing the mainframe 30 billion 80 percent of the world’s corporate data resides or originates on mainframes business transactions processed on the mainframe per day World’s leading businesses run on the mainframe
- 4. © 2015 IBM Corporation 4 Traditional 1964–2014 • Batch • General Ledger • Transaction Systems • Client Databases • Accounts payable / receivable • Inventory, CRM, ERP Linux & Java 1999–2014 • Server Consolidation • Oracle Consolidation • Early Private Clouds • Email • Java®, Web & eCommerce CAMSS2 2015–2020 • On/Off Premise, Hybrid Cloud • Big Data & Analytics • Enterprise Mobile Apps • Security solutions • Open Source Linux on z ecosystem enablement 1964 20141999 2020 MIPS Traditional Open Systems CAMSS New marketplace dynamics will drive hyper growth opportunity for the IBM Mainframe 15 years of Enterprise Linux®on z Systems™ 1. MIPS :Millions of Instructions per Second or the metric z uses to measure client workload 2. CAMSS: Cloud, Analytics, Mobile, Social, Security 1
- 5. © 2015 IBM Corporation 5 Linux on z Systems value proposition: Premier quality of service at lowest platform total cost 1. IT economic advantage1 with: • Lowest Linux platform TCO for selected workloads & environments • Greenest server allowing upgradeability & investment protection 2. Highly efficient scaling with industry-leading levels of resource sharing & utilization • Scale up -High server capacity with up to 141 cores running at 5 GHz 3. An open and standard environment, with support for key open source software & applications 4. Integrated SOE/SOR environment for business processes – including cloud, analytics and mobile 5. Leadership levels of availability & disaster recovery, with non-disruptive growth of compute capacity 6. Leading security environment – EAL5+ support with high-speed cryptography 7. Cloud ready with support for multi-tenancy, rapid provisioning, scaling on demand 1. April, 2014 IBM Competitive Project Office Benchmark
- 6. © 2015 IBM Corporation 6 Open Source Linux SW Porting Completions & 2H15 Activity Languages and Dev Environment Database & Messaging Cloud infrastructure Node.js Ruby Rails Python LLVM OpenJDK, OpenJDK JIT GCCGO, Golang compiler oCaml, oCaml native compiler Erlang, Erlang native compiler Apache HTTP Web Server PHP/Zend R language Clojure Scala Swift (Apple) MySQL PostgreSQL MariaDB MongoDB Cassandra Redis CouchDB Cloudant (not open source) CouchBase Gemfire RabbitMQ Neo4j Docker Chef Puppet Openstack CloudFoundry OpenShift Ported - complete Work in progress To be started * Content and priority are subject to change Tier 1: Foundation Packages * • Focus areas: languages, databases, messaging, and cloud infrastructure • Porting work: for some packages, compilers, bug fixes, build script changes are required • The intent is to “dockerize” all ports Various sources of input: e.g. BlueMix, Github stats, feedback from: direct client input, IBM client reps, on going research
- 7. © 2015 IBM Corporation 7 Open Source Linux SW Porting Completions & 2H15 Activity App development & DevOps Configuration, monitoring management and tools Big Data & Analytics Web Application Development eCommerce & Application server Xerces-c XMLSec protobuf Doxygen ANTLR Maven Apigility .Net Node.js extended components Jenkins Fluentd SaltStack cAdvisor virt-install Ansible Zenoss Zookeeper DataDog ElasticBox Hadoop not open source - Veristorm & BigInsights) Apache Hadoop HortonWorks Apache SPARK ELK (Elasticsearch, Logstash, Kibana) SugarCRM Apache Kafka DruPal Joomla Solr jMeter Wordpress Ceilometer Apache Tomcat HAProxy NGNIX Magento X-Cart jBoss Ported - complete Work in progress To be started Tier 2: Popular Tools and Applications* • Focus areas: dev tools, configuration management, big data analytics, web development, ecommerce, application server • Many of these packages should just work on Linux on z without porting effort, especially if they are written in Java or supported languages and RHEL/SLES are among supported distros. • The ecosystem team is validating following packages per customer request • The intent is to “dockerize” all ports * Content and priority are subject to change
- 8. © 2015 IBM Corporation 8 Example: Enabling Docker for Linux on z Systems • IBM built Docker on Linux on z with gccgo • Binaries for technology preview available now (RHEL 7 and SLES 12) – http://www.ibm.com/developerworks/linux/linux390/docker.html – Instructions on setting up and building base images: • http://containerz.blogspot.ca/2015/03/first-steps-with-docker.html • http://containerz.blogspot.ca/2015/03/creating-base-images.html – Create a Docker image that runs a private repository on Linux on z • Same instruction as for other platforms: • https://github.com/docker/docker-registry/blob/master/ADVANCED.md • IBM-managed images to be uploaded to ibmcom namespace in Docker Hub – Linux on z images are named with “_s390x” suffix, until multi-arch support is available • Docker is Docker is Docker… on Linux on z too! • Follow our blog: http://containerz.blogspot.com/
- 9. © 2015 IBM Corporation 9 Dockercon demo: Power and z Systems participation in Docker eco system Developer creates an airline reservation application using Docker with components of the solution run in containers on Power and z Systems. App is created on a laptop, compiled with a build service for Power8 and z13 containers and then using Docker compose and swarm to push the web front-end to Power8 systems and the MongoDB backend z Systems http://www.ustream.tv/recorded/64657419
- 10. © 2014 IBM Corporation 10 © 2015 IBM Corporation 10 Hardware access to z Systems Desire ISVs, developers and students to remote access z hardware Syracuse University: Announcing the z Systems Community Cloud Register for a free Linux on Sys z Virtual Machine (contact evalyan@us.ibm.com) 4 Clicks and 5 minute to your own virtual mainframe Develop port and test on your own z System Cloud management with IBM Wave for z/VM & Cloud Manager for Open Stack IBM Chiphopper™ Program Application porting or rehosting program designed to help IBM Business Partners enable, test and support their existing x86 Linux applications running on non IBM platforms onto IBM System z running Red Hat Enterprise Linux or SUSE Linux Enterprise Server — at no cost Coming soon: z Personal Development Tool (zPDT) technology running on bare metal servers at IBM Softlayer Participating in Bountysource.com to provide bounties for specific open source packages, building tool chains, bug fixes or performance enhancements Main page: https://www.bountysource.com/teams/ibm Bounties page: https://www.bountysource.com/teams/ibm/bounties
- 11. © 2015 IBM Corporation 11 Linux on z Open-source Ecosystem Community – Phase 1 • We have created a developerWorks community; visit us today! • https://www.ibm.com/developerworks/community/groups/community/lozopensource/ • Information on all open-source software we have brought to Linux on z: • Recipes for building the software on Linux on z • Pointers to binaries if available • Other related news and information • Source code repositories and build instructions maintained on GitHub • https://github.com/linux-on-ibm-z/docs/wiki/ • Open to every one interested in Linux on z Systems • Users can post questions/comments regarding Linux on z • Give feedback to the Linux on z Open-source Ecosystem team • We look forward to hearing from you!
- 12. © 2015 IBM Corporation 12 Where to get packages Assets Where to get it? Apache HTTP https://github.com/linux-on-ibm-z/docs/wiki/Building-Apache-HTTP-server AntLR https://github.com/linux-on-ibm-z/docs/wiki/Building-AntLR Ceilometer client https://github.com/linux-on-ibm-z/docs/wiki/Building-Python-Ceilometer-client Chef client & server https://github.com/linux-on-ibm-z/docs/wiki/Building-Chef-client-12.1.2 https://github.com/linux-on-ibm-z/docs/wiki/Building-Chef-server-12.0.4 CouchDB https://github.com/linux-on-ibm-z/docs/wiki/Building-CouchDB Docker http://www.ibm.com/developerworks/linux/linux390/docker.html Doxygen https://github.com/linux-on-ibm-z/docs/wiki/Building-Doxygen Erlang https://github.com/linux-on-ibm-z/docs/wiki/Building-Erlang-on-RHEL7 https://github.com/linux-on-ibm-z/docs/wiki/Building-Erlang-on-SLES12 Fluentd https://github.com/linux-on-ibm-z/docs/wiki/Building-Fluentd Go (GCCGO) https://github.com/linux-on-ibm-z/docs/wiki/Building-gccgo MariaDB https://github.com/linux-on-ibm-z/docs/wiki/Building-MariaDB-10.0 Maven https://github.com/linux-on-ibm-z/docs/wiki/Building-Maven MongoDB https://github.com/linux-on-ibm-z/docs/wiki/Building-MongoDB https://github.com/linux-on-ibm-z/docs/wiki/Building-MongoDB-3.0-on-RHEL-6-and-SLES-11 MySQL https://github.com/linux-on-ibm-z/docs/wiki/Building-MySQL
- 13. © 2015 IBM Corporation 13 Where to get packages Assets Where to get it? Node.JS https://nodejs.org/download/ oCaml Interpreter https://github.com/linux-on-ibm-z/docs/wiki/Building-oCaml-interpreter PHP https://github.com/php/php-src/blob/PHP-5.6.8/INSTALL PostgreSQL https://github.com/linux-on-ibm-z/docs/wiki/Building-PostgreSQL-9.4-on-SLES12 https://github.com/linux-on-ibm-z/docs/wiki/Building-PostgreSQL-9.4-on-RHEL7 https://github.com/linux-on-ibm-z/docs/wiki/Building-PostgreSQL-9.4-on-SLES11 https://github.com/linux-on-ibm-z/docs/wiki/Building-PostgreSQL-9.4-on-RHEL6 Protobuf https://github.com/linux-on-ibm-z/docs/wiki/Building-ProtoBuf Puppet https://github.com/linux-on-ibm-z/docs/wiki/Building-Puppet Python https://github.com/linux-on-ibm-z/docs/wiki/Building-Python-2.7.9 https://github.com/linux-on-ibm-z/docs/wiki/Building-Python-3.4.3 RabbitMQ https://github.com/linux-on-ibm-z/docs/wiki/Building-RabbitMQ-on-SLES https://github.com/linux-on-ibm-z/docs/wiki/Building-RabbitMQ-on-RHEL Redis https://github.com/antirez/redis/releases/tag/3.0.1 Ruby-on-Rails http://guides.rubyonrails.org/getting_started.html Ruby https://github.com/linux-on-ibm-z/docs/wiki/Building-Ruby Snappy-Java https://github.com/linux-on-ibm-z/docs/wiki/Building-Snappy-Java V8 https://github.com/linux-on-ibm-z/docs/wiki/Building-V8-libraries Xerces-C https://github.com/linux-on-ibm-z/docs/wiki/Building-Xerces XMLSec https://github.com/linux-on-ibm-z/docs/wiki/Building-XMLSec
- 14. © 2015 IBM Corporation 14 Future Directions • Continue to port foundational and popular Linux software to z • Help open-source projects optimize their code on z hardware • Simplify access to open-source software for Linux on z Systems • An online system for packaging software for Linux on z, and distributing them to clients • Some ideas being considered: • Docker containers for fast and painless application development and testing • RPM-based package repository that eases deployment on major distributions • Collaborate with distributions to expand coverage for z Systems
- 15. © 2015 IBM Corporation 15 Backups
- 16. © 2015 IBM Corporation 16 Acknowledgements • None of this work would be possible without the outstanding contributions from our Linux on z Systems Open Source Ecosystem Leadership Team, our Linux on z Systems Performance teams and Ecosystem Partners: Platform Technology Computing & Persistence Labs in India • Ecosystem Leadership Team: Bryan Chan, Mike Cox, Cheryl Fraser, Cindy Lee, Mohammad Abdirashid, Enyu Wang • Performance Leadership Team: Tarun Chopra, Moriyoshi Ohara, Hartmut Penner, Stefan Wirag, Otto Wohlmuth
- 17. © 2015 IBM Corporation 17 Trademarks The following are trademarks of the International Business Machines Corporation in the United States and/or other countries. Notes: Performance is in Internal Throughput Rate (ITR) ratio based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput that any user will experience will vary depending upon considerations such as the amount of multiprogramming in the user's job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve throughput improvements equivalent to the performance ratios stated here. IBM hardware products are manufactured from new parts, or new and serviceable used parts. Regardless, our warranty terms apply. All customer examples cited or described in this presentation are presented as illustrations of the manner in which some customers have used IBM products and the results they may have achieved. Actual environmental costs and performance characteristics will vary depending on individual customer configurations and conditions. This publication was produced in the United States. IBM may not offer the products, services or features discussed in this document in other countries, and the information may be subject to change without notice. Consult your local IBM business contact for information on the product or services available in your area. All statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only. Information about non-IBM products is obtained from the manufacturers of those products or their published announcements. IBM has not tested those products and cannot confirm the performance, compatibility, or any other claims related to non-IBM products. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products. Prices subject to change without notice. Contact your IBM representative or Business Partner for the most current pricing in your geography. This information provides only general descriptions of the types and portions of workloads that are eligible for execution on Specialty Engines (e.g, zIIPs, zAAPs, and IFLs) ("SEs"). IBM authorizes customers to use IBM SE only to execute the processing of Eligible Workloads of specific Programs expressly authorized by IBM as specified in the “Authorized Use Table for IBM Machines” provided at www.ibm.com/systems/support/machine_warranties/machine_code/aut.html (“AUT”). No other workload processing is authorized for execution on an SE. IBM offers SE at a lower price than General Processors/Central Processors because customers are authorized to use SEs only to process certain types and/or amounts of workloads as specified by IBM in the AUT. The following are trademarks or registered trademarks of other companies. Adobe, the Adobe logo, PostScript, and the PostScript logo are either registered trademarks or trademarks of Adobe Systems Incorporated in the United States, and/or other countries. Cell Broadband Engine is a trademark of Sony Computer Entertainment, Inc. in the United States, other countries, or both and is used under license therefrom. Intel, Intel logo, Intel Inside, Intel Inside logo, Intel Centrino, Intel Centrino logo, Celeron, Intel Xeon, Intel SpeedStep, Itanium, and Pentium are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries. IT Infrastructure Library is a registered trademark of the Central Computer and Telecommunications Agency which is now part of the Office of Government Commerce. ITIL is a registered trademark, and a registered community trademark of the Office of Government Commerce, and is registered in the U.S. Patent and Trademark Office. Java and all Java-based trademarks and logos are trademarks or registered trademarks of Oracle and/or its affiliates. Linear Tape-Open, LTO, the LTO Logo, Ultrium, and the Ultrium logo are trademarks of HP, IBM Corp. and Quantum in the U.S. and Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both. Microsoft, Windows, Windows NT, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both. OpenStack is a trademark of OpenStack LLC. The OpenStack trademark policy is available on the OpenStack website. TEALEAF is a registered trademark of Tealeaf, an IBM Company. Windows Server and the Windows logo are trademarks of the Microsoft group of countries. Worklight is a trademark or registered trademark of Worklight, an IBM Company. UNIX is a registered trademark of The Open Group in the United States and other countries. Node.js is an official trademark of Joyent. IBM SDK for Node.js is not formally related to or endorsed by the official Joyent Node.js open source or commercial project. Java, JavaScript and all Java-based trademarks and logos are trademarks or registered trademarks of Oracle and/or its affiliates Chiphopper developerWorks* GDPS* GPFS HiperSockets HyperSwap* z13 z/Architecture* zEnterprise* z/OS* z/VM*
- 18. Notices and Disclaimers Copyright © 2015 by International Business Machines Corporation (IBM). No part of this document may be reproduced or transmitted in any form without written permission from IBM. U.S. Government Users Restricted Rights - Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM. Information in these presentations (including information relating to products that have not yet been announced by IBM) has been reviewed for accuracy as of the date of initial publication and could include unintentional technical or typographical errors. IBM shall have no responsibility to update this information. THIS DOCUMENT IS DISTRIBUTED "AS IS" WITHOUT ANY WARRANTY, EITHER EXPRESS OR IMPLIED. IN NO EVENT SHALL IBM BE LIABLE FOR ANY DAMAGE ARISING FROM THE USE OF THIS INFORMATION, INCLUDING BUT NOT LIMITED TO, LOSS OF DATA, BUSINESS INTERRUPTION, LOSS OF PROFIT OR LOSS OF OPPORTUNITY. IBM products and services are warranted according to the terms and conditions of the agreements under which they are provided. Any statements regarding IBM's future direction, intent or product plans are subject to change or withdrawal without notice. Performance data contained herein was generally obtained in a controlled, isolated environments. Customer examples are presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual performance, cost, savings or other results in other operating environments may vary. References in this document to IBM products, programs, or services does not imply that IBM intends to make such products, programs or services available in all countries in which IBM operates or does business. Workshops, sessions and associated materials may have been prepared by independent session speakers, and do not necessarily reflect the views of IBM. All materials and discussions are provided for informational purposes only, and are neither intended to, nor shall constitute legal or other guidance or advice to any individual participant or their specific situation. It is the customer’s responsibility to insure its own compliance with legal requirements and to obtain advice of competent legal counsel as to the identification and interpretation of any relevant laws and regulatory requirements that may affect the customer’s business and any actions the customer may need to take to comply with such laws. IBM does not provide legal advice or represent or warrant that its services or products will ensure that the customer is in compliance with any law.
- 19. Notices and Disclaimers (con’t) Information concerning non-IBM products was obtained from the suppliers of those products, their published announcements or other publicly available sources. IBM has not tested those products in connection with this publication and cannot confirm the accuracy of performance, compatibility or any other claims related to non-IBM products. Questions on the capabilities of non- IBM products should be addressed to the suppliers of those products. IBM does not warrant the quality of any third-party products, or the ability of any such third-party products to interoperate with IBM’s products. IBM EXPRESSLY DISCLAIMS ALL WARRANTIES, EXPRESSED OR IMPLIED, INCLUDING BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE. The provision of the information contained herein is not intended to, and does not, grant any right or license under any IBM patents, copyrights, trademarks or other intellectual property right. • IBM, the IBM logo, ibm.com, Bluemix, Blueworks Live, CICS, Clearcase, DOORS®, Enterprise Document Management System™, Global Business Services ®, Global Technology Services ®, Information on Demand, ILOG, Maximo®, MQIntegrator®, MQSeries®, Netcool®, OMEGAMON, OpenPower, PureAnalytics™, PureApplication®, pureCluster™, PureCoverage®, PureData®, PureExperience®, PureFlex®, pureQuery®, pureScale®, PureSystems®, QRadar®, Rational®, Rhapsody®, SoDA, SPSS, StoredIQ, Tivoli®, Trusteer®, urban{code}®, Watson, WebSphere®, Worklight®, X-Force® and System z® Z/OS, are trademarks of International Business Machines Corporation, registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A current list of IBM trademarks is available on the Web at "Copyright and trademark information" at: www.ibm.com/legal/copytrade.shtml.