Stig Telfer - OpenStack and the Software-Defined SuperComputer
- 1. SOFTWARE-DEFINED SUPERCOMPUTER OPENSTACK AND THE Stig Telfer, Research Computing Services, Cambridge University
- 2. OPENSTACK AND THE SOFTWARE-DEFINED SUPERCOMPUTER ABOUT ME ▸ HPC ▸ Distributed systems ▸ HPC ▸ Software-defined networking ▸ HPC ▸ OpenStack ▸ HPC on OpenStack
- 3. “…AT THE SC14 SUPERCOMPUTING CONFERENCE IN NOVEMBER, CRAY ANNOUNCED THAT IT IS WORKING WITH CAVIUM TO DELIVER CLUSTERS BASED ON THE 48-CORE VARIANT OF THE THUNDERX CHIPS TO INVESTIGATE THE FEASIBILITY OF USING THESE CHIPS TO RUN HPC WORKLOADS…” The Next Platform February 27, 2015 OPENSTACK AND THE SOFTWARE-DEFINED SUPERCOMPUTER
- 4. OPENSTACK AND THE SOFTWARE-DEFINED SUPERCOMPUTER HPC VS CLOUD ▸ Performance is king ▸ OS and software stack ▸ Network ▸ Storage ▸ Telemetry and analytics
- 5. OPENSTACK AND THE SOFTWARE-DEFINED SUPERCOMPUTER CLOUD VS HPC ▸ Flexibility ▸ Self-service ▸ Consistency ▸ User-friendly
- 6. THE PROJECT CLOUD FOR HPC
- 7. OPENSTACK AND THE SOFTWARE-DEFINED SUPERCOMPUTER High-Speed Network Outside World Compute Management Network Compute Compute Compute Compute Compute Management Monitoring Storage … FIRST ITERATION ▸ Started with OpenStack Havana ▸ Economy hardware ▸ Diskless compute nodes ▸ Neutron networking ▸ Ironic bare metal ▸ Platform-as-a-Service use case
- 8. MAKE LEMONADE WHEN LIFE GIVES YOU LEMONS
- 9. OPENSTACK AND THE SOFTWARE-DEFINED SUPERCOMPUTER HACKED INTO SHAPE ▸ Ironic power driver for smart PDUs ▸ Neutron driver for SNMP- enabled switches ▸ Fixes for multi-homed bare metal hosts ▸ HPC-like diskless compute node instances High-Speed Network Outside World Compute Management Network Compute Compute Compute Compute Compute Management Monitoring Storage …
- 10. OPENSTACK AND THE SOFTWARE-DEFINED SUPERCOMPUTER Compute Management Storage NFS export Instance metadata cloud-init Ephemeral tmpfs Overlay rootfs Read-only NFS DISKLESS COMPUTE NODES ▸ NFS image exported read-only, common to all compute nodes ▸ Writeable ephemeral overlay mounted by initrd ▸ Instance metadata applied ▸ Largely implemented sideband of OpenStack
- 11. OPENSTACK AND THE SOFTWARE-DEFINED SUPERCOMPUTER Compute Management Storage Cinder attach iSCSI/iSER Instance metadata cloud-init Ephemeral tmpfs Overlay rootfs Read-only block device Image filesystem BETTER DISKLESS COMPUTE NODES ▸ Root image is Cinder volume ▸ Ironic + Cinder support ▸ Use iSER for Cinder protocol ▸ Read-only attach of Cinder volume ▸ Ramdisk applies ephemeral overlay ▸ Multi-attach of Cinder volume
- 12. OPENSTACK AND THE SOFTWARE-DEFINED SUPERCOMPUTER Storage Compute Workload Management Network Compute Workload High-Speed Network Management Storage Workload External Workload Internal Outside World NETWORKING FOR HPC ▸ Layer-2 protocols, eg RoCE ▸ RDMA is highly desirable ▸ Maximum latency dominates
- 13. WORKLOAD MANAGEMENT ITS NOT HPC WITHOUT
- 14. OPENSTACK AND THE SOFTWARE-DEFINED SUPERCOMPUTER ACHIEVING THE BEST OF BOTH WORLDS ▸ The flexibility of cloud without the performance overhead? ▸ The programming environment of HPC? ▸ A snowflake? ▸ What is next?
- 15. THANK YOU WATCH THIS SPACE…