Flash Storage Trends
1 like1,815 views
The document discusses flash storage trends and IBM's flash storage solutions. It provides an overview of storage technologies, including developments in hard disk drives and the emergence of flash memory. It then discusses IBM's flash storage portfolio, including all-flash arrays like the IBM FlashSystem which provide low latency flash performance for applications. The document outlines various deployment strategies for flash, like using Easy Tier to optimize capacity utilization across storage tiers.
Flash Storage Trends
- 1. Osys AG | Hofwiesenstrasse 350 | 8050 Zürich Telefon +41 44 317 18 19 | Fax +41 44 317 18 20 | office@osys.ch | www.osys.ch © 2012 Flash Storage Trends Osys Techtalk Werner Eggli Senior IT Specialist | werner.eggli@osys.ch September 2013
- 2. - Überblick Storage Technologie - IBM Flash Systems - Einsatz von Flash Technologie in IBM Storage Systemen
- 3. - Überblick Storage Technologie
- 5. Seite 5 Disk History 1956 IBM RAMAC first disk drive in the world approx. 5 MB storage, 1200 rpm access time > 600ms weight > 1ooo kg 1956 to 2013 12.5 times increase in RPM 240‘000 times increase in capacity (vs. SAS/1.2TB)
- 6. Seite 6 Hard Disk RPM Latency (ms) Seek (ms) IO/s * FC/SAS 15000 2 4 167 FC/SAS 10000 3 5 125 SATA/SAS 7200 4.2 9 76 - Performance Entwicklung - Performance heute: * 100% Random IO Rate per GB und Hard Disk Drive Generation 0.1 1 10 100 1000 1985 1990 1995 2000 2005 2010 IOPS/GB 15k RPM 10k RPM Desktop 5400 & 7200 <= 7200 RPM Seit 1990 um Faktor 100 schlechter
- 7. Seite 7 Annual Areal Density Growth Disk
- 8. Seite 8 - ATA, SATA, FATA, SAS (2.0), FC-Platten - 3 ½ Zoll vs. 2 ½ Zoll Formfaktor - GMR (Giant Magneto-Resistance) stark ausgereizt Hard Disk Heat Assisted Magnetic Recording (HAMR) Bit Patterned Media (BPM) Hard Disk - Roadmap Disk Technologie
- 9. Seite 9 Annual Areal Density Growth Rate Scenarios
- 10. Seite 10 Demo Hardware Platform Press release on Jan 22, 2010: http://www.zurich.ibm.com/news/10/storage.html Perpendicular Recording (senkrechte Bitanordnung) Ultrafeine Barium-Ferrit-Medien ohne Metallaufdampfen Reduktion der Spurabweichung auf unter 25 nm Spurbreite auf unter 0.45 µm (Faktor 25) Erhöhung S/L-Geschwindigkeit um Faktor 38 Archivierung und Langzeitdatenspeicherung riesige Kassettenkapazitäten stromloser austauschbarer Datenträger Linear Tape File System LTFS Tape Demonstration – 35 TB Kassette
- 11. Seite 11 Entwicklung der letzten 10 Jahre In the last 10 years: CPU Performance 8 - 10x increase DRAM Speed 7- 9x Network Speed 100x Bus Speed 20x Disk Speed 1.2X …and everything waits Source: IBM and Industry Estimates
- 12. Seite 12 SLC = Single Level Cell 1 Bit per Zelle 100.000 Schreibzyklen eMLC = Enterprise MLC 2 Bit per Zelle 30.000 Schreibzyklen MLC = Multi Level Cell 2 Bit per Zelle 3.000 Schreibzyklen TLC = Triple Level Cell 3 Bit per Zelle 1.000 Schreibzyklen Aufbau einer Flash Speicherzelle mit Floating Gate Oxydschicht Control Gate Floating Gate DrainSource P-Schicht N-SchichtN-Schicht 0 10 20 30 40 50 60 70 80 90 100 MLC eMLC SLC P/ECycles(Thousands) Flash Type Typical Chip Endurance Flash Technologie
- 13. Seite 13 Reale Haltbarkeit ist Device abhängig Kalkulierbare Haltbarkeit: SLC Flash Konfiguration 10 TB, 1 GBps Schreiben eMLC Flash Konfiguration 10 TB, 1 GBps Schreiben MLC Flash Konfiguration 10 TB, 1GBps Schreiben EnduranceYears GBps TB 7.31 1 000,10010 EnduranceYears GBps TB 5.9 1 000,3010 yearathanLess GBps TB 1 000,310
- 14. Seite 14 Flash Preisentwicklung per GB • SLC Chips halten 35 x länger vs. MLC und 3 x länger vs. eMLC • Preis SLC vs. eMLC 2:1 • Preis SLC vs. MLC 8:1 • eMLC Chips halten 10 x länger vs. MLC • Preis 4:1 vs. MLC
- 15. Seite 15ibm.comstorageflash Solid State Disk Drive Performance Comparison
- 16. Seite 16 Flash V-NAND (Samsung Announcement 13. AUG 2013)
- 17. Seite 17 Leistungsklasse Flash Antwortzeiten 1ns 500µs 1000ns 1µs 500ns 1ms 1000µs DRAM L1 L2 .. LX Kosten Leistungsklasse „Flash“ Storage Class Memory SCM (PCM, Phase Change Memory) Flashspeicher
- 18. Seite 18 • Magnetic Pattern auf Nano-Drähten • Permalloy (FeNi-Legierung) • Leistung im Nano-Sekunden Bereich • Fast keinen Stromverbrauch • Dreidimensionale Chip Technologie • 100 Bits per Draht, mehrere ...Millionen.Drähte per Chip • 100-1000 fach höhere Kapazitäten zu ...Flash Memories Stuart Parkin •Louis Neel Medaille (2009) •IUPAP-Award (2009) (International Union of Pure and Applied Physics-magnetism) Racetrack Memory Chips
- 19. Seite 19 Neuordnung der Speicherhierarchie Storage Class Memory (SCM) Archivierung CPU RAM DISK CPU SCM (PCM) TAPE RAM CPU DISK FC, SATA, SAS TAPE2013 1980 2018+ Aktiver SpeicherMemoryLogik TAPE DISK SATA/SAS FLASHRAM Memory like … storage like
- 20. Seite 20 • Consumer disk and enterprise tape will persist for the foreseeable future • Flash will come into its own • Flash may drive out enterprise disk, and if it doesn’t, SCM will • When will SCM arrive? That will depend on the path the NAND industry takes after the 16-20nm node… • 3-D NAND succeeds: new NVMs (such as PCM, RRAM, STT-RAM) will develop slowly, driven only by SCM/embedded market • 3-D NAND fails or is late: one new NVM will be driven rapidly by NAND market • If the latter, SCM could become the dominant storage technology by 2020 • The application software stack will be redesigned to utilize SCM-enabled persistent memory What does the future hold?
- 21. - Überblick Storage Technologie - IBM Flash Systems
- 22. Seite 22 Tape-Libraries Jaguar LTO V7000 / V7000U XIV VTL-Systeme SVCV3700 DS8870 ManagementTivoli SW Flex-Systems Infrastrukutur und Software Storwize Familiy Enterprise Systeme Data Protection- Retention IBM Storage Portfolio Q2 2013
- 23. Seite 23 300+ Customers In over 50 countries 30+ Patents Strong IP Base 34 Year History Deep Expertise Recognized by IBM Research PROVEN FLASH TECHNOLOGY LEADER Why TMS?
- 24. Seite 24 Accelerate critical applications and unleash the power of performance IBM FlashSystem offers extreme performance, low latency and enterprise attributes to handle fast moving operational data in real time Completing the Flash Pyramid with All-Flash Arrays
- 25. Seite 25 •Shipped over 72 Petabytes of Flash storage in 2012 •Broad array of products to fit a wide variety of client needs •Varying capacity and performance to match client workloads •Several form factors to fit into varying needs of datacenter real estate EXP30 Ultra SSD Drawer eXFlash IBM High IOPS Adapters Storwize V7000/3700 DS8000 IBM Delivers Flash-Based Products in all Segments IBM FlashSystem XIV IBM Flash Portfolio
- 26. Seite 26 Tape HDD Form Factor SSD PCIe SSD Seconds 5-15 milliseconds ~1 milliseconds < 1 millisecond IBM FlashSystem 100 microseconds …consistent latency 1U up to 20TB 1 second = 1 million microseconds Systems Comparison
- 27. Seite 27 I/O Serviced by Disk 1. Issue I/O request ~ 100 μs 2. Wait for I/O to be serviced ~ 5,000 μs 3. Process I/O ~ 100 μs Time to process 1 I/O request = 200 μs + 5,000 μs = 5,200 μs CPU Utilization = Wait time / Processing time = 200 / 5,200 = ~4% Time Processing ~100 µs ~100 µs Waiting ~5,000 µs 1 I/O Request CPU State I/O Serviced by IBM FlashSystem 1. Issue I/O request ~ 100 μs 2. Wait for I/O to be serviced ~ 200 μs 3. Process I/O ~ 100 μs Time to process 1 I/O request = 200 μs + 200 μs = 400 μs CPU Utilization = Wait time / Processing time = 200 / 400 = 50% Time Processing ~100 µs ~100 µs Waiting ~200 µs 1 I/O Request CPU State 12X Application benefit: CPU and Application Efficiency Gain Microsecond latency maximizes CPU utilization and efficiency
- 28. Seite 30 SLC Flash eMLC Flash Model 710 720 810 820 Usable Capacity 1-5 TB (1 TB increments) 5 or 10 TB (6 or 12 TB RAID 0) 2-10 TB (2 TB increments) 10 or 20 TB (12 or 24 TB RAID 0) Latency (R/W) 90/25 us 90/25 us 110/25 us 110/25 us IOPS 450K 500K 400K 450K Bandwidth 4 GB/s 5 GB/s 4 GB/s 4 GB/s Interfaces 4x 8Gbit FC or 4x 40Gbit IB 4x 8Gbit FC or 4x 40Gbit IB Data Protection VSR™ 2D Flash RAID™ (inc. VSR™) VSR™ 2D Flash RAID™ (inc. VSR™) All units 1U form factor, less than 500 Watts IBM/TMS Shared Flash Systems
- 29. Seite 31 • 1 Petabyte: 1 Floor Tile • 100 microsecond latency • 22 Million IOPS • 210 GB/s • 12.6 KW power Less power than the average 200TB array 22 Million IOPS Alternative 1 Rack 1 Petabyte, 1 rack. What it means
- 30. - Überblick Storage Technologie - IBM Flash Systems - Einsatz von Flash Technologie in IBM Storage Systemen
- 31. Seite 33 Delivered with IBM on-site Integration Extreme Performance Enterprise Capabilities SAN Volume Controller Extreme Performance with IBM MicroLatency™ All Flash 20 TB RAIDed data capacity Macro Efficiency 1U form factor Variable Stripe RAID and 2-D RAID for Enterprise Reliability IBM FlashSystem 820 Business Continuity with Copy Services Flash Copy for Backup & Optimal Workload Availability $/TB Value with Thin Provisioning & Real Time Compression Drive Storage Efficiency with Easy Tier High performance enterprise class featured solution Skalierbar bis 1.3M IOPs für höchste Anforderungen an Performance, Funktionalität und Zuverlässigkeit IBM FlashSystem Solution
- 32. Seite 34 OLTP Databases – Financial, gaming, real-time billing, trading, real-time monitoring, query acceleration (DB2/Oracle), etc. Analytical applications (OLAP) – Business intelligence, batch processing, ERP systems, reporting, massive data feeds, etc. Virtual Infrastructures – VDI, Consolidated virtual infrastructures, user profiles, etc. HPC/Computational Applications – Simulation, modeling, rendering, FS metadata, scratch space, video on demand, thread efficiency, etc. Cloud-scale Infrastructures – On-demand computing, content distribution, web, caching, metadata, GPFS, active file management, etc. Financial Government E-Commerce HPC Telecom Application Sweet Spots: Do More, Do it Faster!
- 33. Seite 35 Manual Data Placement • Best performance Easy Tier • Best capacity efficiency Preferred Read • Massive acceleration and preserves storage investment IBM Flash Deployment Strategies Review
- 34. Seite 36 Vollautomatisches Verfahren, das die Zugriffe auf jeden Datenblock fortwährend analysiert und zwischen den vorhandenen Speicher-Klassen verschiebt und so eine optimale Verteilung der gespeicherten Daten über die vorhandenen Speicher-Ressourcen sicherstellt. Steht sowohl für Speichersysteme als auch für die IBM Speicher-Virtualisierungs-Lösung zur Verfügung so dass auch ein Tiering zwischen verschiedenen Speichersystemen möglich wird. Für Easy Tier/DS8870 stehen Schnittstellen zur Verfügung, mit denen Administratoren und Applikationen Einfluß auf die Daten- platzierung nehmen und so die Leistungs- fähigkeit der Systeme zusätzlich optimieren können. SSD RAID Array(s) FC/SAS RAID Array(s) SATA RAID Array(s) Easy Tier Application Data Placement IBM Easy Tier Selbstoptimierende Speicher-Infrastrukturen
- 35. Seite 37 IBM Storwize Family
- 36. Seite 38 Benefits – performance, high availability SVC stores two copies of a volume (copy0/copy1) – Reads from primary copy (c0) - “Preferred Read” – Writes to both copies (c0 and c1) – Primary copy may be dynamically changed – Easy to use – just add a copy to an existing volume Single volume presented to host server A local high availability function – Each copy of the volume is on a separate storage system – If disk supporting one copy is unavailable, SVC provides continuous data access from the other copy – Copies are automatically resynchronized when disk is available again Copies can be split – Either copy can continue as production copy Either or both copies may be thin-provisioned – Efficient utilization of FlashSystem Write to both copies SVC IBM FlashSystem 820 Legacy or new disk storage in SVC environment Server SVC Volume Mirroring & Preferred Read
- 37. “The IBM FlashSystem solution also allows us to identify and address potential customer issues faster, helping us to maintain and build our subscriber numbers—which is absolutely the most critical metric in our industry.” -Karim Abdullah, Director of IT Operations Enterprise Data Center Shared Services, Sprint Nextel Sprint drives 45-times performance improvement! The need Sprint Nextel call-center operatives need fast, reliable access to data on accounts, usage and billing. The solution Sprint Nextel deployed nine IBM® FlashSystem™ 820 solutions with a total of 150 TB of eMLC flash, virtualized and managed through IBM System Storage® SAN Volume Controller. The benefit • Cut latency by 10x • Reduced Energy Consumption • Easy integration into existing environment Click here to read full story.
- 38. Seite 4040 XIV SSD Read Cache SSD field upgrade – XIV Gen3 hardware is SSD ready – In order to activate SSD feature, all modules must have SSD feature installed – XIV Gen3 v11.1 required, no downtime required SSD maintenance - no data loss – Can be phased out, tested, replaced and phased in – Only contains read data • XIV redundant data scheme unchanged – We do not protect this data in any way - no need – Reads are redirected RAM SSD as CACHE Non-SSD Drives System Module
- 39. Seite 41 Core ERP (IOPS) CRM and Financial DB Workload 70/30/8k Medical Record App Server (RT) Healthcare EMR Workload 100% random IO DB2 Brokerage (IOPS) Heavy Random Brokerage 90/10, Mixed block IO 84% Random Read Miss Websphere Datastore (IOPS) Web 2.0 OLTP Workload 80/20/4k Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput that any user will experience will vary depending upon considerations such as the amount of multiprogramming in the user's job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve throughput improvements equivalent to the performance ratios stated here. Outstanding Applications Performance with SSD Caching 41
- 40. Seite 43 Greater Exploitation of Flash All-HDD Hybrid with Easy Tier All-flash 5-15 milliseconds ~ 1 millisecond < 1 millisecond Enterprise-class DS8000 flash evolution
- 41. Seite 44 IBM Power p / DS8000 integration Easy Tier Server is an architecture: A Host flash-cache based on IBM research technology using IBM flash hardware (Easy Tier Caching Client) Easy Tier based algorithms for automatic application aware system-wide optimization (Easy Tier / Easy Tier Caching Server) A proprietary protocol provides in band (SAN) communication and coherency Hosts (Caching Clients) Work independently to cache their applications IO streams providing real-time performance enhancement Use the Cooperative Caching protocol to have cooperative system-aware caching that interfaces with IBM Storage running the Cooperative Caching Server Host Caching Client IBM Server IBM Server Host Caching Client Easy Tier Caching Server DS8870 Flash Cache SAN Flash Cache SSD HDD Easy Tier 5 - Easy Tier Server Overview
- 42. Seite 45 1,056 15k hard disk drives (today) 224 flash drives (today) 146GB 15k (RAID 10) 2Q13All-Flash (RAID 5) YE13 All-Flash (RAID 5) Usable Capacity 72TB usable performance optimized comparison point Raw Capacity 1.72x 1x 1x Response Time ~ 1ms ~ 0.3ms ~ 0.1ms Floor space 1.33x 1X 0.66x Energy Usage 13.9kw 5.7kw ~ 5.0kw ¢ / GB / IOP 1x ~ 1x < 1x 224 flash drives (4Q13) DS8800 All Flash: Today and Tomorrow
- 43. Seite 46 Tape tier storage: – Improve cost structure of Easy Tier storage – Maximize performance / cost benefit – Automatically migrate idle extents to tape tier – Extents restore to disk when accessed – Perfect for medical photos, digital library, Cloud, & video streaming applications Benefits – Eliminate the management cost of archive/restore process • Tape data appear as online to users – Reduce $/GB – Reduce energy expense – Reduce floor space usage Performance and Efficiency- 1H14 SSD Enterprise Disk Nearline Disk Tape EasyTierDataMovement DS8000 Tape Storage for Easy Tier (planned)
- 44. Seite 47