Extreme Tiered Storage Flash, Disk, And Cloud
Download as PPTX, PDF2 likes938 views
Extreme tiered storage leverages flash, disk, and cloud storage to significantly reduce enterprise storage costs. By using flash for extreme performance, low-cost cloud for massive capacity, and advanced data movement, costs can be reduced while meeting business demands. Current tiered storage with disk alone has not lowered costs enough. Integrating flash, which provides fast random access at high cost, disk for capacity at medium cost, and cloud storage for massive low-cost capacity can fulfill the promise of tiered storage through improved efficiency and reduced budgets. Within a few years, products that fully integrate flash, disk, and cloud into extreme tiered storage architectures should be available.
Extreme Tiered Storage Flash, Disk, And Cloud
- 1. Extreme Tiered Storage:Flash, Disk, and CloudStephen FoskettStorage Expo NL, November 2009
- 2. AbstractThe explosion of digital media and unstructured data is flooding modern storage systems. Although per-GB cost has dropped, enterprise storage costs remain high. Tiered storage has not reduced the costs fast enough, but a new concept holds promise. By leveraging the extreme performance of flash, the low cost of cloud, and advanced data movement technologies, extreme tiered storage can deliver the reduction in storage costs demanded by business. This session presents the business and technical issues and an architecture to address them.
- 3. You Have an Impossible Mission!Reduce budgetsImprove performanceMeet business demands3
- 4. Storage Is Supposed To Be Getting Cheaper!Disk cost is dropping rapidly$250 buys:1994: 2 GB1999: 20 GB2004: 200 GB2009: 2000 GBBut enterprise storage costs keep rising!4
- 5. Tiered Storage to the Rescue!Storage capacity just keeps expanding…Larger files + More files = Growing volume of dataIT responded by…Consolidating on networked storage (SAN and NAS)Experimenting with HSM and ILMTiered storageBut…Storage systems getting more complex and expensiveManagement effort keeps growingCost savings aren’t materializing5
- 6. Where Is The Cost?Hardware and software make up a small percentage of total enterprise storage spending……and hard disk drive capacity makes up a small percentage of that!Data center/environmental, administrative personnel, maintenance, and data protection are much biggerThe biggest opportunity is inefficiency, but this has always been hard to tackle6
- 7. What If Disk Capacity Was Free?A thought experiment: What if disk space was free?The cost of hard disk drives drops to zero tomorrow - How will your usage patterns change?Will you use more or less?Will you manage capacity better or worse?Will your storage budget shrink or grow?Surprise!The cost of disk capacity is almost irrelevant to enterprise storage budgets!Even free disk capacity would not help save money, and it might even make things worseMassive capacity growth is making free disk capacity a reality!7
- 8. Let’s Get Real!We need to tackle the real issues in storage:Focus scarce management resourcesReduce budgets by tackling capacity utilization (finally!)Improve data protectionWhat’s stopping us?Data just keeps growingMainstream technology hasn’t changedPerformance bottlenecks limit effectivenessAlways firefighting, never rebuilding8
- 9. Fulfilling The Promise of Tiered StorageTiered disk storage has not yet lived up to its promiseSmall cost and performance differential between FC and SATA diskTCO is very closeSSD gives extreme performance at high costCloud storage gives massive capacity at low costTiered StoragePerformance and CostCapacity9Tiered StorageSSDFCDiskSATACloud
- 10. Flash!The new (old) buzzRAM vs. NAND flash vs. diskEMC was first with “tier-0”Sun, HP, NetApp adding flash to as a cacheGear6 caches NAS with RAM“Flash will replace high-speed disk”But…Are they reliable?Do they really perform that well?Will you be able to use them?Is the 10x-30x cost justified?Do they really save power?
- 11. Is Flash Reliable Enough?Notes: 1 – No one writes this fast 24x7 2 – Manufacturers claim 2x to 10x better endurance
- 12. Does Flash Perform?Flash offers unique performance characteristicsPro:Very fast random read with low latency and high consistencyLow power consumption and heat, low weight, compact sizeHigh mechanical reliabilityCon:Slower write performance, especially randomWrite performance declines with use and capacity12
- 13. Flash Is Not A DiskFlash must be carefully engineered and integratedCache and intelligence to offset write penaltyAutomatic block-level data placement to maximize ROIIF a system can do this, everything else improvesOverall system performanceUtilization of disk capacitySpace and power efficiencyEven system cost can improve!13
- 14. Then There’s Cloud StorageLike flash, cloud is currently over-hyped but also rapidly being adopted in the enterpriseLike flash, cloud has unique performance characteristics and economicsManaged service versus purchased systemHigh-latency internet/HTTP accessObject store versus conventional NASLike flash, cloud can make tiered storage a successPowerful economics from fully-managed service and pay-for-used pricing14
- 15. Public Cloud Storage EconomicsJust-in-Time ProvisioningPlan/buy for usage and not for peak capacityFully Managed StorageManaged GB = Power, space, cabling, racks, monitoring, software, hardware, migration to new media… all includedEnterprise Purchasing and Pricing ModelFlat, bundled price starts at $0.25/GB/month, $3K/TB/yearEnterprise sales, engineering, and support staffConsulting and strategy available15
- 16. Data Types Suitable for Cloud Storage16
- 17. Paths to the Cloud
- 18. Bringing Flash and Cloud to DiskCombining flash, cloud, and disk is radical but yields massive benefitsEach helps offset the shortcomings of the other and magnify the overall resultIntegrated products are starting to appear but none are yet completeMajor disk vendors adding solid state disks and automating volume-level tieringSmaller companies are introducing integrated flash caching and block-level tieringData movement vendors are adding cloud as a tier18
- 19. What’s Next?Flash and disk tiering will be fully integratedWide striping, thin provisioning, multi-parity, etc will kill conventional RAIDHigh-performance hard disk drives will disappearVMware-specific storage systems will be on the cutting edge of flash/disk integrationHigher-level applications (archiving, content management) will get integrated cloud storage firstFully-realized extreme tiered storage will be available within three years19