The State of Software Defined Storage Survey 2015
2 likes1,171 views
The 2015 State of Software-Defined Storage survey, conducted by DataCore Software, analyzed expectations and experiences of 477 IT professionals regarding software-defined storage (SDS) technology. Key findings indicate that the primary drivers for SDS include extending the life of existing storage assets and economic benefits, while challenges such as application performance degradation and human errors have emerged post-virtualization. The survey also highlights a shift towards hyper-converged and cloud storage solutions, though many respondents reported disappointments with anticipated technologies like big data and flash storage integration.
The State of Software Defined Storage Survey 2015
- 1. The State of Software-Defined Storage (SDS) 2015 Market Survey Date conducted: April, 2015 Copyright 2015 ©DataCore Software Corporation – All Rights Reserved
- 2. TABLE OF CONTENTS Executive Summary 3 Top Level Drivers for SDS 3 Rationale for Virtualizing Storage – 4 Avoid Business Disruption and Reduce Costs Unexpected Challenges after Virtualizing 4 Mission-Critical Applications Application Performance Challenges 5 Human Errors Drive the Need for Greater Automation 5 Flash Storage – A Key Driver for SDS 6 Growth in Hyper-converged and Cloud Storage 7 Big Surprises Regarding Big Data 8 Related Disappointments 9 Spending for SDS in Storage Virtualization 9 and Virtual SANs on the Rise Survey Demographics 10 Conclusions 11
- 3. Table of Contents Click the section to jump ahead 3 Executive Summary For the fifth consecutive year, DataCore Software explored the impact of Software-Defined Storage (SDS) on organizations across the globe. The 2015 survey distills the expectations and experiences of 477 IT professionals that are currently using or evaluating SDS technology to solve critical data storage challenges. The results yield surprising insights from a cross-section of industries over a wide range of workloads. Please refer to the section on Survey Demographics for details on the size of companies, geographies, and vertical markets represented. Top Level Drivers for SDS The top three major business drivers for Software-Defined Storage are charted below. What are the business drivers for implementing Software-Defined Storage? Extending the life of existing storage assets and future-proofing the storage infrastructure to absorb new technologies easily topped the list with more than half of respondents naming this as a key factor (52%). Nearly half look to SDS to avoid hardware lock-in from storage manufacturers and lower hardware costs by allowing them to shop among several storage manufacturers. They also see it simplifying management of different classes by automating frequent or complex storage operations. When compared with earlier surveys, these results portray a sharp increase in the recog- nition of the economic benefits (reduced CAPEX) generated by SDS, complementing the OPEX savings referenced in prior years. Executive Summary Top Level Drivers for SDS Rationale for Virtualizing Storage – Avoid Business Disruption and Reduce Costs Unexpected Challenges after Virtualizing Mission-Critical Applications Application Performance Challenges Human Errors Drive the Need for Greater Automation Flash Storage – A Key Driver for SDS Growth in Hyper-converged and Cloud Storage Big Surprises Regarding Big Data Related Disappointments Spending for SDS in Storage Virtualization and Virtual SANs on the Rise Survey Demographics Conclusions
- 4. Table of Contents Click the section to jump ahead 4 Rationale for Virtualizing Storage – Avoid Business Disruption and Reduce Costs More than half of this year’s survey participants cited the ability to add storage capac- ity without business disruption (52%) as one of the primary reasons for choosing storage virtualization software. This was also identified as one of the top factors cited in the 2014 report. Supporting synchronous mirroring and metro clusters for high availability to ensure business continuity (49%) and asynchronous data replication for remote site disaster recovery (48%) were also high on the list. The next highest respondents were motivated by general cost reductions (44%) made possible when separating data services from the storage hardware. What are the primary reasons your organization chose to deploy storage virtualization software? Unexpected Challenges after Virtualizing Mission-Critical Applications When it comes to mission-critical applications, more than a third of survey participants reported more difficulties determining storage requirements after virtualizing business applications (34%). Nearly a third also noted that application response was slower than before virtualizing (31%), and 25% encountered complications when trying to share stor- age among their clustered servers. At the same time, 19% highlighted storage failures caused unforeseen outages. These are all byproducts of consolidating mixed workloads in fewer physical servers. 35%30%25%20%15% 20% 25% 33% 35% Determining storage requirements became more difficult Response was slower than before virtualizing Needed shared storage to make clusters work Storage failures caused unforeseen outages Executive Summary Top Level Drivers for SDS Rationale for Virtualizing Storage – Avoid Business Disruption and Reduce Costs Unexpected Challenges after Virtualizing Mission-Critical Applications Application Performance Challenges Human Errors Drive the Need for Greater Automation Flash Storage – A Key Driver for SDS Growth in Hyper-converged and Cloud Storage Big Surprises Regarding Big Data Related Disappointments Spending for SDS in Storage Virtualization and Virtual SANs on the Rise Survey Demographics Conclusions Which of the following surprises did you encounter after virtualizing mission-critical applications?
- 5. Table of Contents Click the section to jump ahead 5 Application Performance Challenges Digging into the performance concerns uncovered that more than 60% of respondents experienced performance degradation or the inability to meet performance after virtualizing server workloads – with 25% of those considering it a serious obstacle. When asked what the typical causes of performance problems are, an overwhelming amount of participants (61%) blamed slow applications. 46% of respondents singled out legacy storage devices as the culprit, whereas 22% attributed the slowdowns to incompat- ible storage equipment. Human Errors Drive the Need for Greater Automation In past surveys, the sources of downtime have been relatively constant. However, it has become increasingly clear that the complexity which accompanies data growth and diversi- ty is taking a big toll. An overwhelming number of respondents indicated that human error was behind application and data center outages (61%). In fact, downtime resulting from these errors and accidents were cited with nearly twice the frequency of heating, ventila- tion and air conditioning failures. Fire, smoke, construction work and vandalism together amounted for roughly 25% of responses. It’s clear from these findings that the automation and workflow orchestration provided by Software-Defined Storage platforms like DataCore’s can significantly reduce the occur- rence of human errors, and with that, a marked decrease in downtime. Executive Summary Top Level Drivers for SDS Rationale for Virtualizing Storage – Avoid Business Disruption and Reduce Costs Unexpected Challenges after Virtualizing Mission-Critical Applications Application Performance Challenges Human Errors Drive the Need for Greater Automation Flash Storage – A Key Driver for SDS Growth in Hyper-converged and Cloud Storage Big Surprises Regarding Big Data Related Disappointments Spending for SDS in Storage Virtualization and Virtual SANs on the Rise Survey Demographics Conclusions What are the typical causes of performance problems?
- 6. Table of Contents Click the section to jump ahead 6 Flash Storage – A Key Driver for SDS As one of the triggers to introduce SDS seems to be a direct result of difficulties en- countered when integrating solid state tiers into the data center, DataCore continues to observe how prevalent flash is becoming in the market. Last year, 63% of respondents had less than 10% of their storage capacity assigned to flash storage. This year the number with less than 10% dropped to 53%, illustrating that Flash devices are beginning to expand from a limited role inside servers to wider use within the storage infrastructure. The industry hype, however, would have us believe that customers will shift 100% to all flash. Qualitative and quantitative observations from surveys like this one suggest that’s unlikely due to the costs involved and the concern over their rapid wear. There are other factors preventing organizations from making that move-- including the realization that not all applications benefit from flash devices (see “Related Disappointments” below). Flash is excellent for specialized ‘hot data’ workloads that require high-speed reads such as databases. However, it is not a cost-effective solution for all workloads and still accounts for only a very small fraction of the overall storage space. The number of participants who answered that flash makes up higher than 40% of their storage capacity was 9%. Nevertheless, the industry is beginning to realize a smart balance between flash and spin- ning disk technologies already in place. This is where SDS technologies such as auto-tier- ing optimize the cost and performance trade-offs by migrating workloads to the right mix of magnetic and solid state storage. Less than 10% 10% to 20% 20% to 30% 30% to 40% More than 40% Executive Summary Top Level Drivers for SDS Rationale for Virtualizing Storage – Avoid Business Disruption and Reduce Costs Unexpected Challenges after Virtualizing Mission-Critical Applications Application Performance Challenges Human Errors Drive the Need for Greater Automation Flash Storage – A Key Driver for SDS Growth in Hyper-converged and Cloud Storage Big Surprises Regarding Big Data Related Disappointments Spending for SDS in Storage Virtualization and Virtual SANs on the Rise Survey Demographics Conclusions What storage capacity do you currently have assigned to flash? What unexpected incidents have caused application or data center outages?
- 7. Table of Contents Click the section to jump ahead 7 Growth in Hyper-converged and Cloud Storage Nearly half (45%) of respondents are evaluating the deployment of hyper-converged sys- tems, either to increase performance for specific applications; to increase availability and simplify management for remote sites; or to consolidate compute, networking and stor- age. While hyper-converged vendors tend to agree that storage services need to be imple- mented in a server software stack, many cannot take advantage of existing SAN capacity. Are you currently evaluating the deployment of hyper-converged systems? The ideal hyper-converged infrastructure solution is both hardware and hypervisor agnos- tic, supports DRAM caching and can pool internal as well as external storage, including direct-attached and SAN-attached. About half (47%) of respondents are currently evaluating public / hybrid cloud storage for backup and restore, long-term archive, or disaster recovery. Are you currently evaluating the deployment of a public / hybrid cloud for storage? 5% 10% 20% Backup and Restore 16% 15% 18%15% Long-term Archive Disaster Recovery Executive Summary Top Level Drivers for SDS Rationale for Virtualizing Storage – Avoid Business Disruption and Reduce Costs Unexpected Challenges after Virtualizing Mission-Critical Applications Application Performance Challenges Human Errors Drive the Need for Greater Automation Flash Storage – A Key Driver for SDS Growth in Hyper-converged and Cloud Storage Big Surprises Regarding Big Data Related Disappointments Spending for SDS in Storage Virtualization and Virtual SANs on the Rise Survey Demographics Conclusions
- 8. Table of Contents Click the section to jump ahead 8 Furthermore, more than half (57%) of respondents are evaluating the deployment of private cloud storage for self-service IT, to utilize commodity hardware, to automate / orchestrate storage provisioning, and for faster response to business objectives. Are you currently evaluating the deployment of private cloud storage in your environment? Big Surprises Regarding Big Data When it comes to data storage technology, there is no shortage of projections about the “next big thing” that will shape the future of the industry-- everything from Big Data, the impact of cloud computing, to the aforementioned “flash everywhere” phenomenon. DataCore took a look to see where companies will actually spend their 2015 IT budgets. Most revealing was how many organizations have not budgeted for heavily hyped tech- nologies. For example, from reading recent headlines one would expect to see an over- whelming majority investing in Big Data and Object Storage. On the contrary, half (50%) of the respondents have not earmarked any 2015 funds for either of those initiatives. And more than 70% don’t plan any OpenStack activities this year. Even Public Cloud Storage did not make the cut in 55% of the survey participants. Clearly, programs that make news today are often further out in the planning horizon. Even the “ubiquitous” flash technol- ogy was absent in 28% of the cases. Storage Technologies Not Budgeted for in 2015 Technology % of Respondents Who Did Not Allocate Budget in 2015 OpenStack Storage Public Cloud Storage (i.e., Azure, Amazon) Big Data Storage Object Storage VDI Storage Flash Technology 70% 55% 50% 50% 49% 28% Executive Summary Top Level Drivers for SDS Rationale for Virtualizing Storage – Avoid Business Disruption and Reduce Costs Unexpected Challenges after Virtualizing Mission-Critical Applications Application Performance Challenges Human Errors Drive the Need for Greater Automation Flash Storage – A Key Driver for SDS Growth in Hyper-converged and Cloud Storage Big Surprises Regarding Big Data Related Disappointments Spending for SDS in Storage Virtualization and Virtual SANs on the Rise Survey Demographics Conclusions
- 9. Table of Contents Click the section to jump ahead 9 Related Disappointments To better understand the adoption lag, DataCore inquired about disappointments and false starts encountered in storage infrastructure rollouts. Starting with solid state technologies, 16% of participants felt that flash had failed to ac- celerate applications. The much-heralded cost reductions anticipated from Cloud storage failed to materialize for 24% of the respondents. Another 21% found that highly touted hyper-converged systems did not perform as required or did not integrate well within their infrastructure. One explanation may simply be that these technologies were applied to the wrong problem or that unreasonably high expectations were used to justify their use. Spending for SDS in Storage Virtualization and Virtual SANs on the Rise In sharp contrast to the lack of funding for Object Storage and Big Data, investments in well proven Software-Defined Storage continue to grow. 62% of respondents plan on putting storage virtualization aspects of SDS to use in 2015. Some of that spending likely complements additions to existing centralized SANs. 81% of those polled expect to take advantage of SDS in the form of virtual SANs. They pointed to a couple of use cases. One calls for economical, compact, clustered storage in remote offices / branch offices (ROBO). The other seeks faster performance by moving storage closer to applications, such as latency-sensitive OLTP workloads. How much of your IT budget was budgeted for Software-Defined Storage in 2015? SDS Technology Virtual SANs Storage Virtualization 19% 28% 16% 23% 22% 24% 19% 7% Executive Summary Top Level Drivers for SDS Rationale for Virtualizing Storage – Avoid Business Disruption and Reduce Costs Unexpected Challenges after Virtualizing Mission-Critical Applications Application Performance Challenges Human Errors Drive the Need for Greater Automation Flash Storage – A Key Driver for SDS Growth in Hyper-converged and Cloud Storage Big Surprises Regarding Big Data Related Disappointments Spending for SDS in Storage Virtualization and Virtual SANs on the Rise Survey Demographics Conclusions Less than 5%N/A 5 - 10% 10 - 25% 25% or Greater 19% 7% What technology disappointments or false starts have you encountered in your storage infrastructure?
- 10. Table of Contents Click the section to jump ahead 10 Survey Demographics The respondents of the 2015 Datacore State of Software-Defined Storage survey repre- sent individuals from a diverse set of organizations, both in size and industries, providing broad insights into the similarity in needs for SDS over a wide range of IT environments. Financial Services Healthcare Government (Federal, State, Local) Manufacturing Education IT Services Other Industry Annual Revenue Less than $10 Million $10 Million to $100 Million $100 Million to $1 Billion More than $1 Billion Executive Summary Top Level Drivers for SDS Rationale for Virtualizing Storage – Avoid Business Disruption and Reduce Costs Unexpected Challenges after Virtualizing Mission-Critical Applications Application Performance Challenges Human Errors Drive the Need for Greater Automation Flash Storage – A Key Driver for SDS Growth in Hyper-converged and Cloud Storage Big Surprises Regarding Big Data Related Disappointments Spending for SDS in Storage Virtualization and Virtual SANs on the Rise Survey Demographics Conclusions
- 11. Table of Contents Click the section to jump ahead 11 company size geographic region Less than 500 employees Between 500 and 5,000 employees More than 5,000 employees North America South America Europe Asia Australia & New Zealand Executive Summary Top Level Drivers for SDS Rationale for Virtualizing Storage – Avoid Business Disruption and Reduce Costs Unexpected Challenges after Virtualizing Mission-Critical Applications Application Performance Challenges Human Errors Drive the Need for Greater Automation Flash Storage – A Key Driver for SDS Growth in Hyper-converged and Cloud Storage Big Surprises Regarding Big Data Related Disappointments Spending for SDS in Storage Virtualization and Virtual SANs on the Rise Survey Demographics Conclusions
- 12. Table of Contents Click the section to jump ahead 12 Conclusions The fifth annual survey uncovers some major surprises on how IT professionals approach storage-related innovations. For example, Big Data, object storage, hyper-converged systems and other heavily pro- moted technologies are far from commonplace. They are more often found at the fringes in pilot programs, where IT is hoping to assess their value. Adoption of these new data organization and management methods occurs at a much slower pace than one would guess from the frequency of news coverage. The responses suggest interest in them is moderated by: a) Previous hard-learned lessons and disappointments when misapplying much- hyped technologies b) Inability to quantify return on investment from what appears to be radical structural and organizational changes At the same time, the poll reveals that many organizations are moving away from stor- age functions tied to specific hardware. In fact, year-to-year comparisons reveal more pronounced use of Software-Defined Storage and the prerequisite storage virtualization software for purposes of achieving: • Continuous Availability: Safeguarding business information and providing non-stop access to data for critical applications • Faster Performance: Meeting responsiveness and service level agreements necessary to make timely business decisions and assimilate next-generation workloads • Higher Efficiency: Getting better utilization from the storage resources already in place, and those planned in the immediate future, whether inside servers, in the SAN or out on the cloud In DataCore’s experience over the past 17 years, across a universe of more than 25,000 global installations, those objectives make perfect sense. As important, they are realizable in a cost-effective manner without disrupting IT operations or increasing business risk. Executive Summary Top Level Drivers for SDS Rationale for Virtualizing Storage – Avoid Business Disruption and Reduce Costs Unexpected Challenges after Virtualizing Mission-Critical Applications Application Performance Challenges Human Errors Drive the Need for Greater Automation Flash Storage – A Key Driver for SDS Growth in Hyper-converged and Cloud Storage Big Surprises Regarding Big Data Related Disappointments Spending for SDS in Storage Virtualization and Virtual SANs on the Rise Survey Demographics Conclusions