EMC IT's Best Practices
- 1. EMC IT’s Best Practices: Cal State University 2/18/2009 2004 - Today
- 2. EMC IT’s Infrastructure Challenges Cost Availability Security Project Delivery Scalability Agility Compliance Business Partnership
- 3. Our Environment and Portfolio Portfolio of 414 Applications & Tools Data Centers: 2 enterprise 3 regional 5,200 Data Center & Field Office Servers 230 PBX’s 219,000 Data Ports / 87,000 Voice Ports 460 “3rd Parties” Connected To EMC (3,900 users) 48,000+ Internal Users of IT Services 61 Countries & 398 Offices 20 Languages Supported By Helpdesk 1,100 System Changes / Month 39,000 Support Requests/ Month 150+ Ongoing Active Initiatives 6 PB Storage (across 5 tiers) 2,500 DB Instances 8,500 App Enhancements (2008) 950k B2B Transactions (2008) 23,000 Devices Monitored
- 4. EMC Strategic Acquisitions: 2003 – 2008 Network Intelligence Since 2003 approximately $7 Billion Invested in ≈40 Strategic Acquisitions Services Virtualization / Data Mobility Resource Management Content Mgmt Availability / Archiving Information Security Cloud Infrastructure and Services Authentica RSA Tablus Verid Documentum Acartus Ask Once X-Hive Document Sciences Rainfinity ProActivity Captiva Acxiom VMware Akimbi Valyd Indigo Stone Dolphin Internosis Geniant Interlink Astrum Smarts nlayers Voyence BusinessEdge Infra Legato Kashya Avamar Illuminator Consumer / Small Business Dantz Mozy Pi Iomega 1/03 1/04 1/07 1/08 1/05 1/06 1/09 WysDM Conchango Zephyr SourceLab
- 5. EMC IT’s Guiding Principles Architect for the Future Centralize, Consolidate and Virtualize to drive utilization up, become more agile and responsive, and improve service quality. Classify and Tier applications, environments and data to optimize TCO. Leverage de-duplication and archiving to “shrink the base” Automate operations to drive efficiency and service quality up. Replace custom dedicated solutions with “shared utility infrastructure”; building the private cloud. Change the conversation with the Business from “How” to “What” Deliver services and service levels, not technologies Provide cost transparency to drive better decisions Reinforce “the new way” via strong IT Governance Solution architecture control Portfolio management
- 6. Driving Bottom-Line Results $47.5M in Infrastructure saved over 3 years While business demand for IT doubled
- 7. EMC IT 2004: Islands of Information High-end storage Mid-tier storage SAN fabric Data Center A Data Center B Data Center C Data Center D Data Center E
- 8. EMC IT in early 2004: 4 Backup Solutions 2 Storage Tiers 105 (included in above) DAS 70 Switches 90 (66 TB) Mid-tier Storage 115 (896 TB); many older, low-density Hi-end Storage 63 management points SAN Fabrics 5 Data Centers 962 TB Raw Capacity
- 9. A Close Look Mirror: ~257 TB 1 Data center storage. 2 Excludes 40 TB unassigned space. Remote Replica: ~25 TB ~63% Allocation 2 3% 27% 13% 12% ~50% Utilization Host Free Space: ~120TB Host Utilized: ~118 TB 8% Local Replica: ~80 TB Current Raw Capacity 1 962 TB
- 10. ...Plus Miscellaneous Unallocated, System Overhead, and Unused Legacy Storage: 362 TB Local Replica: ~80 TB Remote Replica: ~25 TB Mirror: ~257 TB ~50% Utilization Host Free Space: ~120TB Host Utilized: ~118 TB 8% 3% 27% 13% 12% 37% ~63% Allocation 5 1 Data center storage. 5 Excludes 40 TB unassigned space. Current Raw Capacity 1 962 TB
- 11. The ILM Optimization Plan Local Replica: ~70–90 TB Unallocated, System Overhead, and Unused Legacy Storage: ~175–220 TB 2004 Raw Capacity 962 TB Consolidated Raw Capacity @ 700 - 750 TB Host Free Space: ~120 TB Host Utilized: ~118 TB Mirror: ~257 TB Local Replica: ~80 TB Remote Replica: ~25 TB Mirror: ~230 - 271 TB Host Free Space: ~ 51 TB Host Utilized: ~118 TB Remote Replica: ~20–35 TB 75% Allocation 70% Utilization 50% Utilization Unassigned: ~40TB 63% Allocation Unallocated, System Overhead, and Unused Legacy Storage: ~362 TB
- 12. Making the Business Case $42 Million Five-Year Cost Avoidance assuming 30% annual data growth 2008 Raw Capacity 3.6 PB 750 TB 962 TB Consolidated Raw Capacity 2.4 PB Mirror: ~230–271 TB Unassigned Host Free Space: ~ 51 TB Host Utilized: ~ 118 TB Local Replica: ~ 70–90 TB Remote Replica: ~ 20–35 TB 750 TB (TBC) Mirror Host Free Space Host Utilized Local Replica Remote Replica 75% Allocation Unallocated, System Overhead, and Unused Legacy Storage: ~175–220 TB Unallocated, System Overhead, and Unused Legacy Storage Cost Avoidance 1.2 PB 70% Utilization
- 13. Better Utilization Slows Storage Growth 70% 20%
- 14. EMC’s Tiered Capability and Service Catalog Business Important SAN Mission-Critical SAN Tier 1 Tier 2 Tier 3 Tier 4 Tier 5 Tape ATA, CAS Mid-tier High-end/Mid-tier Software-based local replication High-end Array-based replication AVAILABILITY (Unplanned Downtime) Seconds to minutes Hours Hours Hours to days Minutes to hours RECOVERY POINT Seconds Seconds to minutes Minutes to hours Up to 24 hours Up to 72 hours PERFORMANCE (Workload) Dynamic workload Highest transaction volume High performance for constant workloads Moderate performance Primarily read access Internet performance Primarily read access N/A
- 15. Oracle ERP “Before” on High-End Storage Tier 1 Tier 2 Tier 3 Tier 4 Tier 5 N/A 0 TB 0 TB 0 TB 20.5 TB DB 1400 GB RDF 1400GB ERP 120 GB Share-plex1: 2000 GB Share-plex2: 2000 GB Test: 3500 GB Dev: 300 GB Production Refresh 1400 GB Scheduler 275 GB RDF 120 GB RDF 275 GB System Test: 3500 GB System Test: 3500 GB Archive 150 GB Backup Staging 1100 GB TOTAL CAPACITY
- 16. ERP Oracle “After” Resides on More Cost-Effective Tiers TOTAL CAPACITY Tier 1 Tier 2 Tier 3 Tier 4 Tier 5 N/A 1.51 TB 8.7 TB 6.8 TB 3.5 TB DB 1400 GB RDF 1400GB ERP 120 GB Share-plex1: 2000 GB Share-plex2: 2000 GB Test: 3500 GB Dev: 300 GB Production Refresh 1400 GB Scheduler 275 GB RDF 120 GB RDF 275 GB System Test: 3500 GB System Test: 3500 GB Archive 150 GB Backup Staging 1100 GB
- 17. Data Growth Absorbed by Lowest TCO Tiers Tiered storage infrastructure and an application alignment process enable over 75% of data growth to reside on tiers 3 & 4.
- 18. Mitigating the “multiplier effect” – Email Archiving EDL 2 TB mirrored 2 TB Clone 2 TB Clone 2 TB Replicated Prod DR Tape 90 Days EDL EDL EDL EDL EDL EDL EDL EDL EDL 10 copies Prod DR 1.2 TB Mirrored 1.2TB Replicated 1TB Before Archive After Archive 1TB 8 TB Tier 1 10TB EDL 15 TB Tape 2.4 TB Tier 4 33 TB while in Exchange Mailbox Compressed De-duplicated 2.4 TB after Archive 2 TB mirrored
- 19. “Shrinking the Base” through Archiving Oracle 11i Archiving Oracle 11i 1 TB of Transactional Data Tape Backup of Prod 90 TB 5TB (Prod, Splx, SBY, ACT, Bkup) DR 3TB (Dev, Test, Training, Perf, etc) RAID 5TB (Prod, Splx, SBY, ACT, Bkup) Mirror 5TB (Prod, Splex, SBY, ACT, Bkup) 12TB (Dev, Test, Training, Perf) 5TB (Prod, Splx, SBY, ACT, Bkup) Mirror 0.5 TB Arch RAID 2TB Archving 98.37% Capacity Reduction Backup of (Prod, Splx, Dev, Test, etc) Onto EDL with RAID 28 TB 5 TB 10 TB 15 TB 20 TB 32 TB 35 TB 63 TB 153 TB 2.5 TB
- 20. Optimized Power Consumption on Lower Storage Tiers 1 TB Data on Different Capacity/Performance Drives 15K 73 GB 15K 146 GB 10K 300 GB 7.2K 500 GB 787 kWh/yr 1,434 kWh/yr 3,048 kWh/yr 6,096 kWh/yr 94% 87% 73% 7.2K 750 GB SATA II 525 kWh/yr 50% 7.2K 1 TB SATA II 393 kWh/yr 25% High Capacity Disks Consume Less Energy
- 21. Server Virtualization Virtualize existing applications as servers reach EOSL ~500 servers reach end-of-service-life each year; need to be replaced or virtualized Over past two years, avoided purchase of >800 servers through use of VMware Density ranges from 2:1 to 18:1 Design and build a virtual, shared, tiered application hosting platform for future projects Implement service-based model for application hosting Design horizontally scalable and tiered service farms Expect average consolidation ratio in excess of 40:1. Sweep the Floor in 2009 Remove 1600 physical servers Extend useful life of Data Centers indefinitely
- 22. ~2000 Servers Avoided and Eliminated so far.
- 23. Architect for the Future Future-State EMC IT Infrastructure Architecture 100% Virtualized Tiered Storage FCOE FLASH Tiered VMs DR for Mission Critical Apps Regional DCs in EMEA (Cork) and APJ (Bangalore) Global MPLS Network WAN Acceleration (WAAS) Hopkinton Ex Westborough
- 24. Architect for the Future Future-State EMC IT Client Architecture 100% Virtualized {3 year plan} Online, Offline, Synch Centralized administration and maintenance Universal deployment: Employees, Contractors and Partners Enabler to “BYOPC” model
- 25. Business Value Delivered Availability, Scalability and Agility Compliance, E-Discovery Information protection Operational efficiencies Soft Benefits Consolidation – Driving storage utilization up, slowing growth, saving data center space, power, HVAC, optimizing staff efficiency. >1.2 petabytes of storage avoided. Classification & Tiering – Driving data growth to the right tier; minimal growth in tier 1 storage despite significant data growth. Archiving – Slowing data growth and eliminating backup costs. >$2m in backup tape savings alone. Virtualization – Driving server utilization up, avoiding server purchases, saving data center space, power, HVAC, optimizing staff efficiency. Over 1000 server purchases avoided over last 2 years. Remote Office Backup – Eliminate tape costs, slow data growth, Avoided tech refresh on edge equipment. Hard Benefits Actual Results Category
- 26. Key Lessons Learned Focus on highest return efforts, depending on state of current IT infrastructure Considerable hard and soft savings Financial Transition from tape to backup-to-disk is surprisingly painless with no impact to applications “ Archiving” is often a dirty word when viewed as offsite tape repositories, however, “active archiving” is transparent to users and keeps data available— reducing the size of production databases has multiplier effects Deployment ILM is a critical foundation for building an information infrastructure ILM is much more than technology—it’s about people, process, and culture Application Classification (in terms of service levels) is a make-or-break step Executive sponsorship and management support is critical Engaging support throughout all levels of organization throughout a major transformation is paramount Overall