Ibm Data Management 4 Mar 2007
- 1. Data Management Information Lifecycle Management: RE: Reminder Workshop IBM Tivoli management software Technical Sales Storage IBM Nederland
- 2. Agenda IBM TotalStorage Capabilities IBM’s Point of View Definitions and Concepts IBM’s Enabling Technologies and Services Reference Conceptual Architecture Customer References
- 3. Does your company have “Information Indigestion?” Many of our clients experience this problem How to manage and protect an exponentially increasing amount of information? What should be kept – what should be deleted? Difficulty meeting the challenges of regulatory compliance? High cost of retrieving information for litigation? IBM’s Point of View Do you struggle with any of the following?... IBM sees Fortune 500 customers struggling with following issues: Saving TBs of data for years – Too expensive They are saving all of their e-mails – Too much pain and too expensive Saving compliant data on Optical media and wanting to replace it – Too old Relational databases are getting very large but firms must keep data for corporate or regulatory compliance or reference – Too big and slow … we see plenty of companies that do.
- 4. Surge in criticality, value and volume of digital information is overwhelming… Volume of information is growing explosively IBM’s Point of View As highlighted by industry analysts, Information is growing explosively, yet not all data is created equal 1 Enterprise Storage Impact Report Source: Enterprise Storage Group Enterprise data projected to grow at an annual rate of 64% percent 1 Outpacing IT’s ability to collect, store and manage it by traditional means … yet the value of your data is not equal across applications, and its value changes over time Each enterprise assigns different value to structured and unstructured data Does your storage data management strategy take this into account? Need to align IT investment to information value office documents Web content email instant messaging CAD/CAM paper digital photos video Fax images audio Data Value 0 20 40 60 80 100 7 Ds 14 Ds 21 Ds 28 Ds 3 Mo 6 Mo 9 Mo. 1 Yr 5 Yr 10 Yr MPEG Prod. Files Email Code Database
- 5. Definitions and Concepts IBM’s Answer - Information Lifecycle Management Solutions ILM is the process of managing information—from creation to disposal—in a manner that aligns costs with the changing value of information.
- 6. Definitions and Concepts Information On Demand (IOD) Information on demand - Getting the right information to the right people or processes at the right time to act on emerging opportunities and competitive threats. Creating business value and reducing risk by integrating, analyzing and optimizing all types and sources of information throughout its life cycle. Information Services Information Accelerators Business Applications Business Processes IT Service Management Business Driven Development Information Assets & Systems
- 7. Definitions and Concepts What is Information Lifecycle Management? ILM in an On Demand Storage Environment Categorizing data Managing active data Managing inactive data Managing changes with no disruptions Reduce human errors
- 8. Definitions and Concepts Within IOD, Data Assets and Systems are the backbone of almost any business process Virtualize Everything Commit to Openness Collaborate to Innovate Key Principles of IOD: Data Assets & Systems Infrastructure Management Data Retention Resource Virtualization Data Protection Systems Storage Servers Networking Static Systems Agile Business Maximizing Business Value Effectively Manage Information Assets Efficiently Manage Data Assets Data Assets & Systems Files, Storage, Servers, Networks Information Services Data Mgmt, Information Integration, Business Intelligence, Content Mgmt, Master Data Mgmt Information Accelerators Industry Specific Services, Models, Schemas & Policies Business Applications Commercial, Internally Developed, Composite-Based Business Processes Manage, Collaborate, Optimize ITSM ILM Business Driven Development Model, Design, Develop, Test Deploy Manage Increasing Virtualization Model / Assemble Information On Demand Architecture
- 9. Definitions and Concepts Highlights of IBM’s ILM Capabilities and Focus Areas Part of IBM’s ILM strategy is to help manage and reduce the amount of data you need to store, providing a key differentiator versus a number of our competitors. These solution focus areas provide the set of capabilities and services we can offer our customers in a Data Management solution. Data Lifecycle Management for Files Appropriate tiered placement, movement and expiration/deletion of files Database and Application Archive Extract “older” information for tiered placement, movement and archive e-mail Archive Copy/archive, extract attachments, archive “old” e-mails Content Management Enterprise repository for all data types IBM Services Assessment, planning, implementation * Tiered and/or virtualized storage is an ILM foundation of all offerings
- 10. Definitions and Concepts IBM Recommended 3 Step Approach for Data Management Systems 3 Step Approach File Systems Databases Applications e-mail 1 Data Classification and Rationalization 2 Establish Storage Tiers and Infrastructure 3 Determine Policies to Manage Data Gold Silver Bronze
- 11. Definitions and Concepts IBM Recommended Approach for Data Management 1a.) Data Classification 1b.) Data Rationalization Determine who owns, who is authorized to read, and who is authorized to modify specific data, in compliance with laws, regulations, security and privacy policies Determine appropriate business value and service level of specific data, so that it can be placed on the appropriate storage, and can be subsequently moved to other storage or expired (deleted) at a later date if the status changes over the lifecycle of the information represented 1 Classify and Rationalize File Systems Databases Applications e-mail
- 12. Definitions and Concepts IBM Recommended Approach for Data Management 1 Classify and Rationalize (cont.) Can you see all of your data? Identify duplicate files Identify usage violations Capture Does data support your business? Identify inappropriate files Enforce Usage Quotas Disposal Is data being disposed properly? Obsolete files unreferenced many years Orphan files of users no longer in company
- 13. IBM’s Enabling Technologies TotalStorage Productivity Center for Data For aiding in Step 1.) Data Classification and Rationalization Reclaim more of this Delete this Leave this alone Delete / share this Delete / archive this -Often Clean this - Often Invest in storing, accessing, managing and protecting this Remaining Storage Capacity System Files Non Business Files Duplicate data Redundant application data, log files, dump files, temporary files Stale / Orphan Data Valid Data
- 14. Definitions and Concepts IBM Recommended Approach for Data Management 2 Establish Storage Tiers Match tiers of storage to cost points and service levels required File Systems Databases Applications e-mail 1 Data Classification and Rationalization 2 Establish Storage Tiers and Infrastructure Gold Silver Bronze
- 15. IBM’s Enabling Technologies TotalStorage Disk Lines and Corresponding Service Levels For aiding in Step 2.) Establish Storage Tiers and Infrastructure Server Line Storage Line zSeries iSeries UNIX Linux on zSeries Linux on POWER Windows Linux x86 (Intel/AMD) DS8000 DS6000 DS4000 FC DS4000 SATA N3000/5000 Filer DS400 SCSI DS300 iSCSI LTO Tape 3592 Tape Gold Class Silver Class Bronze Class
- 16. Definitions and Concepts IBM Recommended Approach for Data Management 3 Determine Polices to Manage Data 3a.) Data Lifecycle Management 3b.) Compliance / Retention Establish policies to move or expire data based on external characteristics Establish policies based on internal characteristics Date Since Created (Age) Date Last Referenced/ Updated Size Context of Information Content Description File Systems Databases Applications e-mail
- 17. Definitions and Concepts IBM Recommended Approach for Data Management Step 3a.) Data Lifecycle Management Capture Dispose Tier 1 Tier 2 Tier 3 Active Reference Dormant Recall Migrate Movement is based on size and type of data, and date last referenced
- 18. IBM’s Enabling Technologies IBM Tivoli Storage Manager (TSM) Step 3.) For Aiding in Data Lifecycle Management Administration User Interface TSM Clients Servers, Clients, Application Systems Storage Hierarchy TSM Server TSM Storage pools Local Area Network Storage Area Network Database Log
- 19. IBM’s Enabling Technologies IBM Tivoli Storage Manager (TSM) Space Manager Step 3.) For Aiding in Data Lifecycle Management Centralized point of control for Hierarchical Storage Management (HSM) File system selection Effectiveness reporting Automated management Policy-based file selection On-demand scheduling Transparent recall Platforms Supported AIX, HP-UX, Linux-x86, Solaris Windows NTFS
- 20. Definitions and Concepts IBM Recommended Approach for Data Management Capture Dispose Tier 1 Tier 2 Tier 3 Active Reference Dormant Retrieve Archive Retention Managed Data: Data that needs to be retained and protected over a period of time and then disposed of. Usually stored on inexpensive media; trend is to SATA disk and Tape Step 3b.) Compliance and Retention
- 21. Step 3b.) Data Retention – Electronic Records Chain of Trust Source: Cohasset Associates, Inc. The above summary is for informational purposes only. IBM customers are responsible for seeking appropriate legal counsel and ensuring their own compliance with legal requirements. Media overwrite protection (P-WORM) Physical write protect (removable media-write lab) Overview protect (E-WORM) Caching for faster access (robotics / RAID) Overwrite protect (logical, read-only, S-WORM) Write verify (hash / checksum) Validate integrity (hash / checksum) Retention protection (metadata) Policy / rules Direct management of multiple logical / physical storage systems Overwrite protect (logical read-only) Access controls (read-only, access security) Policy / rules Search metadata Revision / version control Access / security (role / function) Audit trail Retention of metadata Manage disposition (deletion control) Policy / business rules Media On-line, Near-line, Off-line Physical Storage Library, Controller, Drive Logical Storage File Management Application Overwrite protect Retention protection Write verify Validate integrity Policy / rules IBM Tivoli Storage Manager IBM System Storage Archive Manager (Adds Retention Function)
- 22. IBM’s Enabling Technologies IBM System Storage DR550 Designed to provide non-rewriteable and non-erasable tiered storage with state-of-the-art retention management requirements built-in Data encryption, in flight and at rest Low acquisition cost Integrated Solution Deemed compliant with SEC 17a-4 by independent consultants DR550 Express - attractive entry product (1.1TB – 6.7TB) for SMB Non-erasable, non-rewritable format DR550 can assist with compliance for: Industry regulations Government regulations Corporate retention policies And so on (the DR550 can be used to store and protect any kind of data ) DR550 is an ideal solution for: Archive inactive tables/rows from databases (DB2, Oracle, etc.) Optical storage replacement Images (any kind of digital media) Any valuable digital corporate asset e-mail archive Instant messages Voicemail Archive inactive data from ERP data stores or databases (SAP, PeopleSoft, etc. ) IBM System Storage Archive Manager SW Single or Dual POWER5 Servers Gb Ethernet ports 5.6TB to 89.6TB capacity (SATA) Up to 2 PB “tiered” configuration Best-in-class retention management system
- 23. IBM’s Enabling Technologies IBM DR 550 Sample Architecture Best-in-class retention management appliance Three critical components are required to build a “Retention Managed Data” solution Scanned Customer Correspondence IBM DB2 Content Manager Active Archive Enterprise Vault IBM DB2 CommonStore … and others Business application Retention device – based on WORM technology Generic content management application Policy-based non-erasable, non-rewriteable storage system SQL Server DB2
- 24. You may be asking about ILM…… Where do I start? How do I develop an ILM strategy? Can I get assistance in developing an ILM roadmap – implementation plan? How do I classify and rationalize my data? What kind of ROI / TCO can I achieve with archive solutions and ILM? How do I consolidate my existing applications? What can I do to reduce my business risk and address the challenges of regulatory compliance? IBM’s Enabling Services Our IGS Services Portfolio can help you along the way
- 25. IBM’s Enabling Services Data Management IBM IT services has a suite of capabilities that can help you manage your storage environment across its entire lifecycle BUSINESS IT Storage Strategy & Planning (SSP) Offering Storage Strategy, Design & Planning Cost of ownership studies Storage Utility Assessment Data & Software Migration Planning Backup and Restore Planning Storage Architecture Operational Services MSS Services Storage Consolidation Storage monitoring and management Operations management and support Performance management and capacity planning Storage consolidation Interoperability Testing Services Implementation Services Backup and restore tuning, and management Performance & Capacity Services High Availability & GDPS Services Business Continuity Rapid Recovery Sysplex management Remote Copy management PLAN DESIGN IMPLEMENT RUN ASSESS Comprehensive Solutions IBM Managed Storage Services E-mail Solutions Backup & Restore Solutions Business Intelligence Solutions Storage Management Services Storage consolidation strategy, planning, and standards Performance Tuning and management Implementation Services Storage Migration
- 26. Reference Conceptual Architecture Data Management/Tiered Storage Management Service Level Cost per GB Platinum Gold Silver Bronze Enterprise Tier Midrange Tier Cost Centric Tier Mid-range Disk with Fibre Channel Enterprise-class Disk Mid-range Tape Enterprise-class Tape Virtual Tape Mid-range Disk with S-ATA DS4000 Flexibility Virtual Tape Server UltraScalable Tape Library LTO Enterprise Tape Library 3592 DS8000 The Standard DS6000 Enterprise disk for all clients DS300 / 400 New entry point DR550 Retention Managed Storage Nseries
- 27. Reference Conceptual Architecture Best Practices for Data Management/Tiered Storage Management Charge-back system is in place to offer “users” or “buyers” different fees for different classes of service. Differentiating characteristics of each class: Speed of access to Information Availability of data Backup / recovery requirements Data security Data retention / archive functionality Data movement / migration Offers monthly invoice, providing transparency to customer Drives significant adoption of tier 2 disk usage, consistent with best practice ILM strategy (data to be kept in pools, shared across servers, classified by performance tiers) Options for classes of service: Option 1: Single class of service having specified attributes for all characteristics to left, with a limit of 4 to 6 classes. (Platinum, Gold, Silver, etc.) Option 2: Multiple classes of service for each characteristic, and the user or buyer must select 1 from each A policy-based data movement strategy that will migrate data across tiers, as well as delete data over time, based upon file type, size, age and user Well defined, documented, and repeatable processes/procedures must be in place to support environment Flexible infrastructure must be in place to support current and future (3 years ahead) business requirements Tools must support multiple storage frame vendors: IBM, HDS, EMC, HP, etc. Tools must be verified in the marketplace for 12 months before production deployment Expansion of volumes must be performed without any outages and must be performed with proper data redundancy Provisioning, Zoning, LUN Masking must be automated Environment must support following server platforms: AIX, Linux, HPUX, Sun, Windows Copy tools must be open and a single set of copy / move / availability tools will be used to manage the all disk tiers, and block-level manual or automated (scripted) data movement will be performed without outages. These tools must include: Synchronous (Up to 300 miles) Asynchronous (Up to thousands of miles) Migration (Instantaneous) Copy (Instantaneous) Charge Back System Automation /Tools Copy Functionality Policy
- 28. Customer References Data Management Company Description Solution Description Leading American Hospital TotalStorage ESS TPC for Data Benefits Decreased storage costs by 50% 5X storage capacity than previous system Maintained availability during multiple power outages US Law Enforcement Agency Nationwide suspect identity application, VIPER, reduced cost per suspect identified by 80%+ 50% lower total cost of ownership due to higher system utilization Fortune 500 Energy company Tiered storage solution with virtualization Large British telecom firm Reduced management costs 30% ($725K per year) Network performance increased 10% SVC TPC FAStT 700 FAStT 500 LTO Ultrium Tape Tivoli Storage Manager Top food products company 66% improvement in process efficiency pSeries 660 TSM
- 29. Questions ?
Editor's Notes
- #2: To replace the title / subtitle with your own: Click on the title block -> select all the text by pressing Ctrl+A -> press Delete key -> type your own text
- #7: So – an uncontrollable volume of data, almost infinite variety in information and a velocity of change that could make it hard to breathe. For a business to survive under these pressures, something has to change. At IBM, we have been placing our investment into helping you transform your current environment into Information On Demand. Information on demand is about getting the right information to the right people or processes at the right time to act on emerging opportunities and competitive threats. It is about creating business value and reducing risk by integrating, analyzing and optimizing all types and sources of information throughout its lifecycle. Big marketing words. But they carry a lot of value. Let me see if I can paint a mental picture for you of what your company could accomplish with Information On Demand. (click)
- #8: ILM is recognized by the industry as aligning information with business processes and requirements expressed through service level agreements. ILM is making sure that the information that the user needs is available to them when they need it. And when they don’t need it, it is stored on inexpensive media, or is deleted depending on policy. So we will talk about managing ILM in a On Demand Storage environment - categorizing data, managing active data – production data, inactive data – backup copies or archived data, into a variable cost storage hierarchy while taking into account the requirement for recoverability of data. “ Information Lifecycle Management is comprised of the policies, processes, practices, and tools used to align the business value of information with the most appropriate and cost effective IT infrastructure from the time information is conceived through its final disposition. Information is aligned with business processes through management of policies and service levels associated with applications, metadata, information, and data.” SNIA Definition Categorizing Data Aligning data to business requirements Managing Active Data Performing data cleanup using best practices Managing Inactive Data Managing data governance requirements Managing Storage Aligning storage to business requirements Managing Changes with no disruptions Centralized view of data and storage Prioritizing incidents to maximize data availability Reduce Human Errors Process management and best practices for data and storage management