Oracle 12c Information Lifecycle Management
1 like1,241 views
Oracle 12c introduces new information lifecycle management (ILM) capabilities including a heat map to classify data access patterns, automatic data optimization (ADO) policies to automate data compression and movement over time, and storage tiering. The heat map provides fine-grained I/O statistics to identify hot, warm, and cold data. ADO policies can be defined using SQL to compress and tier data based on time or access thresholds. The ILM features are application transparent and aim to reduce storage costs over the data lifecycle.
Oracle 12c Information Lifecycle Management
- 1. BASEL BERN BRUGG DÜSSELDORF FRANKFURT A.M. FREIBURG I.BR. GENEVA HAMBURG COPENHAGEN LAUSANNE MUNICH STUTTGART VIENNA ZURICH Oracle 12c Emiliano Fusaglia Principal Consultant LS-IMS Information Lifecycle Management
- 2. Agenda 2 3/27/2016 1. Introduction to ILM Data Explosion ILM Definition ILM Challenger Existing ILM Solutions Overview Oracle 12c ILM 2. Oracle 12c ILM Heat Map Automatic Data Optimization Oracle 12c ILM
- 3. Oracle 12c ILM3 3/27/2016 Introduction to ILM
- 4. Data Explosion 4 3/27/2016 Where did the data explosion come from? Longer data retention driven by business need and new law enforcement. The more and more customer data becomes valuable and saved on CRM, ERP, DWH and Big Data systems. IoT Current trend shows that data doubles every 18 months! Oracle 12c ILM
- 5. Information Lifecycle Management - Definition 5 3/27/2016 What does Information Lifecycle Management mean? Information Lifecycle Management (ILM) refers to a wide-ranging set of strategies for administering storage systems on computing devices. ILM comprises the policies, processes, practices, and tools used to align the business value of information with the most appropriate and cost effective IT infrastructure from the time information is conceived through its final disposition Oracle 12c ILM
- 6. Information Lifecycle Management - Challenger 6 3/27/2016 Oracle 12c ILM
- 7. Information Lifecycle Management - Challenger 7 3/27/2016 More Data to manage without additional cost Define ILM processes Compress Data without impacting performance Distribute the data on multi- tiers devices Oracle 12c ILM
- 8. Existing ILM solutions 8 3/27/2016 Application consolidation Data compression Storage Tiering Offline Archives Data Retention/Deletion Which are the existing ILM solutions? Increase data density but probably not enough. Efficient, but can penalize the performance. Difficult for the Storage to identify the correct data to move. To query offline data can become highly inefficient. Loss of historical information. Oracle 12c ILM
- 9. 9 3/27/2016 Oracle 12c ILM Oracle 12c ILM
- 10. Overview Oracle 12c ILM 11 3/27/2016 Source: Oracle Corporation ILM Webpage Oracle 12c ILM
- 11. Overview Oracle 12c ILM 12 3/27/2016 Data Classification Rules for data movement and compression ILM Automatization Oracle 12c ILM
- 12. Oracle 12c ILM 13 3/27/2016 Heat Map Asynchronously analyze the I/O issued on the database, and resource efficiently (<5% cost) it maintains the Data Heat Map. Recognize application I/O requests from system I/O requests Can collect statistics at database, tablespace, segment and row level. Automatic Data Optimization (ADO) Part of the Advanced Compression Option. Permits to define the data lifecycle policies using SQL and PL/SQL functions. Supports automated compression and storage tiering. Automated solution which enforces the defined policies . Oracle 12c ILM rely on the following components: Oracle 12c ILM
- 13. Oracle 12c ILM: Heat Map 14 3/27/2016 Enable Hot/Cold data classification : PL/SQL API for querying Heat Map statistics: ALTER SYSTEM SET HEAT_MAP = ON; ALTER SESSION SET HEAT_MAP = ON; SELECT tablespace_name, min_writetime, min_ftstime FROM table(dbms_heat_map.tablespace_heat_map('EXAMPLE')) Oracle 12c ILM
- 14. Oracle 12c ILM: Heat Map on Enterprise Manager 15 3/27/2016 Hot Data Warm Data Cold Data Oracle 12c ILM
- 15. Oracle 12c ILM: Automatic Data Optimization (ADO) 16 3/27/2016 010100001111010 101010100001010 101001000010101 010010101010101 001010001111010 1010101101 0100110110111010010101001010 1010101010101010101010101010 1010101010101010101010101010 1010101010101010101001 1010100110100101010 1010100101010101010101010101 0100111010010101010010101010 101001101010101 1100101010100101001100101010 1010100101100110101010100101 0101010101011010010101010010 1 0101010101011010101001010101010101010101010010 1010100101001010101001010100101011010110101001 1010101111110010101001000000000000111111011111 1111111010100101000010100010100100110011111101 0001010010010100000010011111110101011111111100 1000001010001010010100101001010010101101111101 0101001001010101001011110101011111110101010010 1010100101001111111111101010010101010000000000 1010101000101010100101010101011101010100101010 1010010101010010101010101010101010101010101010 1010010100101010101010101010101010101010100101 0101010101010101010101010101010101010101010101 0100101010101010101010101010101011111101000000 1101010101110101010100101010101010100101010010 1010101000101010100101010101011101010100101010 1010010101010010101010101010101010101010101010 1010010100101010101010101010101010101010100101 0101010101010101010101010101010101010101010101 0100101010101010101010101010101011111101000000 Hot Data Warm Data Cold Data Advanced Row Compression 3x ADO & Data Compression *Columnar Query Compression 10x *Columnar Archive Compression 15x *Columnar Compression available on Exadata and other Oracle Storage (ZFS, Pillar, etc..) only. Oracle 12c ILM
- 16. Automatic Data Optimization Add compression and tiering policies to tables Oldest Data Most Recent Data Policy 1 Policy 2 Compress Partitions with Advanced Compression if they haven’t been modified in 30 days Compress Partitions with Hybrid Columnar Compression if they haven’t been modified from in 180 days Oracle 12c ILM
- 17. Automatic Data Optimization A heat map tracks the activity of segments and blocks Oldest Data Most Recent Data Policy 1 Policy 2 Oracle 12c ILM
- 18. Automatic Data Optimization Policies are automatically applied to tables Oldest Data Most Recent Data Policy 1 Policy 2 If after 30 days partitions haven’t be modified they will be compressed using advanced row compression Oracle 12c ILM
- 19. Automatic Data Optimization Policies are automatically applied to tables Oldest Data Most Recent Data Policy 1 Policy 2 After 180 days of no modification, the oldest partition is identified to be compressed using Hybrid Columnar compression Oracle 12c ILM
- 20. Automatic Data Optimization Policies are automatically applied to tables Oldest Data Most Recent Data Policy 1 Policy 2 Oracle 12c ILM
- 21. Automatic Data Optimization Reduce storage footprint, read compressed data faster Oldest Data Most Recent Data Policy 1 Policy 2 Oracle 12c ILM
- 22. Automatic Data Optimization Automatically tier data to lower cost storage Oldest Data Most Recent Data Policy 1 Policy 2 Policy 3 If the tablespace is nearly full then compress the oldest partition with Archive Hybrid Columar Compression and move it to Tier 2 Storage Oracle 12c ILM
- 23. Automatic Data Optimization Compress data over it’s lifecycle Oldest Data Most Recent Data No Compression Advanced Row Compression Hybrid Columnar Query Compression Hybrid Columnar Archive Compression 3X Compression OLTP 10X Compression Reporting 15X Compression Compliance Oracle 12c ILM
- 24. Oracle 12c ILM: Automatic Data Optimization (ADO) 25 3/27/2016 COMPRESS BASIC (alias Batch Compression) COMPRESS ADVANCED (alias OLTP Compression) CREATE TABLE sales (prod_id NUMBER NOT NULL, cust_id NUMBER NOT NULL, ...) PARTITION BY RANGE (time_id) ( PARTITION sales_2012 VALUES LESS THAN(TO_DATE(...)) ROW STORE COMPRESS BASIC, PARTITION sales_2013 VALUES LESS THAN (MAXVALUE) ROW STORE COMPRESS ADVANCED ); ADO & Data Compression Oracle 12c ILM
- 25. Oracle 12c ILM: Automatic Data Optimization (ADO) 26 3/27/2016 Add row-level compression policy after 14 days of no modifications COMPRESS ADVANCED (alias OLTP Compression) ADO & Data Compression ALTER TABLE emp ILM ADD POLICY ROW STORE COMPRESS ADVANCED ROW AFTER 14 DAYS OF NO MODIFICATION; ALTER TABLE sales MODIFY PARTITION sales_2011 ILM ADD POLICY COMPRESS FOR ARCHIVE HIGH SEGMENT AFTER 6 MONTHS OF NO ACCESS; Add segment-level compression policy after 6 months of no modifications Oracle 12c ILM
- 26. Oracle 12c ILM: Automatic Data Optimization (ADO) 27 3/27/2016 ADO & Storage Tiering 2009 2010 2011 2012 2013 2014 Current Year Sales Table Partitioned by Year High End SSD Disks Mid-Tier Storage DisksLow End Storage Disks $ $$ $$$$ Oracle 12c ILM
- 27. Oracle 12c ILM: Automatic Data Optimization (ADO) 28 3/27/2016 Add Storage tier policy ADO & Storage Tiering ALTER TABLE sales MODIFY PARTITION sales_2011 ILM ADD POLICY TIER TO low_end_tablespace; ALTER TABLE sales MODIFY PARTITION sales_2015 ILM ADD POLICY TIER TO high_end_tablespace; The partition movement occurs when the source tablespace has reached a capacity threshold. The threshold for activating tiering policies is based on two parameters: TBS PERCENT USED and TBS PERCENT FREE, which are controlled by the DBMS_ILM_ADMIN package, (default values 85% and 25%). Oracle 12c ILM
- 28. Oracle 12c ILM - Summary 29 3/27/2016 All ILM features are Application Transparent. Heat Map statistics provide fine grained I/O classification. ADO policies permit to automate data movement and compression. Support to complex business rules for data archiving actions. Oracle Advanced Compression option is required. Oracle 12c ILM
- 29. Emiliano Fusaglia Principal Consultant Tel. +41-79-909 7213 Emiliano.Fusaglia@trivadis.com 3/27/201630 Oracle 12c ILM