Index Tuning
- 1. Index TuningBy Roi AssaRoi.Assa@888Holdings.com
- 2. Topics:Fragmentation typesHow to identify?How to analyze it?Resolving fragmentation issuesExamples…
- 3. Extents
- 5. External FragmentationOccurs when an index leaf page is not in logical orderKnown as logical fragmentation as wellFor example:On Insert - it is possible that new keys will be inserted in between existing keysThis may cause new index pages to be created to accommodate any existing keys that were moved so that the new keys can be inserted in correct order
- 6. These new index pages usually will not be physically adjacent to the pages the moved keys were originally stored inExternal FragmentationIndex structure before any additional data inserts:An INSERT statement adds new data to the index (value=5). This insert will cause the index pages to be out of logical order. SELECT * FROM Table WHERE Data BETWEEN 4 AND 10
- 7. Internal FragmentationInternal fragmentation occurs when the index pages are not being used to their maximum volume. Severe internal fragmentation can lead to increased index size and cause additional reads to be performed to return needed data.
- 8. These extra reads can lead to degradation in query performance. Internal FragmentationIndex structure before any additional data inserts:An INSERT statement adds new data to the index (value=5). This insert will cause the index page not to use the maximum volume.
- 10. How to identify?select * from sys.dm_db_index_physical_stats( { database_id | NULL | 0 | DEFAULT } , { object_id | NULL | 0 | DEFAULT } , { index_id | NULL | 0 | -1 | DEFAULT } , { partition_number | NULL | 0 | DEFAULT } , { mode | NULL | DEFAULT })
- 11. How to identify?Scanning Modes :LIMITED – The fastestIt scans all pages for a heap, but only the parent-level pages for an index, which are the pages above the leaf-levelSAMPLED – Returns statistics based on a 1 percent sample of all the pages in the index or heapDETAILEDScans all pages and returns all statistics.
- 12. How To Analyze It?
- 14. IN_ROW_DATA
- 15. LOB_DATA
- 16. ROW_OVERFLOW_DATA (varchar, nvarchar, varbinary, or sql_variant)
- 17. index_depth - Number of index levels
- 18. index_level - Current level of the index (The nonleaf levels of indexes are only processed when mode = DETAILED)
- 19. Resultsavg_fragmentation_in_percent – Percentage of external fragmentation (out-of-order pages in the index)The lower the number the better > 5% and < = 30% ALTER INDEX REORGANIZE > 30% ALTER INDEX REBUILD WITH (ONLINE = ON)fragment_count - The number of fragments in the index (physically consecutive leaf pages)avg_fragment_size_in_pages - Average number of pages in one fragment in an index (page_count/ fragment_count) Should be as high as possiblepage_count - Total number of index or data pages
- 20. Results (for Sampled and Detailed)avg_page_space_used_in_percent - Average percentage of available data storage space used in all pages (internal) Should be as high as possibleghost_record_count - Number of ghost records ready for removal by the ghost cleanup task (records are in the pages physically but not there logically due to deletion or update)version_ghost_record_count - Counts those records which are logically not in the table but cannot be deleted yet due to an open transaction using row versioning (running on snapshot isolation level)
- 21. Results (for Sampled and Detailed)forwarded_record_count - Number of records in a heap that have forward pointers to another data location (Occurs during an update, when there is not enough room to store the new row in the original location)SQL Server 2008compressed_page_count - The number of compressed pagesResolving Fragmentation Issues
- 22. Rebuilding Indexes (BOL)Rebuilding an index drops and re-creates the index
- 23. Rebuilding:
- 25. reclaims disk space by compacting the pages based on the specified or existing fill factor setting
- 26. reorders the index rows in contiguous pagesALTER INDEX PK_Employee_EmployeeID ON HumanResources.Employee REBUILDCREATE UNIQUE CLUSTERED INDEX PK_Employee_EmployeeID ON HumanResources.Employee(EmployeeID ) WITH (DROP_EXISTING = ON)
- 27. Reorganizing Indexes (BOL)Physically reordering the leaf-level pages to match the logical, left to right, order of the leaf nodes
- 28. Reorganizing:
- 29. Compacts the index pages (based on the existing fill factor value)
- 30. Uses minimal system resources
- 31. Two phases: Compaction DefragALTER INDEX PK_Employee_EmployeeID ON HumanResources.Employee REORGANIZE
- 32. Rebuilding vs. ReorganizingRebuild - Re-create the index internally again and when that has been achieved, it drops the existing index Statistics are re-computed Require free spaceReorganize – Physically re-organizing the leaf nodes of the indexDoes not update statisticsSwaps one page with another and therefore does not require free spaceCan free up some pages (compaction and defrag)Can remove logical fragmentation Not necessarily fix extent fragmentation (in which the previous and the next extents are physically contiguous)