SQL Server 2000 Research Series - Architecture Overview
Download as PPT, PDF1 like653 views
The document provides an overview of the architecture of Microsoft SQL Server 2000. It describes the main components of SQL Server including the SQL Server engine, memory management, and transaction logging and recovery. The SQL Server engine consists of a relational engine and storage engine. The relational engine handles query parsing, optimization, and execution while interacting with the storage engine to access and modify data. The storage engine manages disk pages, buffers, and transactions through components like the buffer manager, lock manager, and transaction manager.
SQL Server 2000 Research Series - Architecture Overview
- 1. Technical Integration Department System Analysis & Training Group Jerry Yang August 25, 2005 SQL Server 2000 Research Series Architecture Overview
- 2. Introduction Operating Environment The SQL Server Engine Memory Management Transaction Logging And Recovery Summary Agenda
- 3. Introduction Operating Environment The SQL Server Engine Memory Management Transaction Logging And Recovery Summary Architectural Overview
- 4. Introduction What Is It ? Why Analyze Architecture ? Processing Procedures Performance Issues Hardware Deploy Software Implementation How Should We Proceed ? DBMS Structure SQL Server Components Relationships
- 5. DBMS – Database Management Systems Introduction Application Programs/Queries Software to Process Queries/Programs Software to Access Stored Data Users/Programmers DATABASE SYSTEM DBMS SOFTWARE Stored Database Definition (Meta-Data) Stored Database
- 6. Introduction Operating Environment The SQL Server Engine Memory Management Transaction Logging And Recovery Summary Architectural Overview
- 7. Service Manager Enterprise Manager Query Analyzer SQL Server Profiler DTS - Data Transformation Services Client Network Utility Operating Environment
- 8. Service Manager Enterprise Manager Query Analyzer SQL Server Profiler DTS - Data Transformation Services Client Network Utility Operating Environment
- 9. Service Manager Operating Environment
- 10. Enterprise Manager Operating Environment
- 11. Enterprise Manager (Continued) Operating Environment
- 12. Query Analyzer Operating Environment
- 13. Query Analyzer (Continued) Operating Environment
- 14. Introduction Operating Environment The SQL Server Engine Memory Management Transaction Logging And Recovery Summary Architectural Overview
- 15. The SQL Server Engine SQL Server Architecture Net-Library User Mode Scheduler Relational Engine OLE & Non-OLE DB Communication Storage Engine I/O Manager Win 32 API
- 16. The SQL Server Engine SQL Server Architecture Net-Library User Mode Scheduler Relational Engine OLE & Non-OLE DB Communication Storage Engine I/O Manager Win 32 API
- 17. The SQL Server Engine SQL Server Architecture (Continued)
- 18. The SQL Server Engine Net-Library Functionality An abstraction layer enables SQL Server to read from and write to many different network protocols. Advantage Support many network protocols without having to change the core server code.
- 19. The SQL Server Engine Net-Library (Continued) Primary Net-Libraries Members OLE DB Provider for SQL Server SQL Server ODBC Driver Super Socket & Shared Memory Inter-computer Connection Local Connection Secondary Net-Libraries Members TCP/IP IPX/SPX ETC.
- 20. The SQL Server Engine Net-Library (Continued) Operating Environment
- 21. The SQL Server Engine Net-Library (Continued) Operating Environment
- 22. The SQL Server Engine Relational Engine Functionality Comprises all the components necessary to parse and optimize any query. Manages the execution of queries as it requests data from the storage engine in terms of OLE DB row sets and then processes the row sets returned.
- 23. The SQL Server Engine Relational Engine ODS ( O pen D ata S ervices)
- 24. The SQL Server Engine Relational Engine ODS (Continued) Functionality An interface between server Net-Library and server-based applications. Connection Handler: <1> . Listens for new connection <2> . Cleans up failed connections <3> . Acknowledges cancellations of commands <4> . Returns result sets, messages, status values to the client
- 25. The SQL Server Engine Relational Engine Command Parser
- 26. The SQL Server Engine Relational Engine Command Parser (Continued) Functionality Handles language events raised by ODS. Command Syntax Checker Error Raiser & Identifier Command Translator – Internal Format (Query Tree) Note The only one can access the source of the statement.
- 27. The SQL Server Engine Relational Engine Optimizer
- 28. The SQL Server Engine Relational Engine Optimizer (Continued) Functionality Takes the Query Tree from the Command Parser and prepared it for execution. Execution Plan Generation <1> . Normalization <2> . Hardware Part: Memory, CPU, I/O, ETC. <3> . Table Part: Table, Column, Index, ETC.
- 29. The SQL Server Engine Relational Engine SQL Manager
- 30. The SQL Server Engine Relational Engine SQL Manager (Continued) Functionality Be responsible for everything having to do with managing stored procedures and their plans. Recompilation – Based on changes in the object’s schema Caching of procedure plan management Auto-parameterized Query SELECT * FROM Customer WHERE Customer_ID = ‘1234567’ SELECT * FROM Customer WHERE Customer_ID = @param
- 31. The SQL Server Engine Relational Engine Expression Manager
- 32. The SQL Server Engine Relational Engine Expression Manager (Continued) Functionality Handles computation, comparison, and data movement. SELECT @var_Salary = Salary * 0.9 FROM Employee WHERE Employee_No = ‘013456’
- 33. The SQL Server Engine Relational Engine Query Executor Functionality Runs Execution Plan Interacts with Storage Engine <1> . Modifies Data <2> . Retrieves Data <3> . Manages Transaction <4> . Handles Locking
- 34. The SQL Server Engine Storage Engine Functionality Comprises the components needed to actually access and modify data on disk.
- 35. The SQL Server Engine Storage Engine Access Methods Manager
- 36. The SQL Server Engine Relational Engine Access Methods Manager (Continued) Functionality Sets up and requests scans of data pages / index pages and prepared the OLE (Object Linking and Embedding) DB row sets to return to the Relational Engine. Requester: Access Methods Manager Executer: Row Operations Manager & Index Manager Queries, Updates, and Deletes
- 37. The SQL Server Engine Storage Engine Page Manager & Text Manager
- 38. The SQL Server Engine Relational Engine Page Manager & Text Manager (Continued) Functionality The Page Manager and Text Manager cooperate to manage a collection of pages as named database. Type of Disk Pages Data Pages Text / Image Pages Index Pages Page Free Space (PFS) Pages Global Allocation Map (GAM) Pages Index Allocation Map (IAM) Pages Bulk Changed Map Pages Differential Changed Map Pages For three kinds of datatypes storage: (1).text (2).ntext (3).image All user data, except for text, ntext, and image datatypes.
- 39. The SQL Server Engine Storage Engine Buffer Manager
- 40. The SQL Server Engine Relational Engine Buffer Manager (Continued) Functionality Handles the in-memory version of each physical disk page and provides all other modules access to it. Note When a page is needed for a process, it must exist in memory in the buffer pool. If the page isn’t there, a physical I / O is performed to get it.
- 41. The SQL Server Engine Storage Engine Transaction Manager
- 42. The SQL Server Engine Relational Engine Transaction Manager (Continued) Functionality Guarantees the consistency and recoverability of SQL Server databases. Coordinates the following items: <1> . Log Manager <2> . Buffer Manager <3> . Lock Manager <4> . Recovery Module Note SUSPENDED! Chapter: Transaction Logging And Recovery
- 43. The SQL Server Engine Storage Engine Lock Manager
- 44. The SQL Server Engine Relational Engine Lock Manager (Continued) Functionality Guards data and the internal resources that make it possible for many users to simultaneously access the database and not be severely affected by others’ uses. Two Separate Locking Systems Locking System I – Fully Shared Data Table Locking System II – Restricted System Data
- 45. The SQL Server Engine Relational / Storage Engines & DBMS
- 46. Introduction Operating Environment The SQL Server Engine Memory Management Transaction Logging And Recovery Summary Architectural Overview
- 47. Memory Pools What Is Memory Pools ? Why Use It ? Pool Types Buffer Pool 4 ~ 10 MB 1 Buffer = 1 Page (8 KB) Operating System Memory MAX – 4 ~ 10 MB Need Memory Size > 8 KB Memory Management
- 48. Buffer Manager In-Memory Pages Access - Hashing Hash Lists Hash Buckets A Hash Bucket is a structure in memory that contains an array of pointers to the buffer page. Hashing Function Hashing is a technique that uniformly maps a key via a hash function across a set of Hash Buckets. Memory Management
- 49. Buffer Sweeper - Lazywriter Buffer Pool Management Reference Count Data / Index Pages Expensive Pages Ex: Stored Procedure Plans Free List Memory Management
- 50. Introduction Operating Environment The SQL Server Engine Memory Management Transaction Logging And Recovery Summary Architectural Overview
- 51. Corporations of Managers Transaction Manager Buffer Manager Log Manager Lock Manager Recovery Module Transaction Logging And Recovery
- 52. Transaction Logging Definition Transaction log is a set of files associated with a database at the time the database is created or altered. LSN Log Sequence Number Transaction Logging And Recovery
- 53. Recovery Checkpoint Database-by-database Basis All committed transactions are written to the database. Triggered Conditions Database Owner Issues A Ckeckpoint Command Log Is Getting Full (more than 70% of capacity) Long Recovery Time Is Estimated Transaction Logging And Recovery
- 54. Recovery (Continued) Recovery Algorithm Phase 1: Analysis Phase 2: Redo (rollforward) Phase 3: Undo (rollback) Transaction Logging And Recovery
- 55. Recovery (Continued) Transaction Logging And Recovery
- 56. Introduction Operating Environment The SQL Server Engine Memory Management Transaction Logging And Recovery Summary Architectural Overview
- 57. Summary What Do You Need to Know Today… Query Executer
- 58. Fundamentals of Database Systems Author: Elmasri / Navathe Publisher: Addison-Wesley Publishing Company Inside of Microsoft SQL Server 2000 Author: Kalen Delaney Publisher: Microsoft Press Reference
- 59. Any Question?