SlideShare a Scribd company logo
Smarter Technology
for Better Business
Can you Restore Back to Yesterday?
Always Answer YES!
John Abrams
President and COO
Aspect Consulting, Inc.
Remote Monitoring Best Practices:
Agenda
Introductions
The Goals of Monitoring
The Traditional Method
New Centralized Method
The Approach
Aspect Solution
Introductions and Qualifications:
Introducing John Abrams…
• President and Founder of Aspect Consulting, Inc.
• Over 20 years of solid project leadership and technical experience in
Data Management, Data Integration, Database Administration.
• Certified Oracle DBA with extensive expertise with logical and
physical DBA activities with both Oracle and SQL Server.
• Currently providing remote database administration and monitoring
services for multiple clients across industries.
Introductions and Qualifications:
About Aspect Consulting
 Founded in 1994; specializing in helping
clients increase revenue and decrease
expenses in through:
 Database Administration: Both onsite and
remote. Qualified consultants experienced in
improving database performance and stability.
 Data Management: Data Warehouse
Development; BI Reporting.
 RDBMS Software Installation and
Configuration: Oracle, SQL Server, etc.
 Application Design and Architecture:
Full life cycle development of custom applications,
logical and physical design, coordination of
resources, custom application development.
Introductions and Qualifications:
Current Remote DBA Clients
Remote Monitoring Best Practices:
The Goals of Monitoring
Databases Always Up
No Missed Backups
Never Run out of Disk Space
No Performance Problems
And… achieve all this in the most
efficient way possible
Remote Monitoring Best Practices:
Traditional Monitoring Methods
Utilize Maintenance Plans
Send Both Success and Failure Notifications
Or….no monitoring at all
Remote Monitoring Best Practices:
Issues with the Traditional Method:
Missed Backups:
• Maintenance Plans are modified from All User to selected databases, potentially
leaving new databases without backup.
Stopped SQL Agent:
• Agent does not restart and no jobs run—without your knowledge.
Missed Alerts:
• Too many emails. Multiple success and failure notifications get buried in inboxes.
Time Consuming to Set Up and Maintain:
• Monitoring not centralized: difficult to set up, maintain and update.
Centralized Monitoring Solution:
Gather Data and Alert Process Flow
SQL Statement
Gathers Info
Results Data
Stored in Meta
Database
Stored
Procedure
Reviews
Data and
Sends Alert
Centralized Monitoring Solution:
Analytical Reporting Process Flow
SQL Statement
Gathers Info
Results Data
Stored in Meta
Database
Stored
Procedure
Reviews
Data and
Analyzes
Generate
Trending
Reports
Centralized Monitoring Solution:
Centralized Monitoring Components
Create
Multiple
Data Gather
Jobs
Sends
Single
Alert
EmailStore Data in
Result Tables
Stores
Data for
Trending
Reports
Alert Job
Centralized Monitoring Solution:
A Better Method:
Why
Centralized
Monitoring is
Better
 Nothing Slips Through the Cracks: you do not
miss when jobs do not run.
 One Single Email: email displays results across
entire environment-rather than multiple emails lost
in your inbox.
 Easily Scalable: Single set of jobs, rather than
deploying the same set of jobs across 100 servers.
 Historical Data Readily Available: data can be
used for trending and alerting.
 Flexible Framework: the sky is the limit—you
can easily expand and extend monitoring jobs.
Centralized Monitoring Solution:
Two Different Approaches
Single Tier
Approach
• Components running on
single, centralized
Database Server:
• Meta Data to hold
server, connection strings, jobs to
send alerts, results tables, etc.
• Linked servers to connect to all
destination databases.
• Dynamic SQL Generating
Procedure to run jobs, store
results, and send alerts.
Multi Tier
Approach
• Adds App Server and
additional components:
• Same Data Model: adds
additional tables for scheduling
jobs to run on instances.
• Utilizes Windows Service
Agent to connect, execute
SQL, and send alerts.
• Adds Front End to manage job
maintenance, view alerts, and
generate reports
Centralized Monitoring Solution:
Single-Tiered Approach
Centralized Monitoring Solution:
Multi-Tiered Approach
Centralized Monitoring Solution:
Implement Key Queries
Missed
Backups
Failed
Jobs
Rapid File
Growth
Failed
Jobs
Disk Space
Usage
Key Syntax:
SQL Query: Gather Database Backup Info
Key Syntax:
SQL Query: Gather Database Failed Jobs
Key Syntax:
SQL Query: Gather Database File Size
Key Syntax:
SQL Procedure: Gather Disk Free Space
Utilize SQL Hidden Procedure:
EXEC master..xp_fixeddrives
Key Syntax:
Detect and Alert SP: Failed Backups/Jobs
 SELECT Last Set of Records from Data Results
Table.
 Use MAX(LASTMOD) value to select
records.
 IF detects SOME records (i.e., where backup
date is older than 24 hours/where job status
indicates failure)
 THEN
 Generate alert email.
 Write records to an Alert table.
Stored
Procedure
Detects failures,
sends alert, and
stores alert history
Key Syntax:
Detect and Alert SP: Disk Space/File Size
 SELECT Current Set of Records from Data
Results Table AND Set of Records inserted X
hours (e.g. 24 hours) ago.
 Use MAX(LASTMOD) value to select both
sets of records.
 COMPARE file size/disk space.
 IF detects SOME records where size increased
by X%...
 THEN
 Generate alert email.
 Write records to alert table.
Stored
Procedure
Detects out of range
conditions, sends alert,
and stores alert history
The Aspect Monitoring Solution:
Introducing Prodative® WatchDog EMS
WatchDog
EMS
Centralizes
the Right Info
& Alerts Across
Platforms
Capture Key
Data for
Trending &
Forecasting
Easy to
Configure
and Use
Displays info and alerts (e.g.
availability, backup, and file size)via
a web portal; no need to go to the
server for info.
Solution is simple to configure and
use for immediate impact; no need
for full-time staff for support.
Enables you to analyze, predict,
prepare, and address issues before
users are impacted.
Introducing Prodative® WatchDog EMS
Features
Monitor Critical Information and Alerts:
 Database Availability
 Missed Backups
 Critical Disk Space & File System Usage
(at both the device and subdirectory level)
 Problematic Indexing and Queries
Monitor
Info & Alerts
View Trending Data, Analyze and
Generate Reports
 Track Server and Job Statistics
 Track Disk Space and Database
Growth Over Time
Analyze &
Report
Introducing Prodative® WatchDog EMS
Features
Maintain and Extend Monitoring
using Flexible Controls:
Extend and Add Monitoring Jobs
Set Alerting Parameters
Add Reports
Maintain Users
Maintain &
Extend
Introducing Prodative® WatchDog EMS
Features
Questions…

More Related Content

PPTX
How to Build a Centralized Database Monitoring Solution - Never Miss a Backup
PDF
Apache hadoop & map reduce
PDF
2013 OHSUG - Use Cases for Using the Program Type View in Oracle Life Science...
PPT
Select enterprise backup software
PPTX
Know risk for mining industry 1
PPTX
data science chapter-4,5,6
PPTX
Big Data Expo 2015 - Vision Solutions Sharind Database Information
PDF
Geek Sync | Automating Database Administration Is No Longer Optional
How to Build a Centralized Database Monitoring Solution - Never Miss a Backup
Apache hadoop & map reduce
2013 OHSUG - Use Cases for Using the Program Type View in Oracle Life Science...
Select enterprise backup software
Know risk for mining industry 1
data science chapter-4,5,6
Big Data Expo 2015 - Vision Solutions Sharind Database Information
Geek Sync | Automating Database Administration Is No Longer Optional

Similar to Sql saturday databasemonitoringbestpractices_updated (20)

PDF
Managing DB2 workloads by IBA Group
PDF
How to improve your system monitoring
PDF
Presentation cloud control enterprise manager 12c
PDF
Oracle 0472
PDF
Presentation application change management and data masking strategies for ...
PPT
IBM InfoSphere Optim Solutions - Highlights
PPT
Oracle DBA Meets ITIL and COBIT
PDF
Best Laid Plans: Saving Time, Money and Trouble with Optimal Forecasting
PDF
Information Retrieval And Evaluating Its Usefulness
PDF
Zabbix Conference LatAm 2016 - Rodrigo Mohr - Challenges on Large Env with Or...
PDF
10 Ways to Better Application-Centric Service Management
PDF
monitor_begin_s.PDF
PPTX
CONTROL & AUDIT INFORMATION SYSTEM (HALL, 2015)
PPT
Performance Monitoring And Tuning In Sql Server 2008 Tsql
PPT
End To End Service Management With Operations Manager 2007
PPTX
Data integrity 03.pptx
PDF
Lect. 7 - MIS and business analytics.pdf
PPTX
The 5S Approach to Performance Tuning by Chuck Ezell
PDF
E-Business Suite 2 _ Ben Davis _ Achieving outstanding optim data management ...
PPT
Database auditing essentials
Managing DB2 workloads by IBA Group
How to improve your system monitoring
Presentation cloud control enterprise manager 12c
Oracle 0472
Presentation application change management and data masking strategies for ...
IBM InfoSphere Optim Solutions - Highlights
Oracle DBA Meets ITIL and COBIT
Best Laid Plans: Saving Time, Money and Trouble with Optimal Forecasting
Information Retrieval And Evaluating Its Usefulness
Zabbix Conference LatAm 2016 - Rodrigo Mohr - Challenges on Large Env with Or...
10 Ways to Better Application-Centric Service Management
monitor_begin_s.PDF
CONTROL & AUDIT INFORMATION SYSTEM (HALL, 2015)
Performance Monitoring And Tuning In Sql Server 2008 Tsql
End To End Service Management With Operations Manager 2007
Data integrity 03.pptx
Lect. 7 - MIS and business analytics.pdf
The 5S Approach to Performance Tuning by Chuck Ezell
E-Business Suite 2 _ Ben Davis _ Achieving outstanding optim data management ...
Database auditing essentials
Ad

Recently uploaded (20)

PPTX
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
PDF
cuic standard and advanced reporting.pdf
PDF
NewMind AI Weekly Chronicles - August'25 Week I
PDF
Chapter 3 Spatial Domain Image Processing.pdf
PPTX
Effective Security Operations Center (SOC) A Modern, Strategic, and Threat-In...
PDF
Encapsulation theory and applications.pdf
PDF
Reach Out and Touch Someone: Haptics and Empathic Computing
PPTX
Digital-Transformation-Roadmap-for-Companies.pptx
PDF
Diabetes mellitus diagnosis method based random forest with bat algorithm
PPTX
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
PDF
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
PDF
Review of recent advances in non-invasive hemoglobin estimation
PDF
Machine learning based COVID-19 study performance prediction
PDF
Approach and Philosophy of On baking technology
PDF
Unlocking AI with Model Context Protocol (MCP)
DOCX
The AUB Centre for AI in Media Proposal.docx
PDF
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
PDF
Encapsulation_ Review paper, used for researhc scholars
PDF
Mobile App Security Testing_ A Comprehensive Guide.pdf
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
cuic standard and advanced reporting.pdf
NewMind AI Weekly Chronicles - August'25 Week I
Chapter 3 Spatial Domain Image Processing.pdf
Effective Security Operations Center (SOC) A Modern, Strategic, and Threat-In...
Encapsulation theory and applications.pdf
Reach Out and Touch Someone: Haptics and Empathic Computing
Digital-Transformation-Roadmap-for-Companies.pptx
Diabetes mellitus diagnosis method based random forest with bat algorithm
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
Review of recent advances in non-invasive hemoglobin estimation
Machine learning based COVID-19 study performance prediction
Approach and Philosophy of On baking technology
Unlocking AI with Model Context Protocol (MCP)
The AUB Centre for AI in Media Proposal.docx
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
Encapsulation_ Review paper, used for researhc scholars
Mobile App Security Testing_ A Comprehensive Guide.pdf
Ad

Sql saturday databasemonitoringbestpractices_updated

  • 1. Smarter Technology for Better Business Can you Restore Back to Yesterday? Always Answer YES! John Abrams President and COO Aspect Consulting, Inc.
  • 2. Remote Monitoring Best Practices: Agenda Introductions The Goals of Monitoring The Traditional Method New Centralized Method The Approach Aspect Solution
  • 3. Introductions and Qualifications: Introducing John Abrams… • President and Founder of Aspect Consulting, Inc. • Over 20 years of solid project leadership and technical experience in Data Management, Data Integration, Database Administration. • Certified Oracle DBA with extensive expertise with logical and physical DBA activities with both Oracle and SQL Server. • Currently providing remote database administration and monitoring services for multiple clients across industries.
  • 4. Introductions and Qualifications: About Aspect Consulting  Founded in 1994; specializing in helping clients increase revenue and decrease expenses in through:  Database Administration: Both onsite and remote. Qualified consultants experienced in improving database performance and stability.  Data Management: Data Warehouse Development; BI Reporting.  RDBMS Software Installation and Configuration: Oracle, SQL Server, etc.  Application Design and Architecture: Full life cycle development of custom applications, logical and physical design, coordination of resources, custom application development.
  • 6. Remote Monitoring Best Practices: The Goals of Monitoring Databases Always Up No Missed Backups Never Run out of Disk Space No Performance Problems And… achieve all this in the most efficient way possible
  • 7. Remote Monitoring Best Practices: Traditional Monitoring Methods Utilize Maintenance Plans Send Both Success and Failure Notifications Or….no monitoring at all
  • 8. Remote Monitoring Best Practices: Issues with the Traditional Method: Missed Backups: • Maintenance Plans are modified from All User to selected databases, potentially leaving new databases without backup. Stopped SQL Agent: • Agent does not restart and no jobs run—without your knowledge. Missed Alerts: • Too many emails. Multiple success and failure notifications get buried in inboxes. Time Consuming to Set Up and Maintain: • Monitoring not centralized: difficult to set up, maintain and update.
  • 9. Centralized Monitoring Solution: Gather Data and Alert Process Flow SQL Statement Gathers Info Results Data Stored in Meta Database Stored Procedure Reviews Data and Sends Alert
  • 10. Centralized Monitoring Solution: Analytical Reporting Process Flow SQL Statement Gathers Info Results Data Stored in Meta Database Stored Procedure Reviews Data and Analyzes Generate Trending Reports
  • 11. Centralized Monitoring Solution: Centralized Monitoring Components Create Multiple Data Gather Jobs Sends Single Alert EmailStore Data in Result Tables Stores Data for Trending Reports Alert Job
  • 12. Centralized Monitoring Solution: A Better Method: Why Centralized Monitoring is Better  Nothing Slips Through the Cracks: you do not miss when jobs do not run.  One Single Email: email displays results across entire environment-rather than multiple emails lost in your inbox.  Easily Scalable: Single set of jobs, rather than deploying the same set of jobs across 100 servers.  Historical Data Readily Available: data can be used for trending and alerting.  Flexible Framework: the sky is the limit—you can easily expand and extend monitoring jobs.
  • 13. Centralized Monitoring Solution: Two Different Approaches Single Tier Approach • Components running on single, centralized Database Server: • Meta Data to hold server, connection strings, jobs to send alerts, results tables, etc. • Linked servers to connect to all destination databases. • Dynamic SQL Generating Procedure to run jobs, store results, and send alerts. Multi Tier Approach • Adds App Server and additional components: • Same Data Model: adds additional tables for scheduling jobs to run on instances. • Utilizes Windows Service Agent to connect, execute SQL, and send alerts. • Adds Front End to manage job maintenance, view alerts, and generate reports
  • 16. Centralized Monitoring Solution: Implement Key Queries Missed Backups Failed Jobs Rapid File Growth Failed Jobs Disk Space Usage
  • 17. Key Syntax: SQL Query: Gather Database Backup Info
  • 18. Key Syntax: SQL Query: Gather Database Failed Jobs
  • 19. Key Syntax: SQL Query: Gather Database File Size
  • 20. Key Syntax: SQL Procedure: Gather Disk Free Space Utilize SQL Hidden Procedure: EXEC master..xp_fixeddrives
  • 21. Key Syntax: Detect and Alert SP: Failed Backups/Jobs  SELECT Last Set of Records from Data Results Table.  Use MAX(LASTMOD) value to select records.  IF detects SOME records (i.e., where backup date is older than 24 hours/where job status indicates failure)  THEN  Generate alert email.  Write records to an Alert table. Stored Procedure Detects failures, sends alert, and stores alert history
  • 22. Key Syntax: Detect and Alert SP: Disk Space/File Size  SELECT Current Set of Records from Data Results Table AND Set of Records inserted X hours (e.g. 24 hours) ago.  Use MAX(LASTMOD) value to select both sets of records.  COMPARE file size/disk space.  IF detects SOME records where size increased by X%...  THEN  Generate alert email.  Write records to alert table. Stored Procedure Detects out of range conditions, sends alert, and stores alert history
  • 23. The Aspect Monitoring Solution: Introducing Prodative® WatchDog EMS WatchDog EMS Centralizes the Right Info & Alerts Across Platforms Capture Key Data for Trending & Forecasting Easy to Configure and Use Displays info and alerts (e.g. availability, backup, and file size)via a web portal; no need to go to the server for info. Solution is simple to configure and use for immediate impact; no need for full-time staff for support. Enables you to analyze, predict, prepare, and address issues before users are impacted.
  • 24. Introducing Prodative® WatchDog EMS Features Monitor Critical Information and Alerts:  Database Availability  Missed Backups  Critical Disk Space & File System Usage (at both the device and subdirectory level)  Problematic Indexing and Queries Monitor Info & Alerts
  • 25. View Trending Data, Analyze and Generate Reports  Track Server and Job Statistics  Track Disk Space and Database Growth Over Time Analyze & Report Introducing Prodative® WatchDog EMS Features
  • 26. Maintain and Extend Monitoring using Flexible Controls: Extend and Add Monitoring Jobs Set Alerting Parameters Add Reports Maintain Users Maintain & Extend Introducing Prodative® WatchDog EMS Features