SlideShare a Scribd company logo
SQL Server onStorage Area Networks
Brent OzarSQL Server MVPfor Quest SoftwareManaged SQL, VM,  80tb SAN for $7b coPublished authorMade lots of expensive mistakeswww.BrentOzar.com@BrentO on Twitter
BrentOzar.com/go/insidetheblackbox
The AgendaInside the SANDBA Pros & ConsStarting From The BeginningHow to Use SQLIOMultipathing
In The Beginning…
Next: External Storage
Storage Area NetworksIndependentExpandableWell-ProtectedBlazing FastComplexExpensive
SQL Server On SANs
Photo Licensed with Creative Commons from http://www.flickr.com/photos/tophost/2247031208/
Photo Licensed with Creative Commons from http://www.flickr.com/photos/tophost/2246209421/
Photo Source http://www.flickr.com/photos/tophost/2246209421/
SAN ComponentsDrive enclosuresControllers (& Cache)Switch networksHost Bus AdaptersHBA DriversServers
Drive Allocation Methods
SQL Server On SANs
Good ThingsClusteringTable partitioningFaster buildsEasier growthCaching speedPhotoSource http://www.flickr.com/photos/pcka/3240903696/
Not-So-Good ThingsBlack boxCachingmay not helpCompatibility listsMore driversTough to growSAN adminsmay not helpPhoto Source http://www.flickr.com/photos/stewf/95709873/
“How many gigs do you need?”
“We’ll keep an eye on it for ya.”Perfmon changesNeighbors changeSAN changesSAN monitoring software is toughPhoto Source http://www.flickr.com/photos/mrjoro/39470992/
What’s Your Bottleneck?Not Enough DrivesDrives Too SlowShared DrivesRAID LevelSAN ControllersPartition AlignmentDriversMultipathing
Things to MonitorHard drivesControllers (CPU, caching)Controller connectivity to the networkNetwork switch throughputServer connectivity to the SAN (the HBA) Server drivers
The X Factor: RedundancyHard drives – hundredsControllers – 2+Controller connectivity to network – 4+Network – separate networks, switchesServer connectivity to SAN – 2+Network fabrics – iSCSI, Fiber, WAN
SAN MonitoringStrict HCLs, SCLsCross-platformmeans JAVANo “full” pictureVery, very, veryexpensivePhoto Source: http://flickr.com/photos/earthandeden/865393933/
Unpredictable, Unexplainable
Start From The BeginningGet block sizes rightAlign partitionsDesign for pathingTest with SQLIOInstall SQL ServerMonitor sec/read, writeSave history
Simple SAN Pathing
Simple SAN Pathing
Simple SAN Pathing
Simple SAN Pathing
SIMPLE?!?1#%&@!?
Photo Licensed with Creative Commons from http://www.flickr.com/photos/creatista/204265480/
Goals of MultipathingProtectionPerformance
Active/Active Can Mean
Active/Active GotchasOne path per LUN/volumeSending vs receivingPost-failover stickinessNetwork design
Network Bottleneck Example
Pathing Really Matters Now
Photo Licensed with Creative Commons from http://www.flickr.com/photos/thatguyfromcchs08/2300190277/
Photo Licensed with Creative Commons from http://www.flickr.com/photos/atomdocs/3127663764/Why Can’t We Go Faster?
How to Run SQLIOsqlio -kW -t2 -s120 -dM -o1 -frandom -b64 -BH -LS Testfile.dat
Write This Down. It’s Important.sqlio -kW -t2 -s120 -dM -o1 -frandom -b64 -BH -LS Testfile.datsqlio -kW -t2 -s120 -dM -o2 -frandom -b64 -BH -LS Testfile.datsqlio -kW -t2 -s120 -dM -o4 -frandom -b64 -BH -LS Testfile.datsqlio -kW -t2 -s120 -dM -o8 -frandom -b64 -BH -LS Testfile.datsqlio -kW -t2 -s120 -dM -o16 -frandom -b64 -BH -LS Testfile.datsqlio -kW -t2 -s120 -dM -o32 -frandom -b64 -BH -LS Testfile.datsqlio -kW -t2 -s120 -dM -o64 -frandom -b64 -BH -LS Testfile.datsqlio -kW -t2 -s120 -dM -o128 -frandom -b64 -BH -LS Testfile.datsqlio -kW -t4 -s120 -dM -o1 -frandom -b64 -BH -LS Testfile.datsqlio -kW -t4 -s120 -dM -o2 -frandom -b64 -BH -LS Testfile.datsqlio -kW -t4 -s120 -dM -o4 -frandom -b64 -BH -LS Testfile.datsqlio -kW -t4 -s120 -dM -o8 -frandom -b64 -BH -LS Testfile.dat
We Did the Hard Work
The OutputE:\Program Files (x86)\SQLIO>sqlio -kW -t2 -s120 -dM -o1 -frandom -b64 -BH -LS Testfile.datsqlio v1.5.SGusing system counter for latency timings, -1361967296 counts per second2 threads writing for 120 secs to file M:Testfile.dat	using 64KB random IOs	enabling multiple I/Os per thread with 1 outstanding	buffering set to use hardware disk cache (but not file cache)using current size: 24576 MB for file: M:Testfile.datinitialization doneCUMULATIVE DATA:throughput metrics:IOs/sec:  1539.50MBs/sec:    96.21latency metrics:Min_Latency(ms): 0Avg_Latency(ms): 0Max_Latency(ms): 572histogram:ms: 0  1  2  3  4  5  6  7  8  9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24+%: 66 32  1  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0
Common Bottlenecks1 gig = ~125 MB/sec2 gig = ~250 MB/sec4 gig = ~500 MB/sec10 gig = ~1250 MB/sec
Working Around ItData/logs/tempdbon different volumesSeparategroups of DBsSeparate DBinto filegroupsTempDB, backupsPhoto Source http://www.flickr.com/photos/doodlemonger/2667917978/
Wrapping It UpTest before deploymentLearn multipathingDesign DB files around SAN limitsMonitor foreverGet vendor helpPhoto Source http://www.flickr.com/photos/doodlemonger/2667917978/
Advanced TopicsTable partitioningFilegroups & filesSnapshot backupsStorage virtualizationStorage VMotionSAN administrationPhoto Source http://www.flickr.com/photos/thomasthomas/504369245/
BrentOzar.com/go/insidetheblackbox

More Related Content

PPTX
Virtualization and SAN Basics for DBAs
PDF
Salt conf 2014-installing-openstack-using-saltstack-v02
PDF
Nginx for Fun & Performance - Philipp Krenn - Codemotion Rome 2015
PDF
Squid for Load-Balancing & Cache-Proxy ~ A techXpress Guide
PDF
Using Embulk at Treasure Data
PDF
Recent Updates at Embulk Meetup #3
PPT
Apache Traffic Server
PDF
The top 5 Kubernetes metrics to monitor
Virtualization and SAN Basics for DBAs
Salt conf 2014-installing-openstack-using-saltstack-v02
Nginx for Fun & Performance - Philipp Krenn - Codemotion Rome 2015
Squid for Load-Balancing & Cache-Proxy ~ A techXpress Guide
Using Embulk at Treasure Data
Recent Updates at Embulk Meetup #3
Apache Traffic Server
The top 5 Kubernetes metrics to monitor

What's hot (17)

PPTX
Orchestration? You Don't Need Orchestration. What You Want Is Choreography by...
PPTX
Scaling and Managing Selenium Grid
PDF
Cloud forensics putting the bits back together
PDF
Capistrano
PDF
Building Real-Time Applications with Android and WebSockets
ODP
Continuous Security
PDF
Odoo Performance Limits
 
PDF
Wordpress y Docker, de desarrollo a produccion
ODP
Nagios Conference 2014 - Troy Lea - Monitoring VMware Virtualization Using vMA
 
PDF
Odoo Online platform: architecture and challenges
 
PPTX
Ch10.애플리케이션 서버의 병목_발견_방법
PPTX
Nagios Conference 2014 - Jeff Mendoza - Monitoring Microsoft Azure with Nagios
 
PDF
Salt conf 2014 - Using SaltStack in high availability environments
PPTX
Websockets in Node.js - Making them reliable and scalable
PDF
KOWAZA for mackerel
PPT
Google App Engine with JSF 2.x
PDF
Puppet Camp Berlin 2014 Closing Keynote: Next steps for doing more awesome th...
 
Orchestration? You Don't Need Orchestration. What You Want Is Choreography by...
Scaling and Managing Selenium Grid
Cloud forensics putting the bits back together
Capistrano
Building Real-Time Applications with Android and WebSockets
Continuous Security
Odoo Performance Limits
 
Wordpress y Docker, de desarrollo a produccion
Nagios Conference 2014 - Troy Lea - Monitoring VMware Virtualization Using vMA
 
Odoo Online platform: architecture and challenges
 
Ch10.애플리케이션 서버의 병목_발견_방법
Nagios Conference 2014 - Jeff Mendoza - Monitoring Microsoft Azure with Nagios
 
Salt conf 2014 - Using SaltStack in high availability environments
Websockets in Node.js - Making them reliable and scalable
KOWAZA for mackerel
Google App Engine with JSF 2.x
Puppet Camp Berlin 2014 Closing Keynote: Next steps for doing more awesome th...
 
Ad

Similar to SQL Server On SANs (20)

PPTX
5 Steps to Faster Web Sites and HTML5 Games
PPTX
5 steps to faster web sites & HTML5 games - updated for DDDscot
PDF
Practical Performance Tips and Tricks to Make Your HTML/JavaScript Apps Faster
PPT
download it from here
PPT
gofortution
PPT
vBACD - Introduction to Opscode Chef - 2/29
PDF
Chicago Docker Meetup Presentation - Mediafly
PDF
HTTP cache @ PUG Rome 03-29-2011
PPT
Csdn Drdobbs Tenni Theurer Yahoo
PDF
Http/2 - What's it all about?
PDF
Check the version with fixes. Link in description
PDF
Swift: One Language To Rule Them All
PDF
Azure Nights August2017
PDF
The Case for HTTP/2 - Internetdagarna 2015 - Stockholm
PPTX
Azure + DataStax Enterprise (DSE) Powers Office365 Per User Store
PPT
Champion Fas Deduplication
PPT
Drizzle Keynote at the MySQL User's Conference
PPT
IBM SAN Volume Controller Performance Analysis
PDF
Framework and Application Benchmarking
PDF
Application Performance Troubleshooting 1x1 - Von Schweinen, Schlangen und Pa...
5 Steps to Faster Web Sites and HTML5 Games
5 steps to faster web sites & HTML5 games - updated for DDDscot
Practical Performance Tips and Tricks to Make Your HTML/JavaScript Apps Faster
download it from here
gofortution
vBACD - Introduction to Opscode Chef - 2/29
Chicago Docker Meetup Presentation - Mediafly
HTTP cache @ PUG Rome 03-29-2011
Csdn Drdobbs Tenni Theurer Yahoo
Http/2 - What's it all about?
Check the version with fixes. Link in description
Swift: One Language To Rule Them All
Azure Nights August2017
The Case for HTTP/2 - Internetdagarna 2015 - Stockholm
Azure + DataStax Enterprise (DSE) Powers Office365 Per User Store
Champion Fas Deduplication
Drizzle Keynote at the MySQL User's Conference
IBM SAN Volume Controller Performance Analysis
Framework and Application Benchmarking
Application Performance Troubleshooting 1x1 - Von Schweinen, Schlangen und Pa...
Ad

More from Quest Software (10)

PPTX
Perfmon And Profiler 201
PPTX
Advanced Index Tuning for SQL Server
PPTX
Perfmon And Profiler 101
PPTX
Disaster Recovery 101
PPTX
CMDB Basics
PPTX
How To Write A SQL Server Performance Review
PPTX
Get Your Boss To Say Yes
PPTX
Sql Server Service Broker In The Real World
PPTX
Perfmon And Profiler 101
PPTX
Advanced Index Tuning
Perfmon And Profiler 201
Advanced Index Tuning for SQL Server
Perfmon And Profiler 101
Disaster Recovery 101
CMDB Basics
How To Write A SQL Server Performance Review
Get Your Boss To Say Yes
Sql Server Service Broker In The Real World
Perfmon And Profiler 101
Advanced Index Tuning

Recently uploaded (20)

PPTX
Effective Security Operations Center (SOC) A Modern, Strategic, and Threat-In...
PDF
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
 
PPTX
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
PDF
cuic standard and advanced reporting.pdf
PPTX
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
PDF
Network Security Unit 5.pdf for BCA BBA.
PDF
KodekX | Application Modernization Development
 
PDF
Machine learning based COVID-19 study performance prediction
PDF
Spectral efficient network and resource selection model in 5G networks
PPTX
sap open course for s4hana steps from ECC to s4
PDF
Review of recent advances in non-invasive hemoglobin estimation
PDF
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
PPTX
20250228 LYD VKU AI Blended-Learning.pptx
PPT
Teaching material agriculture food technology
PDF
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
PDF
Encapsulation theory and applications.pdf
PDF
Per capita expenditure prediction using model stacking based on satellite ima...
PDF
Advanced methodologies resolving dimensionality complications for autism neur...
PDF
Building Integrated photovoltaic BIPV_UPV.pdf
PPTX
Programs and apps: productivity, graphics, security and other tools
Effective Security Operations Center (SOC) A Modern, Strategic, and Threat-In...
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
 
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
cuic standard and advanced reporting.pdf
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
Network Security Unit 5.pdf for BCA BBA.
KodekX | Application Modernization Development
 
Machine learning based COVID-19 study performance prediction
Spectral efficient network and resource selection model in 5G networks
sap open course for s4hana steps from ECC to s4
Review of recent advances in non-invasive hemoglobin estimation
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
20250228 LYD VKU AI Blended-Learning.pptx
Teaching material agriculture food technology
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
Encapsulation theory and applications.pdf
Per capita expenditure prediction using model stacking based on satellite ima...
Advanced methodologies resolving dimensionality complications for autism neur...
Building Integrated photovoltaic BIPV_UPV.pdf
Programs and apps: productivity, graphics, security and other tools

SQL Server On SANs