SlideShare a Scribd company logo
SharePoint Disaster
  Avoidance Architecture for
   Large Scale Enterprises
Cornelius J. van Dyk        Jason Himmelstein
Crayveon Corporation                    Sentri
c@crayveon.com         jhimmelstein@sentri.com
@cjvandyk                    @sharepointlhorn
• Chief Architect, Crayveon Corporation

• 7 time MVP, MCITP, MCTS

• Blog: www.cjvandyk.com/blog

• Twitter: @cjvandyk

• LinkedIn: http://www.linkedin.com/in/cjvandyk
• SharePoint Practice Director, Sentri Inc.
• MCITP, MCTS SharePoint 2010
• Microsoft vTSP
   ●   virtual Technology Solutions Professional

• SharePoint Foundation Logger
  (http://spflogger.codeplex.com)
• Web: www.sentri.com
• Blog: www.sharepointlonghorn.com
• Twitter: @sharepointlhorn
• LinkedIn: www.linkedin.com/in/jasonhimmelstein
Why do we do this?
Jason’s Family       Cornelius’ Family
GET TO KNOW YOU
• Name

• Company

• What you do with SharePoint

• Something interesting about yourself
DISASTER
• Outage vs Disaster

• When is a disaster actually a disaster?

• Traditional disaster planning
DISCUSSION GROUP BREAKOUT
• What is disaster planning to you?

• In the context of SharePoint

• Critical points
BUSINESS CONTINUITY PLANNING
• Business continuity planning identifies an
  organization's exposure to internal and external
  threats and synthesizes hard and soft assets to
  provide effective prevention and recovery for the
  organization, whilst maintaining competitive
  advantage and system integrity.

• Components
  ●   Planning
  ●   Testing
  ●   Validation
STRATEGIES
• Recovery Point Objective (RPO)

• Recovery Time Objective (RTO)

• Tolerance for down time
DISASTER PLANNING STEPS
• Executive Management Commitment

  ●   This costs money

  ●   Must invest to protect

  ●   Think of Insurance
DISASTER PLANNING STEPS
• Planning Committee

  ●   All business units represented

  ●   One person to lead – think Chief Justice

  ●   Responsibility

  ●   Authority
DISASTER PLANNING STEPS
• Risk Assessment

  ●   Business Impact Analysis

       • Natural Disasters

       • Technical Disasters

       • Human threats

       • Terrorism
DISASTER PLANNING STEPS
• Determine SLA

  ●   SLA for corporate users

  ●   SLA for internal customers

  ●   SLA for partner companies

  ●   SLA for public
DISASTER PLANNING STEPS
• Establish Priorities for Recovery

  ●   Critical Operations

  ●   Key Personnel

  ●   Vital Systems

  ●   Documentation/Records/Policies & Procedures
DISASTER PLANNING STEPS
• Determine Recovery Strategies

  ●   Facilities

       • Destroyed

       • Impaired

  ●   Hardware

       • Servers – replacement availability

       • Network – service providers
DISASTER PLANNING STEPS
• Determine Recovery Strategies

  ●   Software

       • Install ISOs

       • Updates

  ●   Communications

       • Inter-company

       • Partners & Public
DISASTER PLANNING STEPS
• Determine Recovery Strategies

  ●   Data

       • Backups

       • Availability

  ●   Company Services

  ●   Customer Services
DISASTER PLANNING STEPS
• Determine Recovery Strategies

  ●   Distributed architecture

       • Hot Site

       • Warm Site

       • Cold Site
DISASTER PLANNING STEPS
• Determine Recovery Strategies

  ●   Vendor Agreements

       • Circumstances constituting an emergency

       • Contract Duration

       • Termination Conditions

       • Cost

       • Testing
DISASTER PLANNING STEPS
• Determine Recovery Strategies

  ●   Vendor Agreements (cont.)

       • Security procedures

       • System change notifications

       • Hours of operation

       • Hardware requirements

       • Personnel requirements
DISASTER PLANNING STEPS
• Determine Recovery Strategies

  ●   Vendor Agreements (cont.)

       • Compatibility guarantee

       • Availability guarantee

       • Priorities with other customers
DISASTER PLANNING STEPS
• Perform Data Collection

  ●   Critical phone numbers

  ●   Hardware inventory

       • Vendor contact and equipment information

  ●   Software inventory

  ●   Notification checklist
DISASTER PLANNING STEPS
• Organize & Document a Written Plan

  ●   Plan should follow a checklist

  ●   Think rebuild from scratch

       • Notifications

       • Hardware

       • Software

       • Restore backups
DISASTER PLANNING STEPS
• Organize & Document a Written Plan (cont.)

  ●   Think rebuild from scratch (cont.)

       • Re-establish systems

       • Test & Validate

       • Communicate

       • After Action Review
DISASTER PLANNING STEPS
• Develop Testing Criteria & Procedures

• Test the plan

• Test the plan again

• Approve the plan
DISASTER PLANNING STEPS
• Ongoing plan validation

  ●   Annual testing

  ●   Scenario testing

  ●   Testing when something changes
TRADITIONAL DISASTER PLANNING
• Backups

• Log Shipping

• SQL Replication

• Hot Site
SHAREPOINT ARCHITECTURE
• Farm configuration

• 2 WFE, 2 APP, SQL Cluster

• The role of virtualization
RECOVERY vs AVOIDANCE
• What is Disaster Avoidance?

• A new way of looking at DR

• Why another DR strategy?

• What makes SPDAALSE different?
CAUSES OF DISASTERS
• Natural disasters such as floods, hurricanes,
  earthquakes, tornados, storms etc.

• Human induced such as accidents, acts of
  terrorism etc.

• Hardware failures such as drive crashes,
  memory or board failures etc.
CAUSES OF DISASTERS (cont)
• Malware such as worms, viruses etc.

• The one everyone forgets about…
• Software incompatibility when upgrading:

  ●   Operating systems

  ●   Software service pack

  ●   Software patches
SHAREPOINT CUMULATIVE UPDATES
• Bi-monthly

• Recommended by support

• History of hot fixes and re-releases

• Famously broke User Profile Services
CUs A NECCESARY EVIL
• Why apply them at all?

• What’s their risk?

• Can’t we just uninstall them?

• Compared to Exchange…
HOW DOES SPDAALSE HELP?
• Farm Architecture

• SharePoint databases

• Difference between data and configuration

• What makes Large Scale Enterprises different?
TRADITIONAL ARCHITECTURE


• DEMO
SPDAALSE ARCHITECTURE


• DEMO
THINKING DIFFERENT
• Separation of data and configuration

• Performance considerations

• Adding virtualization
IN ACTION
• Building the farm based on SPDAALSE

• Preparing the farm for testing

• Snapping the farm

• Backups
IN ACTION (cont)
• Patching the farm

• Testing the patch

• Rolling back

• Validating rollback
IN ACTION (cont)
• Demo
Agenda
•   Infrastructure Design
     ●   Analyze Customer Requirements
     ●   Hardware requirements
     ●   Server configuration
     ●   Network recommendations
     ●   Virtual vs. Physical
•   SQL Server Performance
     ●   Pre-grow vs. Auto-growth
     ●   IO requirements
     ●   Sizing recommendations
     ●   Database Isolation
•   SharePoint Server Performance
     ●   Tier isolation vs. Location Proximity Requirements
     ●   Load balancing your App Tier
     ●   Load testing in your environment
     ●   Governance & Troubleshooting
Infrastructure Design
• Analyze Customer Requirements
   ●   High Availability
   ●   Disaster Recovery
   ●   Budget Constraints
   ●   Location Awareness
   ●   Number of Concurrent Users
Infrastructure Design
• Hardware requirements
   ●   Web servers & Application servers
            Developer or Evaluation environments             Production in Single Server or farm
                CPU: 4 cores, 64-bit required                          environments
                         RAM: 4GB                               CPU: 4 cores, 64-bit required
                  Hard Drive space: 80GB                                 RAM: 8GB
                                                                  Hard Drive space: 80GB



   ●   SQL servers
               Small Farm                     Medium Farm                       Large Farm
       CPU: 4 cores, 64-bit required   CPU: 8 cores, 64-bit required      Up to 2TB Content DBS
               RAM: 8GB                        RAM: 16GB                        RAM: 32 GB
         Hard Drive space: 80GB          Hard Drive space: 80GB        From 2TB to 5TB Content DBS
                                                                                RAM: 64 GB



• What constitutes a small/medium/large farm?
Infrastructure Design
• Server configuration – Small Farm
Infrastructure Design
• Server configuration – Scaled Farm
Infrastructure Design
Infrastructure Design
• Network recommendations
  ●   Traffic Isolation
       •   Web
       •   Database
       •   Search
       •   Service Applications
       •   Authentication
  ●   Number of NICs per server
  ●   Limit the number of hops
  ●   Colocation of servers
Infrastructure Design

• Physical
   ●   Benefits
        •   No virtualization overhead
        •   Ability to target DBs to separate physical spindles
        •   Only OS limits on Hardware
        •   Simple Networking
   ●   Drawbacks
        •   Backup & recovery time
        •   Limited snapshot ability
        •   Costly & lacking Centralized Management
        •   Failover limitations
Infrastructure Design

• Virtualization
   ●   Benefits
        •   Snapshot capability
        •   Rapid system deployment
        •   HADR ability
        •   Centralized Management
   ●   Drawbacks
        •   Loss of minimum 8% compute for overhead
        •   Limitations on addressing full hardware
        •   Disks are stored as single/multi-file
        •   Centralized Networking
SQL Server Performance

• Pre-grow databases
   ●   Requires more space initially
   ●   Dramatic increase in performance
   ●   Databases like contiguous space
• Auto-growth
   ●   Immediately change from 1m increments
   ●   Do not use “Grow by %” setting
   ●   50-100m maximum growth per required
   ●   Schedule maintenance task to check size & grow in off peak
       hours as required
SQL Server Performance
• IO requirements
                         DB Files             RAID Level   Optimization
        1              TempDB data               10           Write
        2              TempDB logs               10           Write
        3             ContentDB data             10         ReadWrite
        4             ContentDB logs             10           Write
        5              Crawl DB logs             10           Write
        6              Crawl DB data             10         ReadWrite
        7             Property DB logs           10           Write
        8             Property DB data           10           Write
        9             Services DB logs           10           Write
        10            Services DB data           5/10       ReadWrite
        11           Archive Content DB           5           Read
        12       Publishing Site Content DB       5           Read
SQL Server Performance
• Sizing recommendations
  ●   Recommended limit for ContentDBs: 200G
       • Maximum supported: 4TB
           – Includes Remote BLOBs
  ●   Backup/Restore timing
  ●   Simple vs. Full recovery mode
SQL Server Performance
• Database Instance Isolation
   ●   Secure Store Database
   ●   SharePoint core databases
   ●   Content Databases
   ●   Search
   ●   Highly Transactional non-SharePoint DBs
• Drawback
   ●   Lose the central management in a single SQL Server
       Management Studio window
SharePoint Server Performance
• Tier isolation vs. Location Proximity Requirements
   ●   Separation via vLAN
        • Less chatter
        • Increased hop count
   ●   Collocating SharePoint in a single vLAN
        • Increased chatter
        • Lower hop count
• Key take away
   ●   Know your network, determine your topology based upon traffic
       & requirements
SharePoint Server Performance
• Load balancing your App Tier
   ●   Know your load
   ●   Scale based upon need, not perception


• Find your choke point,
      then release the grasp
   ●   Don’t assume, validate!
SharePoint Server Performance

  • Load testing in your environment
     ●   Example
          • 2 Web Servers (4cores, 16GB RAM) using NLB
          • 1 App Server (4cores, 16 GB RAM)
          • 1 SQL Server Instance (16cores, 128GB RAM)

          • Simple CRUD operations
              – Login, create list item, open item, modify item, save item, delete item,
                log out
SharePoint Server Performance

• Load testing in your environment
   ●   Results
        • Farm was completely non-responsive at ~500 concurrent users
   ●   Root cause
        • Watching this test on the server side we found that we were
          immediately CPU bound.
   ●   Conclusion
        • Add CPUs or Web Servers to the farm to handle additional load
References
•   Jason’s Blog                                       Sentri, Inc              SharePoint Foundation Logger
     http://www.sharepointlonghorn.com                 http://www.sentri.com    http://spflogger.codeplex.com
•    My Article on SharePoint Pro
     http://www.sharepointpromag.com/content1/topic/sharepoint-performance-troubleshooting-141506/catpath/sharepoint-server-2010
•   Cornelius J. van Dyk’s Blog
     http://www.cjvandyk.com/blog
•    Eric Shupps’s Blog
     http://www.sharepointcowboy.com
•   SharePoint Server 2010 Hardware and software requirements
     http://technet.microsoft.com/en-us/library/cc262485.aspx
•   SharePoint Server 2010 Capacity Management: Software Boundaries and Limits
     http://technet.microsoft.com/en-us/library/cc262787.aspx
•   Capacity Management and Sizing Overview for SharePoint Server 2010
     http://technet.microsoft.com/en-us/library/ff758647.aspx
•   Capacity Planning for SharePoint Server 2010
     http://technet.microsoft.com/en-us/library/ff758645.aspx
•   Performance Testing for SharePoint Server 2010
     http://technet.microsoft.com/en-us/library/ff758659.aspx
•   Storage and SQL Server Capacity Planning and Configuration
     http://technet.microsoft.com/en-us/library/cc298801.aspx
•   Performance and Capacity Technical Case Studies
     http://technet.microsoft.com/en-us/library/cc261716.aspx
•   Monitoring and Maintaining SharePoint Server 2010
     http://technet.microsoft.com/en-us/library/ff758658.aspx
•   Performance Testing for SharePoint Server 2010
     http://technet.microsoft.com/en-us/library/ff758659.aspx
•   The Load Testing Kit for Visual Studio Team System
     http://technet.microsoft.com/en-us/library/ff823731.aspx
•   Web Capacity Analysis Tool (WCAT)
     http://www.iis.net/community/default.aspx?tabid=34&g=6&i=1466
REFERENCES
• @cjvandyk @sharepointlhorn

• www.cjvandyk.com/blog
  www.sharepointlonghorn.com

•   Deck download http://aurl.to/SPDAALSE
•   Painless deck http://aurl.to/Painless
•   Logging deck http://aurl.to/logging
•   PowerPivot deck http://aurl.to/HMPP
•   Versions List http://aurl.to/v
•   Corne’s Utils http://quix.codeplex.com
Your Feedback is Important

 Please fill out a session evaluation form
  drop it off at the conference registration
                      desk.

                Thank you!

More Related Content

PDF
End of RAID as we know it with Ceph Replication
PDF
Implementing Parallelism in PostgreSQL - PGCon 2014
 
PDF
5 Ways to Avoid Server and Application Downtime
PPTX
High Performance Cloud Computing
PPTX
Next Generation Software-Defined Storage
PPTX
24 Hours of PASS, Summit Preview Session: Virtual SQL Server CPUs
PPTX
Handling Massive Writes
PDF
TechTalkThai webinar SAP HANA
End of RAID as we know it with Ceph Replication
Implementing Parallelism in PostgreSQL - PGCon 2014
 
5 Ways to Avoid Server and Application Downtime
High Performance Cloud Computing
Next Generation Software-Defined Storage
24 Hours of PASS, Summit Preview Session: Virtual SQL Server CPUs
Handling Massive Writes
TechTalkThai webinar SAP HANA

What's hot (20)

PDF
Nippon It Solutions Data services offering 2015
PDF
TechTalkThai-CiscoHyperFlex
PDF
Nagios Conference 2014 - Jeremy Rust - Avoiding Downtime Using Linux High Ava...
PPTX
Severalnines Self-Training: MySQL® Cluster - Part VIII
PDF
Virtualizing Mission-critical Workloads: The PlateSpin Story
PDF
Accelerating Server Hardware Upgrades with PlateSpin Migrate P2P
PDF
EnterpriseDB BackUp and Recovery Tool
 
PDF
Introducing Postgres Enterprise Manager 5.0
 
PDF
Apache hbase for the enterprise (Strata+Hadoop World 2012)
PPTX
Whd master deck_final
PDF
AMER Webcast: VMware Virtual SAN
PPTX
Strata + Hadoop World 2012: Apache HBase Features for the Enterprise
PPTX
Building Storage for Clouds (ONUG Spring 2015)
PPTX
Severalnines Self-Training: MySQL® Cluster - Part VII
PDF
How to build a winning solution for large scale VDI deployments
PPTX
2015 deploying flash in the data center
PPTX
Severalnines Self-Training: MySQL® Cluster - Part II
PDF
Migrating P2V: SUSE Linux Enterprise Server with Xen
PPTX
Severalnines Self-Training: MySQL® Cluster - Part V
PPTX
50 migrations in 24 hours
Nippon It Solutions Data services offering 2015
TechTalkThai-CiscoHyperFlex
Nagios Conference 2014 - Jeremy Rust - Avoiding Downtime Using Linux High Ava...
Severalnines Self-Training: MySQL® Cluster - Part VIII
Virtualizing Mission-critical Workloads: The PlateSpin Story
Accelerating Server Hardware Upgrades with PlateSpin Migrate P2P
EnterpriseDB BackUp and Recovery Tool
 
Introducing Postgres Enterprise Manager 5.0
 
Apache hbase for the enterprise (Strata+Hadoop World 2012)
Whd master deck_final
AMER Webcast: VMware Virtual SAN
Strata + Hadoop World 2012: Apache HBase Features for the Enterprise
Building Storage for Clouds (ONUG Spring 2015)
Severalnines Self-Training: MySQL® Cluster - Part VII
How to build a winning solution for large scale VDI deployments
2015 deploying flash in the data center
Severalnines Self-Training: MySQL® Cluster - Part II
Migrating P2V: SUSE Linux Enterprise Server with Xen
Severalnines Self-Training: MySQL® Cluster - Part V
50 migrations in 24 hours
Ad

Viewers also liked (20)

PPT
Disaster Resilient Structures
PPT
50 Days of ideas to use with theUltranet Message Boards
PDF
Preparing for the Worst: Disaster Planning at the Art, Architecture, and Engi...
PPTX
A Novel Architecture for Disaster Response Workflow Management Systems
PPTX
Causes Of Global Hazards
PPT
Desaster Mgt
PPT
Disaster preparedness
PPT
Natural Disasters
PPTX
2. how does your media product represent particular social groups
PPT
Fire disaster and management IIT Roorkee
PPTX
What are natural disasters
PPTX
Architectural Patterns - Interactive and Event Handling Patterns
PPTX
Natural Disasters In South Asia
PPTX
D.R.I.P.S, LLC.
PDF
Case Study: Jack Henry & Associates Automates Application Deployments Through...
PPTX
Greg Young on Architectural Innovation: Eventing, Event Sourcing
PPTX
Natural Disasters: A comprehensive Presentation
PPT
How Natural Disasters Impact the Environment 2013
PPT
5 Steps to Fabric Structure Success
PPTX
Design and disaster mitigation
Disaster Resilient Structures
50 Days of ideas to use with theUltranet Message Boards
Preparing for the Worst: Disaster Planning at the Art, Architecture, and Engi...
A Novel Architecture for Disaster Response Workflow Management Systems
Causes Of Global Hazards
Desaster Mgt
Disaster preparedness
Natural Disasters
2. how does your media product represent particular social groups
Fire disaster and management IIT Roorkee
What are natural disasters
Architectural Patterns - Interactive and Event Handling Patterns
Natural Disasters In South Asia
D.R.I.P.S, LLC.
Case Study: Jack Henry & Associates Automates Application Deployments Through...
Greg Young on Architectural Innovation: Eventing, Event Sourcing
Natural Disasters: A comprehensive Presentation
How Natural Disasters Impact the Environment 2013
5 Steps to Fabric Structure Success
Design and disaster mitigation
Ad

Similar to Share point disaster avoidance architecture for large scale enterprises (20)

KEY
Cloud Computing & Scaling Web Apps
PPTX
Webinar- Simple and Cost-Effective Disaster Recovery in the Cloud - 7-19-12
PDF
VISIT2008 Weatherforecast For IT
PPTX
Building the Perfect SharePoint 2010 Farm - MS Days Bulgaria 2012
PPT
Cloud Hosting for Government Agencies: Drupal Platform as a Service
PPTX
클라우드 컴퓨팅에 따른 데이터센터의 변화
PDF
The Build vs. Buy Decision for SaaS Delivery
PDF
Virtualisatie In Het NGDC - Marc Janssen
PPTX
Introduction to Windows Azure and Windows Azure SQL Database
PDF
Service Manager Cloud Seminar introcustext
PDF
Oracle Systems _ Kevin Mcisaac _ The IT Landscape has changes - have you_.pdf
PDF
Infrastructure Consolidation and Virtualization
PPTX
Resource Monitoring and Management II
PDF
Sansymphony v-r9
PDF
FewebPlus @ microsoft 19 april 2010 cloud continuum
PDF
SANsymphony V
PDF
Oracle Systems _ Kevin McIsaac _The IT landscape has changed.pdf
PDF
Cloud computing 2012
PDF
PPTX
Windows Azure Platform
Cloud Computing & Scaling Web Apps
Webinar- Simple and Cost-Effective Disaster Recovery in the Cloud - 7-19-12
VISIT2008 Weatherforecast For IT
Building the Perfect SharePoint 2010 Farm - MS Days Bulgaria 2012
Cloud Hosting for Government Agencies: Drupal Platform as a Service
클라우드 컴퓨팅에 따른 데이터센터의 변화
The Build vs. Buy Decision for SaaS Delivery
Virtualisatie In Het NGDC - Marc Janssen
Introduction to Windows Azure and Windows Azure SQL Database
Service Manager Cloud Seminar introcustext
Oracle Systems _ Kevin Mcisaac _ The IT Landscape has changes - have you_.pdf
Infrastructure Consolidation and Virtualization
Resource Monitoring and Management II
Sansymphony v-r9
FewebPlus @ microsoft 19 april 2010 cloud continuum
SANsymphony V
Oracle Systems _ Kevin McIsaac _The IT landscape has changed.pdf
Cloud computing 2012
Windows Azure Platform

More from Sentri (20)

PDF
Uncover the Benefits of Office 365 & Windows Azure
PDF
Discover SharePoint 2013 & Dynamics CRM
PDF
Explore Microsoft Lync & Exchange 2013 Webinar
PDF
Relationship Management for Property Investment Management webinar 2.5.13
PDF
SharePoint 2013 Communities Overview for SPS Philly
PDF
Move Storage to the Cloud with Windows Azure webinar 2.21.2013
PDF
SharePoint 2013 Extranets webinar
PDF
Lync Intro Exchange User Group New York 2_12_2013
PDF
Lync IM and Presence Sentri webinar 2.7.13
PDF
WEBINAR: Uncover the Benefits of Office 365 and Windows Azure
PDF
SharePoint 2013 Unveiled webinar 1.24.13
PDF
Webinar: Understanding the System Center suite & Windows Server 2012
PDF
Sentri Webinar: Microsoft Lync Exchange 2013
PDF
Windows Azure overview webinar by Sentri
PDF
SystemCenter webinar 12 6 12
PDF
Exchange 2013 webinar
PDF
Share point 2013 webinar november 2012
PDF
Empowering Collaboration through Self-Service BI
PDF
Empowering Collaboration through Self-Service BI
PDF
Exchange 2013
Uncover the Benefits of Office 365 & Windows Azure
Discover SharePoint 2013 & Dynamics CRM
Explore Microsoft Lync & Exchange 2013 Webinar
Relationship Management for Property Investment Management webinar 2.5.13
SharePoint 2013 Communities Overview for SPS Philly
Move Storage to the Cloud with Windows Azure webinar 2.21.2013
SharePoint 2013 Extranets webinar
Lync Intro Exchange User Group New York 2_12_2013
Lync IM and Presence Sentri webinar 2.7.13
WEBINAR: Uncover the Benefits of Office 365 and Windows Azure
SharePoint 2013 Unveiled webinar 1.24.13
Webinar: Understanding the System Center suite & Windows Server 2012
Sentri Webinar: Microsoft Lync Exchange 2013
Windows Azure overview webinar by Sentri
SystemCenter webinar 12 6 12
Exchange 2013 webinar
Share point 2013 webinar november 2012
Empowering Collaboration through Self-Service BI
Empowering Collaboration through Self-Service BI
Exchange 2013

Recently uploaded (20)

PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
PDF
Approach and Philosophy of On baking technology
PDF
The Rise and Fall of 3GPP – Time for a Sabbatical?
PPTX
MYSQL Presentation for SQL database connectivity
PDF
Bridging biosciences and deep learning for revolutionary discoveries: a compr...
PPT
“AI and Expert System Decision Support & Business Intelligence Systems”
PPTX
Effective Security Operations Center (SOC) A Modern, Strategic, and Threat-In...
PDF
CIFDAQ's Market Insight: SEC Turns Pro Crypto
PDF
Unlocking AI with Model Context Protocol (MCP)
PDF
Encapsulation theory and applications.pdf
PDF
Network Security Unit 5.pdf for BCA BBA.
PDF
Empathic Computing: Creating Shared Understanding
PDF
Reach Out and Touch Someone: Haptics and Empathic Computing
PDF
cuic standard and advanced reporting.pdf
DOCX
The AUB Centre for AI in Media Proposal.docx
PPTX
Understanding_Digital_Forensics_Presentation.pptx
PDF
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
PPTX
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
PDF
Shreyas Phanse Resume: Experienced Backend Engineer | Java • Spring Boot • Ka...
PDF
Review of recent advances in non-invasive hemoglobin estimation
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
Approach and Philosophy of On baking technology
The Rise and Fall of 3GPP – Time for a Sabbatical?
MYSQL Presentation for SQL database connectivity
Bridging biosciences and deep learning for revolutionary discoveries: a compr...
“AI and Expert System Decision Support & Business Intelligence Systems”
Effective Security Operations Center (SOC) A Modern, Strategic, and Threat-In...
CIFDAQ's Market Insight: SEC Turns Pro Crypto
Unlocking AI with Model Context Protocol (MCP)
Encapsulation theory and applications.pdf
Network Security Unit 5.pdf for BCA BBA.
Empathic Computing: Creating Shared Understanding
Reach Out and Touch Someone: Haptics and Empathic Computing
cuic standard and advanced reporting.pdf
The AUB Centre for AI in Media Proposal.docx
Understanding_Digital_Forensics_Presentation.pptx
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
Shreyas Phanse Resume: Experienced Backend Engineer | Java • Spring Boot • Ka...
Review of recent advances in non-invasive hemoglobin estimation

Share point disaster avoidance architecture for large scale enterprises

  • 1. SharePoint Disaster Avoidance Architecture for Large Scale Enterprises Cornelius J. van Dyk Jason Himmelstein Crayveon Corporation Sentri c@crayveon.com jhimmelstein@sentri.com @cjvandyk @sharepointlhorn
  • 2. • Chief Architect, Crayveon Corporation • 7 time MVP, MCITP, MCTS • Blog: www.cjvandyk.com/blog • Twitter: @cjvandyk • LinkedIn: http://www.linkedin.com/in/cjvandyk
  • 3. • SharePoint Practice Director, Sentri Inc. • MCITP, MCTS SharePoint 2010 • Microsoft vTSP ● virtual Technology Solutions Professional • SharePoint Foundation Logger (http://spflogger.codeplex.com) • Web: www.sentri.com • Blog: www.sharepointlonghorn.com • Twitter: @sharepointlhorn • LinkedIn: www.linkedin.com/in/jasonhimmelstein
  • 4. Why do we do this? Jason’s Family Cornelius’ Family
  • 5. GET TO KNOW YOU • Name • Company • What you do with SharePoint • Something interesting about yourself
  • 6. DISASTER • Outage vs Disaster • When is a disaster actually a disaster? • Traditional disaster planning
  • 7. DISCUSSION GROUP BREAKOUT • What is disaster planning to you? • In the context of SharePoint • Critical points
  • 8. BUSINESS CONTINUITY PLANNING • Business continuity planning identifies an organization's exposure to internal and external threats and synthesizes hard and soft assets to provide effective prevention and recovery for the organization, whilst maintaining competitive advantage and system integrity. • Components ● Planning ● Testing ● Validation
  • 9. STRATEGIES • Recovery Point Objective (RPO) • Recovery Time Objective (RTO) • Tolerance for down time
  • 10. DISASTER PLANNING STEPS • Executive Management Commitment ● This costs money ● Must invest to protect ● Think of Insurance
  • 11. DISASTER PLANNING STEPS • Planning Committee ● All business units represented ● One person to lead – think Chief Justice ● Responsibility ● Authority
  • 12. DISASTER PLANNING STEPS • Risk Assessment ● Business Impact Analysis • Natural Disasters • Technical Disasters • Human threats • Terrorism
  • 13. DISASTER PLANNING STEPS • Determine SLA ● SLA for corporate users ● SLA for internal customers ● SLA for partner companies ● SLA for public
  • 14. DISASTER PLANNING STEPS • Establish Priorities for Recovery ● Critical Operations ● Key Personnel ● Vital Systems ● Documentation/Records/Policies & Procedures
  • 15. DISASTER PLANNING STEPS • Determine Recovery Strategies ● Facilities • Destroyed • Impaired ● Hardware • Servers – replacement availability • Network – service providers
  • 16. DISASTER PLANNING STEPS • Determine Recovery Strategies ● Software • Install ISOs • Updates ● Communications • Inter-company • Partners & Public
  • 17. DISASTER PLANNING STEPS • Determine Recovery Strategies ● Data • Backups • Availability ● Company Services ● Customer Services
  • 18. DISASTER PLANNING STEPS • Determine Recovery Strategies ● Distributed architecture • Hot Site • Warm Site • Cold Site
  • 19. DISASTER PLANNING STEPS • Determine Recovery Strategies ● Vendor Agreements • Circumstances constituting an emergency • Contract Duration • Termination Conditions • Cost • Testing
  • 20. DISASTER PLANNING STEPS • Determine Recovery Strategies ● Vendor Agreements (cont.) • Security procedures • System change notifications • Hours of operation • Hardware requirements • Personnel requirements
  • 21. DISASTER PLANNING STEPS • Determine Recovery Strategies ● Vendor Agreements (cont.) • Compatibility guarantee • Availability guarantee • Priorities with other customers
  • 22. DISASTER PLANNING STEPS • Perform Data Collection ● Critical phone numbers ● Hardware inventory • Vendor contact and equipment information ● Software inventory ● Notification checklist
  • 23. DISASTER PLANNING STEPS • Organize & Document a Written Plan ● Plan should follow a checklist ● Think rebuild from scratch • Notifications • Hardware • Software • Restore backups
  • 24. DISASTER PLANNING STEPS • Organize & Document a Written Plan (cont.) ● Think rebuild from scratch (cont.) • Re-establish systems • Test & Validate • Communicate • After Action Review
  • 25. DISASTER PLANNING STEPS • Develop Testing Criteria & Procedures • Test the plan • Test the plan again • Approve the plan
  • 26. DISASTER PLANNING STEPS • Ongoing plan validation ● Annual testing ● Scenario testing ● Testing when something changes
  • 27. TRADITIONAL DISASTER PLANNING • Backups • Log Shipping • SQL Replication • Hot Site
  • 28. SHAREPOINT ARCHITECTURE • Farm configuration • 2 WFE, 2 APP, SQL Cluster • The role of virtualization
  • 29. RECOVERY vs AVOIDANCE • What is Disaster Avoidance? • A new way of looking at DR • Why another DR strategy? • What makes SPDAALSE different?
  • 30. CAUSES OF DISASTERS • Natural disasters such as floods, hurricanes, earthquakes, tornados, storms etc. • Human induced such as accidents, acts of terrorism etc. • Hardware failures such as drive crashes, memory or board failures etc.
  • 31. CAUSES OF DISASTERS (cont) • Malware such as worms, viruses etc. • The one everyone forgets about… • Software incompatibility when upgrading: ● Operating systems ● Software service pack ● Software patches
  • 32. SHAREPOINT CUMULATIVE UPDATES • Bi-monthly • Recommended by support • History of hot fixes and re-releases • Famously broke User Profile Services
  • 33. CUs A NECCESARY EVIL • Why apply them at all? • What’s their risk? • Can’t we just uninstall them? • Compared to Exchange…
  • 34. HOW DOES SPDAALSE HELP? • Farm Architecture • SharePoint databases • Difference between data and configuration • What makes Large Scale Enterprises different?
  • 37. THINKING DIFFERENT • Separation of data and configuration • Performance considerations • Adding virtualization
  • 38. IN ACTION • Building the farm based on SPDAALSE • Preparing the farm for testing • Snapping the farm • Backups
  • 39. IN ACTION (cont) • Patching the farm • Testing the patch • Rolling back • Validating rollback
  • 41. Agenda • Infrastructure Design ● Analyze Customer Requirements ● Hardware requirements ● Server configuration ● Network recommendations ● Virtual vs. Physical • SQL Server Performance ● Pre-grow vs. Auto-growth ● IO requirements ● Sizing recommendations ● Database Isolation • SharePoint Server Performance ● Tier isolation vs. Location Proximity Requirements ● Load balancing your App Tier ● Load testing in your environment ● Governance & Troubleshooting
  • 42. Infrastructure Design • Analyze Customer Requirements ● High Availability ● Disaster Recovery ● Budget Constraints ● Location Awareness ● Number of Concurrent Users
  • 43. Infrastructure Design • Hardware requirements ● Web servers & Application servers Developer or Evaluation environments Production in Single Server or farm CPU: 4 cores, 64-bit required environments RAM: 4GB CPU: 4 cores, 64-bit required Hard Drive space: 80GB RAM: 8GB Hard Drive space: 80GB ● SQL servers Small Farm Medium Farm Large Farm CPU: 4 cores, 64-bit required CPU: 8 cores, 64-bit required Up to 2TB Content DBS RAM: 8GB RAM: 16GB RAM: 32 GB Hard Drive space: 80GB Hard Drive space: 80GB From 2TB to 5TB Content DBS RAM: 64 GB • What constitutes a small/medium/large farm?
  • 44. Infrastructure Design • Server configuration – Small Farm
  • 45. Infrastructure Design • Server configuration – Scaled Farm
  • 47. Infrastructure Design • Network recommendations ● Traffic Isolation • Web • Database • Search • Service Applications • Authentication ● Number of NICs per server ● Limit the number of hops ● Colocation of servers
  • 48. Infrastructure Design • Physical ● Benefits • No virtualization overhead • Ability to target DBs to separate physical spindles • Only OS limits on Hardware • Simple Networking ● Drawbacks • Backup & recovery time • Limited snapshot ability • Costly & lacking Centralized Management • Failover limitations
  • 49. Infrastructure Design • Virtualization ● Benefits • Snapshot capability • Rapid system deployment • HADR ability • Centralized Management ● Drawbacks • Loss of minimum 8% compute for overhead • Limitations on addressing full hardware • Disks are stored as single/multi-file • Centralized Networking
  • 50. SQL Server Performance • Pre-grow databases ● Requires more space initially ● Dramatic increase in performance ● Databases like contiguous space • Auto-growth ● Immediately change from 1m increments ● Do not use “Grow by %” setting ● 50-100m maximum growth per required ● Schedule maintenance task to check size & grow in off peak hours as required
  • 51. SQL Server Performance • IO requirements DB Files RAID Level Optimization 1 TempDB data 10 Write 2 TempDB logs 10 Write 3 ContentDB data 10 ReadWrite 4 ContentDB logs 10 Write 5 Crawl DB logs 10 Write 6 Crawl DB data 10 ReadWrite 7 Property DB logs 10 Write 8 Property DB data 10 Write 9 Services DB logs 10 Write 10 Services DB data 5/10 ReadWrite 11 Archive Content DB 5 Read 12 Publishing Site Content DB 5 Read
  • 52. SQL Server Performance • Sizing recommendations ● Recommended limit for ContentDBs: 200G • Maximum supported: 4TB – Includes Remote BLOBs ● Backup/Restore timing ● Simple vs. Full recovery mode
  • 53. SQL Server Performance • Database Instance Isolation ● Secure Store Database ● SharePoint core databases ● Content Databases ● Search ● Highly Transactional non-SharePoint DBs • Drawback ● Lose the central management in a single SQL Server Management Studio window
  • 54. SharePoint Server Performance • Tier isolation vs. Location Proximity Requirements ● Separation via vLAN • Less chatter • Increased hop count ● Collocating SharePoint in a single vLAN • Increased chatter • Lower hop count • Key take away ● Know your network, determine your topology based upon traffic & requirements
  • 55. SharePoint Server Performance • Load balancing your App Tier ● Know your load ● Scale based upon need, not perception • Find your choke point, then release the grasp ● Don’t assume, validate!
  • 56. SharePoint Server Performance • Load testing in your environment ● Example • 2 Web Servers (4cores, 16GB RAM) using NLB • 1 App Server (4cores, 16 GB RAM) • 1 SQL Server Instance (16cores, 128GB RAM) • Simple CRUD operations – Login, create list item, open item, modify item, save item, delete item, log out
  • 57. SharePoint Server Performance • Load testing in your environment ● Results • Farm was completely non-responsive at ~500 concurrent users ● Root cause • Watching this test on the server side we found that we were immediately CPU bound. ● Conclusion • Add CPUs or Web Servers to the farm to handle additional load
  • 58. References • Jason’s Blog Sentri, Inc SharePoint Foundation Logger http://www.sharepointlonghorn.com http://www.sentri.com http://spflogger.codeplex.com • My Article on SharePoint Pro http://www.sharepointpromag.com/content1/topic/sharepoint-performance-troubleshooting-141506/catpath/sharepoint-server-2010 • Cornelius J. van Dyk’s Blog http://www.cjvandyk.com/blog • Eric Shupps’s Blog http://www.sharepointcowboy.com • SharePoint Server 2010 Hardware and software requirements http://technet.microsoft.com/en-us/library/cc262485.aspx • SharePoint Server 2010 Capacity Management: Software Boundaries and Limits http://technet.microsoft.com/en-us/library/cc262787.aspx • Capacity Management and Sizing Overview for SharePoint Server 2010 http://technet.microsoft.com/en-us/library/ff758647.aspx • Capacity Planning for SharePoint Server 2010 http://technet.microsoft.com/en-us/library/ff758645.aspx • Performance Testing for SharePoint Server 2010 http://technet.microsoft.com/en-us/library/ff758659.aspx • Storage and SQL Server Capacity Planning and Configuration http://technet.microsoft.com/en-us/library/cc298801.aspx • Performance and Capacity Technical Case Studies http://technet.microsoft.com/en-us/library/cc261716.aspx • Monitoring and Maintaining SharePoint Server 2010 http://technet.microsoft.com/en-us/library/ff758658.aspx • Performance Testing for SharePoint Server 2010 http://technet.microsoft.com/en-us/library/ff758659.aspx • The Load Testing Kit for Visual Studio Team System http://technet.microsoft.com/en-us/library/ff823731.aspx • Web Capacity Analysis Tool (WCAT) http://www.iis.net/community/default.aspx?tabid=34&g=6&i=1466
  • 59. REFERENCES • @cjvandyk @sharepointlhorn • www.cjvandyk.com/blog www.sharepointlonghorn.com • Deck download http://aurl.to/SPDAALSE • Painless deck http://aurl.to/Painless • Logging deck http://aurl.to/logging • PowerPivot deck http://aurl.to/HMPP • Versions List http://aurl.to/v • Corne’s Utils http://quix.codeplex.com
  • 60. Your Feedback is Important Please fill out a session evaluation form drop it off at the conference registration desk. Thank you!