Using Snap Clone with Enterprise Manager 12c

Copyright © 2015 Oracle and/or its affiliates. All rights reserved.
Enterprise Manager Snap Clone
Pete Sharman
Database Architect, DBaaS EM Team
pete.sharman@oracle.com
February 2015
Snapshot your data without snapping your storage

Safe Harbor Statement
The following is intended to outline our general product direction. It is intended for
information purposes only, and may not be incorporated into any contract. It is not a
commitment to deliver any material, code, or functionality, and should not be relied upon
in making purchasing decisions. The development, release, and timing of any features or
functionality described for Oracle’s products remains at the sole discretion of Oracle.

Session Abstract
Are database refresh challenges causing you to miss projects deadlines? Is your storage
cost for dev/test environments spiraling out of control? In this session, you will learn how
the Snap Clone feature of Oracle Cloud Management Pack for Oracle Database
• Can refresh production databases after masking and subsetting
• Can enable instant cloning of large databases (TBs) while saving more than 90 percent
on storage costs
• Fits perfectly with your existing investments in storage, servers, and engineered systems
• Is being used by other customers for large-scale environments

Program Agenda
1
2
3
4
Current Challenges
EM 12c Solution
Demo
Summary

The Obligatory Slide About Me
• 20 years with Oracle
– DBA instructor / Education Centre Manager
– HA Consultant
– Internal services curriculum developer
– North America Sales and Consulting database lead
– RAC Development
– ST Curriculum DBA / EM team
– Product Manager, EM Product Suite
– Database Architect, DBaaS, EM Product Suite
• OakTable member
• Presented at conferences all over the place
• Owner, petewhodidnottweet.com ☺

A Large Financial Institution – Storage Challenges
1 - 3 Years
SPARC x86
3 – 5 Years
Storage Cost / GB = $6.6/year
Estimated Annual Storage OPX
Cost “$198M/year” for Oracle
Environments
Applications Team: “1300 Apps
are utilizing private Cloud”
Storage Team: “We have 50 PB SAN.
Annual growth has ranged from 20-35%”
Database Team: “delivering
test data for UAT is a focus for private Cloud
this year ”
Very Small (less < 1 TB) 1,400 300 5
Small (1TB to 5TB) 500 3,000 5
Medium (5TB to 10TB) 75 7,500 7
Large (10TB to 15TB) 25 12,500 7
Very Large (>15TB) 20 20,000 7
Total: 2,020
Oracle DB
Size
Average
Number of
Non-prod
Environments
Average
DB Size
(GB)
Number
of
Applications
5 to 7 non-prod clones per production database
18 of 30 PB for non-prod Oracle environments
$122M of $198M for non-prod clones

Process Challenges
“Database Refresh
is a
necessary evil!”
60000
refresh/year
2000+
Dev/Test DB
3 – 5 TB
Typical DB size
RMAN
full clones
10 - 20
issues/day
EMC & NetApp
storage
- Christian Bilien,
Global Head of
Database Team

Evolution of Solutions
Point Features Point Tools EM Solution
Storage level:
snapshot,
volume/lun thin
clone, dedupe,
compression, etc
× Lacked DB or
application context
× Does not solve
process problem
VM cloning
DB cloning using
smart file systems
× Limited focus on
just cloning
× Lacked lifecycle
management of
clones
Technology
agnostic
End-to-End
automation from
prod to test/dev
Designed for DBAs
Complete mgmt of
clones - masking,
performance,
patch/upgrade, etc

EM Solution – Data Lifecycle Management (DLM)
Supports full and thin database clones
Technology Agnostic
End-to-End Automation – Prod to Test/Dev
Designed for DBAs
Integrated Masking, Subsetting, Patch, etc
Available via Admin Flows and Self Service portal
EMCLI and REST API for integrations

Strong Investment in EM’s Data Cloning Solution
EM 12c R2 EM 12c R3 EM 12c R4 EM 12c R4+
• Snap Clone for
NAS storage –
NetApp & Sun
ZFSSA
• RMAN backup
based clones
• Snap Clone
Analyzer to show
storage savings
• Snap Clone using
CloneDB
• Data Guard Standby
as a Test Master
• NetApp Ontap 8.x
cluster mode
• Certification for Eng.
systems, I/O over IB
• Support for NFSv4
• Snap Clone using
Solaris File System
(ZFS)
• Snap Clone for PDBs
(Admin Flows)
• Data Lifecycle Management
• Snap Clone using EMC SAN
and ASM
• Admin flows for test master
creation
• Integration with masking,
patching, upgrades, etc

Technology Agnostic
Data Lifecycle Management

Supported Cloning Options
Software Solution [Vendor Agnostic]
Hardware Solution [Vendor Specific]
Full Clones Snap (Thin) Clones
NAS SAN
Database Native [Storage Agnostic]
RMAN
Restore
RMAN
Restore
RMAN
Duplicate
RMAN
Duplicate
Data PumpData Pump
• Leverage your existing investments
• Cater to both functional and stress testing needs
• Maximize for best performance
Use Snap Clone whenever you need >1 clones!

Snap Clone using Solaris File System (ZFS)
• Uses a single stock Solaris 11.1+ image – physical or virtual [and NOT the
Sun ZS3 Appliance ]
• Supports any kind of storage – NAS or SAN
• For SAN, mount luns as raw disk and format with ZFS filesystem
• Does NOT require the snapshot/clone licenses from the storage vendor,
these features are available for free
• Additional features include compression, deduplication, IO caching, etc
• HA has to be handled externally either via Solaris Clusters, or by using HA
features of the underlying hypervisor

Solaris File System with SAN Storage Network Diagram

• Ability to create thin databases from
RMAN image copies
• Uses NFS v3 client embedded in
database
• Supported configurations
– Single instance databases
– Note: Only file system support for this
setup (No ASM)
• Supported Versions: 11.2.0.3+, 12.1
• Advantages
– Easy to setup
– No special storage software needed
– Works on all platforms
– Time efficient: Instantaneous cloning
– Space efficient: Create multiple clones
based on one backup
– Uses dNFS to improve performance,
high availability, and scalability of NFS
storage
CloneDB using DNFS

NAS Network Diagram
• Components:
• NAS storage
• Ethernet switch
• DB servers
• EM 12c
• Storage proxy host
(Agent managed
host)

Snap Clone on ASM + EMC Storage
• Ability to create ‘live’ thin clones of
databases on ASM
• Live Clone: NOT snapshot based, but
a live clone of DB
• Clone can be within the same or on
a different cluster
• EMC VMAX (with Time Finder
VPSnap) and VNX storage appliances
• Supported configurations: SI and
RAC
• Supported Versions: DB = 10.2.0.5 or
higher; GI = 11.2 and higher

End to End Automation
Data Lifecycle Management

Data Movement
Test Master
Database
NAME SSN SALARY
MILLER 112-23-4567 40,000
SMITH 111-22-3333 60,000
Masking &
Sub setting
Production
Database
010110011
101001010
000111010
NAME SSN SALARY
AGUILAR 203-33-3234 40,000
BENSON 323-22-2943 60,000
Prod DB Backups Mask / Subset Test Master Clones
Refresh
Data Guard Standby
Refresh

Deployment Scenarios
Continuous or Discrete Replication Standby / Test
Master Database
Production
Database
Snap Clones using Standby
Private backups
(snapshots) for SSA
user
Continuous Discrete
Technology Data Guard, Golden Gate RMAN, Snap Mirror, import/export …
Data Refresh Automatic and instantaneous Manual and at scheduled intervals
Masking and
Subsetting
Not possible At source (in production), or in place at test master
Replication Types:

DB Clone and Refresh – Admin Flow
Enable direct clones from production databases Works with patched or upgraded binary• Enable direct clones from production databases
• Provide automation to refresh the clone with data
changes in production
• Works for storage snapshots, RMAN backups, data
pump exports, etc
• Includes masking & subsetting
• Works with patched or upgraded binary
• If using clone as test master, allows self service users to
refresh existing clones with new data
• Reduces administrative overhead
Test Master
Database
NAME SSN SALARY
MILLER 112-23-4567 40,000
SMITH 111-22-3333 60,000
Masking &
Sub setting
Production
Database
NAME SSN SALARY
AGUILAR 203-33-3234 40,000
BENSON 323-22-2943 60,000

DB Clone and Refresh – Admin Flow
Mask
Subset
Update [Patch or Upgrade]
Change Configuration [SI / RAC]
Snap Clone
Use as Test Master
Version: 11.2.0.4
Config: 3 Node RAC
Data: RMAN Backup1
Version: 11.2.0.4.2
Config: Single Instance
Data: RMAN Backup1
t0 t1 t2 …. tN
Production Database Clone / Test Master
RMAN Backup / Data Pump / Storage Snapshot

Full or Snap Clone: How it Works?
Standby /
Test Master
t0 t1 t2 …. tN
Scheduled or Manual Storage Snapshots or RMAN Backups of the test master database, called Profiles
Private backups
Clones
• Clones can be created from any
profile
• Each user gets a personal read-
write database clone
Test master is
regularly
refreshed with
current data
from production

Self Service Provisioning and Service Catalog
• Out-of-box self service portal
• Catalog of different database configuration with
varied datasets
• Resource quota based on role
• Integrated monitoring, snapshot/rollback, etc

Complete APIs for Automation or Integration
DBaaS Providers:
• CRUD on Zones / Pools / Service templates / Profiles / Quota / etc
List
DBaaS
Portal & API
Deploy
Delete Manage
List Zones
List Service Templates
List Service Instances
Request DBs
Request PDBs
Request Schemas
Track request progress
Service Control (start/stop)
Backup
Restore
Snapshot
Get Chargeback info
Delete Service
Extend reservation

Complete REST API for Automation or Custom Portals
OR
Out of box Self Service Portal
POST :
https://example.oracle.com/em/cloud/dbaas/zone/82CF1C28FA20A18
3C99D138FF8065F19
Authorization: basic ZGVtb3VzZXI6ZGVtb3VzZXI=
Content-Type:
application/oracle.com.cloud.common.DbPlatformInstance+json
Accept:
application/oracle.com.cloud.common.DbPlatformInstance+json
Body:
{
"based_on":
"/em/cloud/dbaas/dbplatformtemplate/CC3BBB665A6BC6FFE040F00AEF
252456",
"name": "<Request name>",
"description": "<Request Description>",
"params":
{ "username": "Master Account username for the DB",
"password": "Password for the Master Account on the DB"
}
}

Demo
Self Service Data Cloning
(9:17)

Snap Clone Vs Competition
Scale, Scale, Scale
Supports 1 to 1000s of clones
Protects your existing investments
Choice between hardware and software solution
Use of trusted technologies like data guard for test master refresh
Part of Enterprise Manager 12c
Oracle’s flagship management product for all your database needs
In sync with DB releases (support for PDBs on day 1)
Secure and role based access control; used by Fortune 1000 customers
Protection from unnecessary point tools; reduce TCO

Test Master
Database
010110011
101001010
000111010
Snap Clone with Oracle Engineered Systems
Enterprise Manager
12c
Exadata
• Compute nodes are used to run snap
clone databases
• The storage is external to Exadata
and served over NFS
• In case of ZS3 storage, all traffic over
infiniband
SuperCluster
• Solaris Zones or LDOMS used to run
snap clone databases
• Embedded ZS3-ES storage served
over infiniband
Oracle Virtual Compute Appliance
• Oracle VMs used to run snap clone
databases
• Embedded ZS3-ES storage served
over infiniband
/source [nfs]
.. more
/clone1 [nfs]
External Storage
/clone2 [nfs]

Cloud Management Pack for Oracle Database Summary
Metering, ChargebackMetering, Chargeback
Supports Databases, Schema, and PDBsSupports Databases, Schema, and PDBs
Database CloningDatabase Cloning Full clones and Snap Clones (thin clones)Full clones and Snap Clones (thin clones)
Quota and Policy based ManagementQuota and Policy based Management
Self-Service ProvisioningSelf-Service Provisioning
Enforces governance and controlEnforces governance and control
Supports Database, Schema, and PDBsSupports Database, Schema, and PDBs
Comprehensive REST and EMCLI APIsComprehensive REST and EMCLI APIs For all self service and admin functionsFor all self service and admin functions
Enterprise-wide Service CatalogEnterprise-wide Service Catalog
Role based, Single catalog, to enforce
standardization across the DB estate
Role based, Single catalog, to enforce
standardization across the DB estate

References
• Enterprise Manager Page on O.com
• Cloud Management Page on OTN
• Cloud Administration Guide (Documentation)
• MOS Note: EM12c Recommended Plug-Ins and Patches for DBaaS
(1549855.1)

Using Snap Clone with Enterprise Manager 12c

Using Snap Clone with Enterprise Manager 12c

More Related Content

What's hot (20)

Similar to Using Snap Clone with Enterprise Manager 12c (20)

Recently uploaded (20)

Using Snap Clone with Enterprise Manager 12c