SlideShare a Scribd company logo
Managing Oracle Enterprise
Manager Cloud Control 12c
with Oracle Clusterware
Session ID#UGF9794
Leighton L. Nelson
Mercy
About Me
• Oracle DBA for 10+ years
• Oracle ACE
• Oracle Certified Expert: RAC and Grid Infrastructure
11gR2
• Co-Author Expert Oracle Enterprise Manager Cloud
Control 12c – Apress 2013
• Oracle RAC SIG US Events Chair/IOUG Liaison
Agenda
• OEM 12c Architecture Overview
• OEM High Availability
• Level 2 HA Configuration
• Oracle Clusterware Setup
• OEM Installation
• OEM Failover
• Management Repository Configuration
OEM 12c Architecture Overview
OEM High Availability Levels
Level Description Load Balancer Required Cost
1 OMS and Repository on separate hosts.
No redundancy.
No $
2 OMS installed on shared storage with VIP used in
active/passive failover.
Repository Database using local Data Guard.
No $$
3 Multiple OMSs in active/active configuration.
Repository using RAC Database with local Data Guard
Yes, At primary site $$$
4 Primary OMS in active/active configuration with RAC
Repository database. Standby OMS at DR site in
active/active configuration. Standby RAC database at
DR site
Yes. At pimary and standby
sites
$$$$
Level 2 – Active/Passive HA
• A minimum of 2 Servers Required
• OMS binaries installed on shared filesystem
• NFS/OCFS2/DBFS/ACFS
• OMS can run on one node in cluster at any given
time
• Data Guard for Management Repository
Level 2 – Active/Passive OMS
Level 2 – Active/Passive OMS
Oracle Clusterware Setup
• Clusterware can be used to create/manage VIP
• 11.2+ uses appvipcfg for VIP
<GRID_HOME>/bin/appvipcfg create -network=1 
-ip=192.168.1.0 
-vipname=omsvip 
-user=root
• VIP can be created on non-default network
• In Oracle 12c Flex Clusters app vips can be create on
leaf nodes
• Allow Oracle Grid Infrastructure software owner (e.g.
grid) to run the script to start the VIP.
<GRID_HOME>/bin/crsctl setperm resource omsvip -u user:grid:r-x
Oracle Clusterware Setup
• Start the VIP as the GI owner e.g. grid
<GRID_HOME>/bin/crsctl start resource omsvip
• Check the status of the VIP
<GRID_HOME>/bin/crsctl status resource omsvip
The status of the output should be similar to the following:
NAME=omsvip
TYPE=app.appvip_net1.type
TARGET=ONLINE
STATE=ONLINE on oms1
Oracle Clusterware Setup
• Check if virtual hostname and VIP are resolvable
nslookup <omsvip>
• Also do a reverse lookup of the IP address.
nslookup <virtual IP address>
• Verify that the IP address returned from the nslookup
output is running on the OMS host.
ifconfig –a | grep <virtual IP address>
OEM Installation
• Create ORACLE_HOME for the OMS on the shared
storage on all nodes in the cluster
mkdir –p /u01/app/oms_share
• Create Oracle Inventory directory under ORACLE_HOME
for the OMS on all nodes
mkdir /u01/app/oms_share/oraInventory
• Create the inventory pointer in the oraInventory directory
vi oraInst.loc
inventory loc=/u01/app/oracle/oms_share/oraInventory
inst_group=oinstall
OEM Installation
• Install OEM by setting ORACLE_HOSTNAME
environment variable
runInstaller -invPtrloc /u01/app/oms_share/oraInst.loc
ORACLE_HOSTNAME=omsvip.example.com –debug
OEM Failover
• To manually relocate the VIP to another host in the
cluster issue the following command.
$crsctl relocate res omsvip
CRS-2673: Attempting to stop 'omsvip' on 'oms1'
CRS-2677: Stop of 'omsvip' on 'oms1' succeeded
CRS-2672: Attempting to start 'omsvip' on 'oms2'
CRS-2676: Start of 'omsvip' on 'oms2' succeeded
• Check if the IP address associated with the VIP is
running on the relocated host.
ifconfig –a|grep <vip>
OEM Failover
• Establish IP on failover server (done through Clusterware)
• Start listener (if part of same failover group)
• Start database (if required)
• Set the ORACLE_HOSTNAME environment variable to the
virtual hostname. Continuing with our example we use the
command below.
export ORACLE_HOSTNAME=omsvip.example.com
• Start the OMS on the new node
$OMS_HOME/bin/emctl start oms
Add OEM Clusterware resource
• OEM can be added as Clusterware resource
• Administrator managed (static, 2 – nodes)
• Policy managed (dynamic, > 2 nodes)
• Handled through Agent Framework
• C/C++
• Create Action Script
• Store on shared storage
• Specify START/STOP/CHECK/ABORT routines
Example
$ crsctl add server pool oem_sp -attr
"PARENT_POOLS=Generic, SERVER_NAMES=oms1 oms2”
$ crsctl add resource oem -type cluster_resource -attr
"ACTION_SCRIPT=/opt/cluster/scripts/oem12c.scr,
PLACEMENT='restricted',
SERVER_POOLS=oem_sp,
CHECK_INTERVAL='30',
RESTART_ATTEMPTS='2',
START_DEPENDENCIES='hard(omsvip)',
STOP_DEPENDENCIES='hard(omssvip)'"
Clusterware resource
• Oracle 12c introduced a new generic_application resource
type
crsctl add resource oem -type generic_application -attr
"START_PROGRAM='$OMS_HOME/bin/emctl start oms',
STOP_PROGRAM='$OMS_HOME/bin/emctl stop oms',
CLEAN_PROGRAM='$OMS_HOME/bin/emctl stop oms –all
-force',
CHECK_PROGRAM='$OMS_HOME/bin/emctl status oms'
Management Repository
• Can be configured using Data Guard with Fast-Failover
• Also can be configured with RAC/RAC One Node
• Storage becomes SPOF
• Listeners should be reachable from all nodes in cluster
• Database should be started before starting OEM
Configure OEM with Data Guard Repo
Create database service for fast failover.
Configure OEM with Data Guard Repo
emctl config oms -store_repos_details -repos_conndesc
'"(DESCRIPTION=(FAILOVER=ON)
(ADDRESS_LIST=(ADDRESS=(PROTOCOL=TCP)
(HOST=repo1)(PORT=1521))
(ADDRESS=(PROTOCOL=TCP)(HOST=repo2)
(PORT=1521)))
(CONNECT_DATA=(SERVICE_NAME=emrep))
(FAILOVER_MODE=(TYPE=select)(METHOD=basic)))"'
-repos_user sysman
Configure OEM with RAC/RAC One Node Repo
emctl config oms -store_repos_details -repos_conndesc "
(DESCRIPTION= (ADDRESS=(PROTOCOL=TCP)
(HOST=emrep-scan.example.com)(PORT=1521) )
(CONNECT_DATA=(SERVER=DEDICATED)
(SERVICE_NAME = emrep)))"
-repos_user sysman
References
• How to Configure Grid Control OMS in Active/Passive
CFC Environments failover / HA (Doc ID 405642.1)
• How to Configure the OMS Connect String when
Repository is in a Dataguard setup [ID 1328768.1]
• Oracle® Clusterware Administration and Deployment
Guide12c Release 1
COLLABORATE14.IOUG.ORGCOLLABORATE14.IOUG.ORG
• Network with 5,000+ database and
application professionals
• 5 days of in-depth education built by
users, for users
• Complimentary Pre-Conference
Workshops for IOUG registrants
April 7 – 11, 2014
The Venetian Resort,
Las Vegas, NV
Attend for free!
IOUG’s Call for Speakers is now open
collaborate14.ioug.org/call-for-speakers
Communities
Training Close to HomeTraining Close to Home
Maximum Availability Architecture
with Oracle’s Larry Carpenter and Joe Meeks
October 15: Milwaukee, WI
October 16: Rochester, NY
Performance and Internals with Craig Shallahamer
November 6: Chicago, IL
November 8: Atlanta, GA
Get more information at www.ioug.org/masterclass
or visit the IOUG kiosk in Moscone West, 2nd
floor
IOUG Master Class Series Returns
Coming soon to a city near you!
One Day Interactive Training Events to meet your
educational needs
Come See IOUG at the User Group PavilionCome See IOUG at the User Group Pavilion
Win a Free Registration to COLLABORATE 14!
Stop by the IOUG kiosk in the User Group Pavilion in
Moscone West, 2nd floor, to pick up a lucky poker chip and
see if you are a winner of a free registration to
COLLABORATE 14 in Las Vegas!
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.27
Complimentary eBook
Register Now
www.mhprofessional.com/dbsec
Use Code: db12c
THANK YOU
http://blogs.griddba.com
linkedin.com/pub/leighton-nelson/4/6b8/a7a
@leight0nn
leighton.nelson@mercy.net

More Related Content

ODP
Nagios Conference 2012 - Mike Weber - Failover
PPTX
Hostvn ceph in production v1.1 dungtq
DOCX
Oracle 12c RAC On your laptop Step by Step Implementation Guide 1.0
PDF
[NYC Meetup] Docker at Nuxeo
PPT
SaltConf14 - Oz Akan, Rackspace - Deploying OpenStack Marconi with SaltStack
PDF
Ef09 installing-alfresco-components-1-by-1
PPT
Jurijs Velikanovs - RAC Attack 101 - How to install 12c RAC on your laptop
PDF
Oracle Linux and Oracle Database - A Trusted Combination
Nagios Conference 2012 - Mike Weber - Failover
Hostvn ceph in production v1.1 dungtq
Oracle 12c RAC On your laptop Step by Step Implementation Guide 1.0
[NYC Meetup] Docker at Nuxeo
SaltConf14 - Oz Akan, Rackspace - Deploying OpenStack Marconi with SaltStack
Ef09 installing-alfresco-components-1-by-1
Jurijs Velikanovs - RAC Attack 101 - How to install 12c RAC on your laptop
Oracle Linux and Oracle Database - A Trusted Combination

What's hot (20)

PDF
[2018.10.19] 김용기 부장 - IAC on OpenStack (feat. ansible)
PDF
Install and upgrade Oracle grid infrastructure 12.1.0.2
PDF
Step by Step to Install oracle grid 11.2.0.3 on solaris 11.1
PDF
Essential Linux Commands for DBAs
PPT
Looking at RAC, GI/Clusterware Diagnostic Tools
PDF
OpenStack Deployment with Chef Workshop
PDF
Linux conna kpatch-without-stopmachine-fixed
PPTX
Salty OPS – Saltstack Introduction
PDF
Supercharging Content Delivery with Varnish
PDF
Janice Singh - Writing Custom Nagios Plugins
PDF
Oaktable World 2014 Kevin Closson: SLOB – For More Than I/O!
PDF
[오픈소스컨설팅] EFK Stack 소개와 설치 방법
PDF
Install Solaris 11.1 on a Virtualbox VM
PPTX
VMworld 2016: vSphere 6.x Host Resource Deep Dive
PDF
Chef for OpenStack: OpenStack Spring Summit 2013
DOCX
Guide - Migrating from Heroku to AWS using CloudFormation
PPT
Cloug Troubleshooting Oracle 11g Rac 101 Tips And Tricks
PDF
Dan Norris: Exadata security
PDF
Nagios Conference 2011 - Mike Weber - Training: Reducing Nagios Server Load ...
PDF
PGConf.ASIA 2019 Bali - Mission Critical Production High Availability Postgre...
[2018.10.19] 김용기 부장 - IAC on OpenStack (feat. ansible)
Install and upgrade Oracle grid infrastructure 12.1.0.2
Step by Step to Install oracle grid 11.2.0.3 on solaris 11.1
Essential Linux Commands for DBAs
Looking at RAC, GI/Clusterware Diagnostic Tools
OpenStack Deployment with Chef Workshop
Linux conna kpatch-without-stopmachine-fixed
Salty OPS – Saltstack Introduction
Supercharging Content Delivery with Varnish
Janice Singh - Writing Custom Nagios Plugins
Oaktable World 2014 Kevin Closson: SLOB – For More Than I/O!
[오픈소스컨설팅] EFK Stack 소개와 설치 방법
Install Solaris 11.1 on a Virtualbox VM
VMworld 2016: vSphere 6.x Host Resource Deep Dive
Chef for OpenStack: OpenStack Spring Summit 2013
Guide - Migrating from Heroku to AWS using CloudFormation
Cloug Troubleshooting Oracle 11g Rac 101 Tips And Tricks
Dan Norris: Exadata security
Nagios Conference 2011 - Mike Weber - Training: Reducing Nagios Server Load ...
PGConf.ASIA 2019 Bali - Mission Critical Production High Availability Postgre...
Ad

Viewers also liked (20)

PPTX
Managing Oracle Enterprise Manager Cloud Control 12c with Oracle Clusterware
PPT
Configuring Oracle Enterprise Manager Cloud Control 12c for High Availability
DOC
Configuring Oracle Enterprise Manager Cloud Control 12c for HA White Paper
PPTX
Big data oracle_introduccion
PPTX
Big Data & Oracle Technologies
PDF
OOW15 - Oracle Enterprise Manager Cloud Control for Managing Oracle E-Busines...
PPT
Oracle enterprise manager cloud control 12c
PPTX
Oracle enterprise manager cloud control 12c
PDF
Zero to Manageability in 60 Minutes: Building a Solid Foundation for Oracle E...
PPTX
Data center Trends with Oracle
PPTX
Total cloud control with oracle enterprise manager 12c
PPTX
Em13c New Features- One of Two
PPTX
Upgrading Em13c Collaborate 2016
PPTX
Em13c New Features- Two of Two
PDF
Oracle - Enterprise Manager 12c Overview
PDF
Oracle Enterprise Manager Cloud Control 13c for DBAs
PPTX
Oracle Enterprise Manager 12c: The Oracle Monitoring tool of choice – Why yo...
PDF
Oracle Enterprise Manager
PDF
Oracle Enterprise Manager Cloud Control 13c for DBAs
PDF
OOW16 - Running your E-Business Suite on Oracle Cloud (IaaS + PaaS) - Why, Wh...
Managing Oracle Enterprise Manager Cloud Control 12c with Oracle Clusterware
Configuring Oracle Enterprise Manager Cloud Control 12c for High Availability
Configuring Oracle Enterprise Manager Cloud Control 12c for HA White Paper
Big data oracle_introduccion
Big Data & Oracle Technologies
OOW15 - Oracle Enterprise Manager Cloud Control for Managing Oracle E-Busines...
Oracle enterprise manager cloud control 12c
Oracle enterprise manager cloud control 12c
Zero to Manageability in 60 Minutes: Building a Solid Foundation for Oracle E...
Data center Trends with Oracle
Total cloud control with oracle enterprise manager 12c
Em13c New Features- One of Two
Upgrading Em13c Collaborate 2016
Em13c New Features- Two of Two
Oracle - Enterprise Manager 12c Overview
Oracle Enterprise Manager Cloud Control 13c for DBAs
Oracle Enterprise Manager 12c: The Oracle Monitoring tool of choice – Why yo...
Oracle Enterprise Manager
Oracle Enterprise Manager Cloud Control 13c for DBAs
OOW16 - Running your E-Business Suite on Oracle Cloud (IaaS + PaaS) - Why, Wh...
Ad

Similar to Managing Oracle Enterprise Manager Cloud Control 12c with Oracle Clusterware (20)

PPTX
Automating Software Development Life Cycle - A DevOps Approach
PDF
Distributed tracing in OpenStack
PPTX
Oracle Fusion Middleware provisioning with Puppet
PPTX
Cost Effectively Run Multiple Oracle Database Copies at Scale
PDF
VMworld 2013: How SRP Delivers More Than Power to Their Customers
PDF
MySQL Webinar 2/4 Performance tuning, hardware, optimisation
PDF
Oracle RAC and Your Way to the Cloud by Angelo Pruscino
PPTX
DevOps for database
PDF
Oracle 11g R2 RAC setup on rhel 5.0
PPT
EM12C High Availability without SLB and RAC
PPS
Oracle goldengate and RAC12c
PPT
OpenDaylight Integration with OpenStack Neutron: A Tutorial
PPTX
Ansible: How to Get More Sleep and Require Less Coffee
PDF
0396 oracle-goldengate-12c-tutorial
PDF
What You Should Know About WebLogic Server 12c (12.2.1.2) #oow2015 #otntour2...
PDF
[db tech showcase Tokyo 2018] #dbts2018 #B31 『1,2,3 and Done! 3 easy ways to ...
PDF
Changes in weblogic12c_every_administrator_must_know-140812141929
PDF
Changes in WebLogic 12.1.3 Every Administrator Must Know
PDF
Tales from the four-comma club: Managing Kafka as a service at Salesforce | L...
PPTX
Weblogic
Automating Software Development Life Cycle - A DevOps Approach
Distributed tracing in OpenStack
Oracle Fusion Middleware provisioning with Puppet
Cost Effectively Run Multiple Oracle Database Copies at Scale
VMworld 2013: How SRP Delivers More Than Power to Their Customers
MySQL Webinar 2/4 Performance tuning, hardware, optimisation
Oracle RAC and Your Way to the Cloud by Angelo Pruscino
DevOps for database
Oracle 11g R2 RAC setup on rhel 5.0
EM12C High Availability without SLB and RAC
Oracle goldengate and RAC12c
OpenDaylight Integration with OpenStack Neutron: A Tutorial
Ansible: How to Get More Sleep and Require Less Coffee
0396 oracle-goldengate-12c-tutorial
What You Should Know About WebLogic Server 12c (12.2.1.2) #oow2015 #otntour2...
[db tech showcase Tokyo 2018] #dbts2018 #B31 『1,2,3 and Done! 3 easy ways to ...
Changes in weblogic12c_every_administrator_must_know-140812141929
Changes in WebLogic 12.1.3 Every Administrator Must Know
Tales from the four-comma club: Managing Kafka as a service at Salesforce | L...
Weblogic

More from Leighton Nelson (12)

PPT
IOUG Collaborate 2015 - PDB Cloning Using SQL Commands
PDF
Oracle Enteprise Manager Cloud Control 12c - Setting Up Metrics and Monitorin...
PPTX
A Second Look at Oracle RAC 12c
PPTX
PDB Provisioning with Oracle Multitenant Self Service Application
PDF
Database-as-a-Service with Oracle Enterprise Manager Cloud Control 12c and Or...
PPT
Oracle Enterprise Manager Cloud Control 12c - Top 10 Features for DBAs
PPTX
SQL Developer for DBAs
PDF
UPGRADING FROM ORACLE ENTERPRISE MANAGER 10G TO CLOUD CONTROL 12C WITH ZERO D...
PDF
Migrating from Oracle Enterprise Manager 10g to 12c Cloud Control
DOCX
Learning Oracle with Oracle VM VirtualBox Whitepaper
PPT
Learning Oracle with Oracle VM VirtualBox
PPTX
Oracle RAC - Standard Edition, Enterprise Edition &amp; One Node
IOUG Collaborate 2015 - PDB Cloning Using SQL Commands
Oracle Enteprise Manager Cloud Control 12c - Setting Up Metrics and Monitorin...
A Second Look at Oracle RAC 12c
PDB Provisioning with Oracle Multitenant Self Service Application
Database-as-a-Service with Oracle Enterprise Manager Cloud Control 12c and Or...
Oracle Enterprise Manager Cloud Control 12c - Top 10 Features for DBAs
SQL Developer for DBAs
UPGRADING FROM ORACLE ENTERPRISE MANAGER 10G TO CLOUD CONTROL 12C WITH ZERO D...
Migrating from Oracle Enterprise Manager 10g to 12c Cloud Control
Learning Oracle with Oracle VM VirtualBox Whitepaper
Learning Oracle with Oracle VM VirtualBox
Oracle RAC - Standard Edition, Enterprise Edition &amp; One Node

Recently uploaded (20)

PPTX
MYSQL Presentation for SQL database connectivity
PDF
Electronic commerce courselecture one. Pdf
PDF
Unlocking AI with Model Context Protocol (MCP)
PDF
Approach and Philosophy of On baking technology
PDF
Chapter 3 Spatial Domain Image Processing.pdf
PDF
KodekX | Application Modernization Development
PDF
Empathic Computing: Creating Shared Understanding
PPT
Teaching material agriculture food technology
PPT
“AI and Expert System Decision Support & Business Intelligence Systems”
PPTX
Cloud computing and distributed systems.
PDF
Bridging biosciences and deep learning for revolutionary discoveries: a compr...
PDF
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
PDF
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
PDF
Reach Out and Touch Someone: Haptics and Empathic Computing
PPTX
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
PDF
Modernizing your data center with Dell and AMD
PDF
NewMind AI Monthly Chronicles - July 2025
PDF
Encapsulation_ Review paper, used for researhc scholars
PPTX
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
PDF
Network Security Unit 5.pdf for BCA BBA.
MYSQL Presentation for SQL database connectivity
Electronic commerce courselecture one. Pdf
Unlocking AI with Model Context Protocol (MCP)
Approach and Philosophy of On baking technology
Chapter 3 Spatial Domain Image Processing.pdf
KodekX | Application Modernization Development
Empathic Computing: Creating Shared Understanding
Teaching material agriculture food technology
“AI and Expert System Decision Support & Business Intelligence Systems”
Cloud computing and distributed systems.
Bridging biosciences and deep learning for revolutionary discoveries: a compr...
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
Reach Out and Touch Someone: Haptics and Empathic Computing
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
Modernizing your data center with Dell and AMD
NewMind AI Monthly Chronicles - July 2025
Encapsulation_ Review paper, used for researhc scholars
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
Network Security Unit 5.pdf for BCA BBA.

Managing Oracle Enterprise Manager Cloud Control 12c with Oracle Clusterware

  • 1. Managing Oracle Enterprise Manager Cloud Control 12c with Oracle Clusterware Session ID#UGF9794 Leighton L. Nelson Mercy
  • 2. About Me • Oracle DBA for 10+ years • Oracle ACE • Oracle Certified Expert: RAC and Grid Infrastructure 11gR2 • Co-Author Expert Oracle Enterprise Manager Cloud Control 12c – Apress 2013 • Oracle RAC SIG US Events Chair/IOUG Liaison
  • 3. Agenda • OEM 12c Architecture Overview • OEM High Availability • Level 2 HA Configuration • Oracle Clusterware Setup • OEM Installation • OEM Failover • Management Repository Configuration
  • 5. OEM High Availability Levels Level Description Load Balancer Required Cost 1 OMS and Repository on separate hosts. No redundancy. No $ 2 OMS installed on shared storage with VIP used in active/passive failover. Repository Database using local Data Guard. No $$ 3 Multiple OMSs in active/active configuration. Repository using RAC Database with local Data Guard Yes, At primary site $$$ 4 Primary OMS in active/active configuration with RAC Repository database. Standby OMS at DR site in active/active configuration. Standby RAC database at DR site Yes. At pimary and standby sites $$$$
  • 6. Level 2 – Active/Passive HA • A minimum of 2 Servers Required • OMS binaries installed on shared filesystem • NFS/OCFS2/DBFS/ACFS • OMS can run on one node in cluster at any given time • Data Guard for Management Repository
  • 7. Level 2 – Active/Passive OMS
  • 8. Level 2 – Active/Passive OMS
  • 9. Oracle Clusterware Setup • Clusterware can be used to create/manage VIP • 11.2+ uses appvipcfg for VIP <GRID_HOME>/bin/appvipcfg create -network=1 -ip=192.168.1.0 -vipname=omsvip -user=root • VIP can be created on non-default network • In Oracle 12c Flex Clusters app vips can be create on leaf nodes • Allow Oracle Grid Infrastructure software owner (e.g. grid) to run the script to start the VIP. <GRID_HOME>/bin/crsctl setperm resource omsvip -u user:grid:r-x
  • 10. Oracle Clusterware Setup • Start the VIP as the GI owner e.g. grid <GRID_HOME>/bin/crsctl start resource omsvip • Check the status of the VIP <GRID_HOME>/bin/crsctl status resource omsvip The status of the output should be similar to the following: NAME=omsvip TYPE=app.appvip_net1.type TARGET=ONLINE STATE=ONLINE on oms1
  • 11. Oracle Clusterware Setup • Check if virtual hostname and VIP are resolvable nslookup <omsvip> • Also do a reverse lookup of the IP address. nslookup <virtual IP address> • Verify that the IP address returned from the nslookup output is running on the OMS host. ifconfig –a | grep <virtual IP address>
  • 12. OEM Installation • Create ORACLE_HOME for the OMS on the shared storage on all nodes in the cluster mkdir –p /u01/app/oms_share • Create Oracle Inventory directory under ORACLE_HOME for the OMS on all nodes mkdir /u01/app/oms_share/oraInventory • Create the inventory pointer in the oraInventory directory vi oraInst.loc inventory loc=/u01/app/oracle/oms_share/oraInventory inst_group=oinstall
  • 13. OEM Installation • Install OEM by setting ORACLE_HOSTNAME environment variable runInstaller -invPtrloc /u01/app/oms_share/oraInst.loc ORACLE_HOSTNAME=omsvip.example.com –debug
  • 14. OEM Failover • To manually relocate the VIP to another host in the cluster issue the following command. $crsctl relocate res omsvip CRS-2673: Attempting to stop 'omsvip' on 'oms1' CRS-2677: Stop of 'omsvip' on 'oms1' succeeded CRS-2672: Attempting to start 'omsvip' on 'oms2' CRS-2676: Start of 'omsvip' on 'oms2' succeeded • Check if the IP address associated with the VIP is running on the relocated host. ifconfig –a|grep <vip>
  • 15. OEM Failover • Establish IP on failover server (done through Clusterware) • Start listener (if part of same failover group) • Start database (if required) • Set the ORACLE_HOSTNAME environment variable to the virtual hostname. Continuing with our example we use the command below. export ORACLE_HOSTNAME=omsvip.example.com • Start the OMS on the new node $OMS_HOME/bin/emctl start oms
  • 16. Add OEM Clusterware resource • OEM can be added as Clusterware resource • Administrator managed (static, 2 – nodes) • Policy managed (dynamic, > 2 nodes) • Handled through Agent Framework • C/C++ • Create Action Script • Store on shared storage • Specify START/STOP/CHECK/ABORT routines
  • 17. Example $ crsctl add server pool oem_sp -attr "PARENT_POOLS=Generic, SERVER_NAMES=oms1 oms2” $ crsctl add resource oem -type cluster_resource -attr "ACTION_SCRIPT=/opt/cluster/scripts/oem12c.scr, PLACEMENT='restricted', SERVER_POOLS=oem_sp, CHECK_INTERVAL='30', RESTART_ATTEMPTS='2', START_DEPENDENCIES='hard(omsvip)', STOP_DEPENDENCIES='hard(omssvip)'"
  • 18. Clusterware resource • Oracle 12c introduced a new generic_application resource type crsctl add resource oem -type generic_application -attr "START_PROGRAM='$OMS_HOME/bin/emctl start oms', STOP_PROGRAM='$OMS_HOME/bin/emctl stop oms', CLEAN_PROGRAM='$OMS_HOME/bin/emctl stop oms –all -force', CHECK_PROGRAM='$OMS_HOME/bin/emctl status oms'
  • 19. Management Repository • Can be configured using Data Guard with Fast-Failover • Also can be configured with RAC/RAC One Node • Storage becomes SPOF • Listeners should be reachable from all nodes in cluster • Database should be started before starting OEM
  • 20. Configure OEM with Data Guard Repo Create database service for fast failover.
  • 21. Configure OEM with Data Guard Repo emctl config oms -store_repos_details -repos_conndesc '"(DESCRIPTION=(FAILOVER=ON) (ADDRESS_LIST=(ADDRESS=(PROTOCOL=TCP) (HOST=repo1)(PORT=1521)) (ADDRESS=(PROTOCOL=TCP)(HOST=repo2) (PORT=1521))) (CONNECT_DATA=(SERVICE_NAME=emrep)) (FAILOVER_MODE=(TYPE=select)(METHOD=basic)))"' -repos_user sysman
  • 22. Configure OEM with RAC/RAC One Node Repo emctl config oms -store_repos_details -repos_conndesc " (DESCRIPTION= (ADDRESS=(PROTOCOL=TCP) (HOST=emrep-scan.example.com)(PORT=1521) ) (CONNECT_DATA=(SERVER=DEDICATED) (SERVICE_NAME = emrep)))" -repos_user sysman
  • 23. References • How to Configure Grid Control OMS in Active/Passive CFC Environments failover / HA (Doc ID 405642.1) • How to Configure the OMS Connect String when Repository is in a Dataguard setup [ID 1328768.1] • Oracle® Clusterware Administration and Deployment Guide12c Release 1
  • 24. COLLABORATE14.IOUG.ORGCOLLABORATE14.IOUG.ORG • Network with 5,000+ database and application professionals • 5 days of in-depth education built by users, for users • Complimentary Pre-Conference Workshops for IOUG registrants April 7 – 11, 2014 The Venetian Resort, Las Vegas, NV Attend for free! IOUG’s Call for Speakers is now open collaborate14.ioug.org/call-for-speakers
  • 25. Communities Training Close to HomeTraining Close to Home Maximum Availability Architecture with Oracle’s Larry Carpenter and Joe Meeks October 15: Milwaukee, WI October 16: Rochester, NY Performance and Internals with Craig Shallahamer November 6: Chicago, IL November 8: Atlanta, GA Get more information at www.ioug.org/masterclass or visit the IOUG kiosk in Moscone West, 2nd floor IOUG Master Class Series Returns Coming soon to a city near you! One Day Interactive Training Events to meet your educational needs
  • 26. Come See IOUG at the User Group PavilionCome See IOUG at the User Group Pavilion Win a Free Registration to COLLABORATE 14! Stop by the IOUG kiosk in the User Group Pavilion in Moscone West, 2nd floor, to pick up a lucky poker chip and see if you are a winner of a free registration to COLLABORATE 14 in Las Vegas!
  • 27. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.27 Complimentary eBook Register Now www.mhprofessional.com/dbsec Use Code: db12c

Editor's Notes

  • #5: Each component within the Enterprise Manager architecture should be made highly available to enable a complete High Availability configuration. The main components to be considered are (see Figure 13-1): Enterprise Manager Agent - Communicates with and sends metrics to the OMS Management Server - the heart of the Enterprise Manager Repository -Stores persistent data from the monitored targets. Software library - Stores files for patching, provisioning and agent and plug-in deployment
  • #6: Different levels of high availability can be configured for each component with varying levels of complexity and cost. When considering your high availability requirements, there should be minimal trade-offs in cost, complexity, performance and data loss. Generally, the complexity and level of high availability are proportional to each other.
  • #7: Also called a cold-failover cluster (CFC) In order to reduce OMS downtime during planned or unplanned outage, some redundancy should be introduced into the configuration. A level 2 configuration uses a shared filesystem for the management service to achieve an active/passive or cold failover cluster solution. The filesystem is shared between two or more hosts and is only active on one host at a time. The shared filesystem for the OMS can be installed on a general-purpose cluster file system including NFS, Oracle Cluster File System (OCFS2), and Oracle Automatic Storage Management (ASM) Cluster File System (ACFS). If NFS is used as the shared storage, then ensure the correct mount options are set in /etc/fstab (/etc/filesystems on AIX) to prevent potential I/O issues. Specifically, the rsize and wsize should be set. The example below shows and entry in the /etc/fstab file on a Linux server where the NFS share is mounted on a filer named filer1 under the /vol1/oms_share directory. filer:/vol1/oms_share /u01/app/oms_share nfs rw,bg,rsize=32768,wsize=32768,hard,nointr,tcp,noac,vers=3,timeo=600 0 0 Binaries for the OMS along with the inventory should be installed on the shared filesystem. Setup the virtual hostname and IP address (VIP) using Oracle Clusterware or third-party software and hardware. Failover is achieved by using the virtual hostname for the OMS along with a unique IP address which resolves to the hostname.
  • #8: Also called a cold-failover cluster (CFC) In order to reduce OMS downtime during planned or unplanned outage, some redundancy should be introduced into the configuration. A level 2 configuration uses a shared filesystem for the management service to achieve an active/passive or cold failover cluster solution. The filesystem is shared between two or more hosts and is only active on one host at a time. The shared filesystem for the OMS can be installed on a general-purpose cluster file system including NFS, Oracle Cluster File System (OCFS2), and Oracle Automatic Storage Management (ASM) Cluster File System (ACFS). If NFS is used as the shared storage, then ensure the correct mount options are set in /etc/fstab (/etc/filesystems on AIX) to prevent potential I/O issues. Specifically, the rsize and wsize should be set. The example below shows and entry in the /etc/fstab file on a Linux server where the NFS share is mounted on a filer named filer1 under the /vol1/oms_share directory. filer:/vol1/oms_share /u01/app/oms_share nfs rw,bg,rsize=32768,wsize=32768,hard,nointr,tcp,noac,vers=3,timeo=600 0 0 Binaries for the OMS along with the inventory should be installed on the shared filesystem. Setup the virtual hostname and IP address (VIP) using Oracle Clusterware or third-party software and hardware. Failover is achieved by using the virtual hostname for the OMS along with a unique IP address which resolves to the hostname.
  • #9: Also called a cold-failover cluster (CFC) In order to reduce OMS downtime during planned or unplanned outage, some redundancy should be introduced into the configuration. A level 2 configuration uses a shared filesystem for the management service to achieve an active/passive or cold failover cluster solution. The filesystem is shared between two or more hosts and is only active on one host at a time. The shared filesystem for the OMS can be installed on a general-purpose cluster file system including NFS, Oracle Cluster File System (OCFS2), and Oracle Automatic Storage Management (ASM) Cluster File System (ACFS). If NFS is used as the shared storage, then ensure the correct mount options are set in /etc/fstab (/etc/filesystems on AIX) to prevent potential I/O issues. Specifically, the rsize and wsize should be set. The example below shows and entry in the /etc/fstab file on a Linux server where the NFS share is mounted on a filer named filer1 under the /vol1/oms_share directory. filer:/vol1/oms_share /u01/app/oms_share nfs rw,bg,rsize=32768,wsize=32768,hard,nointr,tcp,noac,vers=3,timeo=600 0 0 Binaries for the OMS along with the inventory should be installed on the shared filesystem. Failover is achieved by using the virtual hostname for the OMS along with a unique IP address which resolves to the hostname.
  • #10: It’s recommended to use the appvipcfg utility in Oracle Clusterware 11gR2 to create application VIPs. The VIP is created with a set of pre-defined settings suitable for an application VIP such placement policy and the failback option. The default value of the failback is set to 0, which means that the VIP and its dependent resources will not automatically fail back to the original node once it becomes available again. VIP can be created on the non-default network (default ora.net1.network) Non-default network should be created with srvctl add network command
  • #11: A VIP can be created in the same was any other Clusterware resource. However, it is recommended to use the appvipcfg utility in Oracle Clusterware 11gR2 to create application VIPs. The VIP is created with a set of pre-defined settings suitable for an application VIP such placement policy and the failback option. The default value of the failback is set to 0, which means that the VIP and its dependent resources will not automatically fail back to the original node once it becomes available again.
  • #12: The   virtual hostname is defined in DNS, and should resolve to the application VIP address created using the steps above. Check if the virtual hostname and VIP are resolvable using nslookup or the dig command. $ nslookup omsvip This should resolve to a unique IP address of the virtual hostname on every node in the cluster. Also do a reverse lookup of the IP address. $nslookup &lt;virtual IP address&gt; Verify that the IP address returned from the nslookup output is running on the OMS host. ifconfig –a|grep &lt;virtual IP address&gt;
  • #13: Install the OMS on the first host by following the installation steps as described in the Oracle Enterprise Manager Cloud Control 12c Basic Installation Guide. You only need to complete the installation once. Since the location is shared, the binaries will be accessible from another host that shares the filesystem.
  • #14: The ORACLE_HOSTNAME should be also set when starting the OEM on each node in the cluster. This should be the same as the Virtual Hostname defined in DNS for the VIP.
  • #15: Once the OMS has been successfully installed and is up and running, if the host were to go down then the VIP will be automatically relocated to another node. The management service can then be manually started on any remaining node in the cluster on which the VIP is running.
  • #16: Oracle Clusterware can be configured to fully manage the OMS by creating start, check, stop, clean and abort routines that tell it how to operate on the OMS.
  • #17: You must decide whether to use administrator or policy management for the application. Use administrator management for smaller, two-node configurations, where your cluster configuration is not likely to change. Use policy management for more dynamic configurations when your cluster consists of more than two nodes. For example, if a resource only runs on node 1 and node 2 because only those nodes have the necessary files, then administrator management is probably more appropriate. An action script is a shell script (a batch script in Windows) that a generic script agent provided by Oracle Clusterware calls. An application-specific agent is usually a C or C++ program that calls Oracle Clusterware-provided APIs directly.
  • #18: To add the OEM server as a resource that uses a named server deployment, assume that you add the resource to a server pool that is, by definition, a sub-pool of the Generic server pool. You create server pools that are sub-pools of Generic using the crsctl add serverpool command. These server pools define the Generic server pool as their parent in the server pool attribute PARENT_POOLS. In addition, they include a list of server names in the SERVER_NAMES parameter to specify the servers that should be assigned to the respective pool.
  • #19: generic_application cluster type can model any application requiring high availability without specifying action scripts
  • #25: If you like what you heard today, you should come see me speak at COLLABORATE 14 – IOUG Forum 1,000 customer sessions, very similar to what you see on User Group Sunday at OpenWorld Includes complimentary hands on labs and pre-conference workshops for IOUG attendees COLLABORATE 14 is April 7-11 in Las Vegas!
  • #26: IOUG Master Class brings the best content from COLLABORATE 13 to a city near you Use these one-day training events to train your entire team at an affordable price! Group discounts available, visit the IOUG kiosk for more information
  • #27: Visit IOUG in the User Group Pavilion, on the 2 nd floor of Moscone West to pick up your poker chip and win a prize Don’t forget to drop off your speaker card from this session to help me win a prize!