Oracle 11gR2 New Features for. RAC. What's New in Clusterware!!! OTN Tour ...
About me… Independent Oracle Consultant - Summersky Enterprises e-mail: ...
Oracle 11gR2 New Features for RAC What's New in Clusterware!!! OTN Tour (Costa Rica, Ecuador, Columbia, Peru)
About me… Independent Oracle Consultant - Summersky Enterprises e-mail:
[email protected]
Oracle Clusterware Components • HAS stack • CRS stack • SCAN • Virtual (IP)
Oracle Clusterware Components New in 11.2.0.2
Grid Infrastructure
CRS Stack
CRS
CSS
EVM
CTSS
ONS
ASM
oraagent
orarootagent
crfmond
HAS Stack GNS
mDNS
GIPCD
GPnPD
crflogd
ClusterWare Files • Oracle Cluster Registry (OCR) • Oracle Local Registry (OLR) • Voting Disk • GPnP Profile
New in 11.2.0.2
Oracle Clusterware Network Switch
Public Network Interconnect Switch
New in 11.2.0.2
Cluster Interconnect
ORADB3 ORADB1
ORADB2
VIP
VIP
SSKY1
ORADB4
SSKY3
VIP
SSKY4
VIP
SSKY2 GIPCD CRFMOND/LOGD DISKMON
DISKMON
DISKMON
GPnP
GPnP
GPnP
CTSS
CTSS
CTSS
CSS
CSS
CSS
EVM
EVM
EVM
CRS
CRS
CRS
HAS
HAS
HAS
NM
CSS
GM
EVM OCR
CRS
HAS
SAN switch OLR
OLR
OLR
OLR
prddb OCR Vote Disk
AA_00
AB_01
AC_02
AD_03
AE_04
AF_05
AG_06
AH_07
© Summersky Enterprises LLC | | Murali Vallath | Slide: 6
GPnPD New in 11.2.0.2
• • • • •
Grid Plug and Play Daemon Started before CSS Allows easy addition and deletion of nodes Dynamic management of VIPs Maintains essential cluster information in an XML profile: – – – –
Cluster name and unique cluster identifier Public and private network interface mappings Location for the OCR and voting disks Location for the ASM parameter file
• Manages and distributes the profile using the GPnP daemon • Defines cluster name, networks and storage © Summersky Enterprises LLC | | Murali Vallath | Slide: 7
GPnP Profile
New in 11.2.0.2
© Summersky Enterprises LLC | | Murali Vallath | Slide: 8
Cluster Stack Invocation ASM
oraagent
init
EVMD
ASM Instance
GPNPD
DB Instance
MDNSD
eONS ONS Listener SCAN
CRSD VIP
orarootagent
OHASD
GNSD
SCAN VIP GNS VIP Network CSSD Monitor CTSSD GNSD
cssdagent
CSSD © Summersky Enterprises LLC | | Murali Vallath | Slide: 9
Clusterware Log Directories ohasd orarootagent_root cssd
ohasd ohasd
crsd oragent_oracle oracssdmonitor_root
evmd
diag diag
oracssdagent_root agent agent gpnpd
log log
gnsd
e.g.. e.g.. prddb1 prddb1
client gipcd
New in 11.2.0.2
orarootagent_root
crsd crsd
GRID GRID HOME HOME
oragent_oracle oracssdmonitor_root
diskmon
crs crs
srvm
acfssec
admin
acfsreplroot
ctssd
acfsrepl
mdnsd
racgmain
crflogd
racg racg
racgevtf
crfmond
racgeut alert.log © Summersky Enterprises LLC | | Murali Vallath | Slide: 10
Clusterware Log Directories
tnslsnr tnslsnr
node node
sweep listener_scan3 stage listener_scan2 metadata listener_scan1 incpkg incident sweep
diag diag
cdump stage alert host_ host_
user_root user_root
metadata
clients clients
log log
crs crs
GRID HOME HOME GRID
lck
trace lck incpkg incident cdump alert
adrci_dir.mif
trace
© Summersky Enterprises LLC | | Murali Vallath | Slide: 11
VIP’s • Database VIP (also called RAC VIP) • Application VIP New in 11.2.0.2
• HAIP (IC VIP)
© Summersky Enterprises LLC | 11gR2 RAC | Murali Vallath | Slide: 12
Cluster Interconnect
New in 11.2.0.2
• Oracle uses the interconnect for cache synchronization • Interconnect is also used for – – – –
Data blocks Locks SCN numbers Messages
© Summersky Enterprises LLC | 11gR2 RAC | Murali Vallath | Slide: 13
Redundant Interconnects
New in 11.2.0.2
• CLUSTER_INTERCONNECT • NIC Bonding • HAIP
© Summersky Enterprises LLC | 11gR2 RAC | Murali Vallath | Slide: 14
Verify Deamons $GRID_HOME/bin/crsctl stat res -t -init
----------------------------------------------------------------------------NAME TARGET STATE SERVER STATE_DETAILS --------------------------------------------------------------------------ora.asm 1 ONLINE ONLINE devsrv1 Started ora.cluster_interconnect.haip 1 ONLINE ONLINE devsrv1 ora.crf 1 ONLINE ONLINE devsrv1 ora.crsd 1 ONLINE ONLINE devsrv1 ora.cssd 1 ONLINE ONLINE devsrv1 ora.cssdmonitor 1 ONLINE ONLINE devsrv1 ora.ctssd 1 ONLINE ONLINE devsrv1 OBSERVER
© Summersky Enterprises LLC | | Murali Vallath | Slide: 15
RAC Background Process •
ACMS – Atomic Controlfile to Memory Service
•
GTX0-j – Global Transaction Process
•
RMSn – Oracle RAC Management Processes (RMSn)
•
RMSN – Remote Slave Monitor
•
LMS – Global Cache Service Processes
•
LMON – Global Enqueue Service Monitor
•
LMD – Global Enqueue Service Daemon
•
LCK – Lock Process
•
DBRM – Database Resource Manager
•
PING – Response time agent
New in 11.2.0.2
© Summersky Enterprises LLC | Oracle Real Application Cluster | Murali Vallath | Slide: 16
SCAN • SCAN –Single Client Access Number • Similar to a cluster alias available on Tru64 and VMS clusters • Helps load balance across the database cluster • Clients do not require VIP information • Removes the requirement to change the client connection if cluster changes • Must resolve to atleast one address on the public network • Best practice .. resolve to 3 addresses for the entire cluster
SCAN • Allows clients to use EZConnect or simple JDBC connections • Each cluster will have 3 SCAN listeners, each having a SCAN VIP defined as cluster resources on network 1 • A SCAN VIP/LISTENER will failover to another node in the cluster • Instance registers with local listener on its node • Database “REMOTE_LISTENER” registers instances with all SCAN listeners
Advanced Installation
SCAN/GNS Configuration SCAN configuration
GNS configuration
Server Pools
Node 1
ssky1
Node 2
ssky2
Node 3
ssky3
sskypool1 Min=2 Max=4
Node 4
ssky4
Node 5
oltp5
Node 6
oltp6
sskypool2 Min=3 Max=3
Node 7
oltp7
Node 8
dwh8
Node 9
dwh9
Node 10
dwh10
sskypool3 Min=3 Max=3
Server Pools • Logical division of the cluster into pools of servers • Applications (e.g. databases) can be configured to run in one or more server pools • Managed by crsctl (applications), srvctl (Oracle) • Defined by 3 attributes: – MIN - minimum number of servers (default 0) – MAX – maximum number of servers (default 0 or -1) – IMPORTANCE – 0 (least important) to 1000
Server Pools • One-to-one mapping between a database service and server pool • A database service can only be defined to operate in one pool – UNIFORM – all servers in the pool – SINGLETON – one server in the pool
• Resources are contained in logical groups of server pools
Types of Server Pools • System defined – Free – Generic
• User defined
Server Pools
Server Pools
Server Pools Node 1
ssky1
Node 2
ssky2
Node 3
ssky3
sskypool1 Min=2 Max=4
Node 4
ssky4 oltp5
Node 5
oltp5
Node 6
oltp6
sskypool2 Min=3 Max=3
Node 7
oltp7
Node 8
dwh8
Node 9
dwh9
Node 10
dwh10
sskypool3 Min=3 Max=3
Server Pools Node 1
ssky1
Node 2
ssky2
Node 3
ssky3
sskypool1 Min=3 Max=4 Importance = 10
Node 8 4
oltp5 ssky4 dwh8
Node 5
oltp5
Node 6
oltp6
Node 7
oltp7
sskypool2 Min=3 Max=3 Importance = 20
Node 8
dwh8
Node 9
dwh9
Node 10
dwh10
sskypool3 Min=3 Max=3 Importance = 30
Q U E S T I O N S A N S W E R S
Complete your evaluations
Thanks for Listening
[email protected] | Murali Vallath | Slide: 30