Voting Disk and OCR in 11gR2: Some changes
Having just delivered an Oracle Database 11gR2 RAC Admin course, I’d like to point out some remarkable changes in the way we handle now the important Clusterware components Voting Disk and Oracle Cluster Registry (OCR): Amazingly, we can now store the two inside of an Automatic Storage Management (ASM) Disk Group, which was not possible in 10g.
The OCR is striped and mirrored (if we have a redundancy other than external), similar as ordinary Database Files are. So we can now leverage the mirroring capabilities of ASM to mirror the OCR also, without having to use multiple RAW devices for that purpose only. The Voting Disk (or Voting File, as it is now also referred to) is not striped but put as a whole on ASM Disks – if we use a redundancy of normal on the Diskgroup, 3 Voting Files are placed, each on one ASM Disk. This is a concern, if our ASM Diskgroups consist of only 2 ASM Disks! Therefore, the new quorum failgroup clause was introduced:
create diskgroup data normal redundancy failgroup fg1 disk 'ORCL:ASMDISK1' failgroup fg2 disk 'ORCL:ASMDISK2' quorum failgroup fg3 disk 'ORCL:ASMDISK3' attribute 'compatible.asm' = '11.2.0.0.0';The failgroup fg3 above needs only one small Disk (300 MB should be on the safe side here, since the Voting File is only about 280 MB in size) to keep one Mirror of the Voting File. fg1 and fg2 will contain each one Voting File and all the other stripes of the Database Area as well, but fg3 will only get that one Voting File.
[root ~]# /u01/app/11.2.0/grid/bin/crsctl query css votedisk## STATE File Universal Id File Name Disk group-- ----- ----------------- --------- --------- 1. ONLINE 511de6e64e354f9bbf4be318fc928c28 (ORCL:ASMDISK1) [DATA] 2. ONLINE 2f1973ed4be84f50bffc2475949b428f (ORCL:ASMDISK2) [DATA] 3. ONLINE 5ed44fb7e79c4f79bfaf09b402ba70df (ORCL:ASMDISK3) [DATA]Another important change regarding the Voting File is that it is no longer supported to take a manual backup of it with dd. Instead, the Voting File gets backed up automatically into the OCR. As a New Feature, you can now do a manual backup of the OCR any time you like, without having to wait until that is done automatically – which is also still done:
[root@ ~]# /u01/app/11.2.0/grid/bin/ocrconfig -showbackup
node 2010/10/06 09:37:30 /u01/app/11.2.0/grid/cdata/clnode/backup00.ocrnode 2010/10/06 05:37:29 /u01/app/11.2.0/grid/cdata/clnode/backup01.ocrnode 2010/10/06 01:37:27 /u01/app/11.2.0/grid/cdata/clnode/backup02.ocrnode 2010/10/05 01:37:21 /u01/app/11.2.0/grid/cdata/clnode/day.ocrnode 2010/10/04 13:37:19 /u01/app/11.2.0/grid/cdata/clnode/week.ocrAbove are the automatic backups of the OCR as in earlier versions. Now the manual backup:
[root@node ~]# /u01/app/11.2.0/grid/bin/ocrconfig -manualbackupnode 2010/10/06 13:07:03 /u01/app/11.2.0/grid/cdata/clnode/backup_20101006_130703.ocrI got a manual backup on the default location on my master node. We can define another backup location for the automatic backups as well as for the manual backups – preferrable on a Shared Device that is accessible by all the nodes (which is not the case with /home/oracle, unfortunately ):
[root@node ~]# /u01/app/11.2.0/grid/bin/ocrconfig -backuploc /home/oracle[root@node ~]# /u01/app/11.2.0/grid/bin/ocrconfig -manualbackupnode 2010/10/06 13:10:50 /home/oracle/backup_20101006_131050.ocrnode 2010/10/06 13:07:03 /u01/app/11.2.0/grid/cdata/clnode/backup_20101006_130703.ocr
[root@node ~]# /u01/app/11.2.0/grid/bin/ocrconfig -showbackupnode 2010/10/06 09:37:30 /u01/app/11.2.0/grid/cdata/clnode/backup00.ocrnode 2010/10/06 05:37:29 /u01/app/11.2.0/grid/cdata/clnode/backup01.ocrnode 2010/10/06 01:37:27 /u01/app/11.2.0/grid/cdata/clnode/backup02.ocrnode 2010/10/05 01:37:21 /u01/app/11.2.0/grid/cdata/clnode/day.ocrnode 2010/10/04 13:37:19 /u01/app/11.2.0/grid/cdata/clnode/week.ocrnode 2010/10/06 13:10:50 /home/oracle/backup_20101006_131050.ocrnode 2010/10/06 13:07:03 /u01/app/11.2.0/grid/cdata/clnode/backup_20101006_130703.ocrConclusion: The way to handle Voting Disk and OCR has changed significantly – they can be kept inside of an ASM Diskgroup especially.
Having just delivered an Oracle Database 11gR2 RAC Admin course, I’d like to point out some remarkable changes in the way we handle now the important Clusterware components Voting Disk and Oracle Cluster Registry (OCR): Amazingly, we can now store the two inside of an Automatic Storage Management (ASM) Disk Group, which was not possible in 10g.
The OCR is striped and mirrored (if we have a redundancy other than external), similar as ordinary Database Files are. So we can now leverage the mirroring capabilities of ASM to mirror the OCR also, without having to use multiple RAW devices for that purpose only. The Voting Disk (or Voting File, as it is now also referred to) is not striped but put as a whole on ASM Disks – if we use a redundancy of normal on the Diskgroup, 3 Voting Files are placed, each on one ASM Disk. This is a concern, if our ASM Diskgroups consist of only 2 ASM Disks! Therefore, the new quorum failgroup clause was introduced:
create diskgroup data normal redundancy failgroup fg1 disk 'ORCL:ASMDISK1' failgroup fg2 disk 'ORCL:ASMDISK2' quorum failgroup fg3 disk 'ORCL:ASMDISK3' attribute 'compatible.asm' = '11.2.0.0.0';The failgroup fg3 above needs only one small Disk (300 MB should be on the safe side here, since the Voting File is only about 280 MB in size) to keep one Mirror of the Voting File. fg1 and fg2 will contain each one Voting File and all the other stripes of the Database Area as well, but fg3 will only get that one Voting File.
[root ~]# /u01/app/11.2.0/grid/bin/crsctl query css votedisk## STATE File Universal Id File Name Disk group-- ----- ----------------- --------- --------- 1. ONLINE 511de6e64e354f9bbf4be318fc928c28 (ORCL:ASMDISK1) [DATA] 2. ONLINE 2f1973ed4be84f50bffc2475949b428f (ORCL:ASMDISK2) [DATA] 3. ONLINE 5ed44fb7e79c4f79bfaf09b402ba70df (ORCL:ASMDISK3) [DATA]Another important change regarding the Voting File is that it is no longer supported to take a manual backup of it with dd. Instead, the Voting File gets backed up automatically into the OCR. As a New Feature, you can now do a manual backup of the OCR any time you like, without having to wait until that is done automatically – which is also still done:
[root@ ~]# /u01/app/11.2.0/grid/bin/ocrconfig -showbackup
node 2010/10/06 09:37:30 /u01/app/11.2.0/grid/cdata/clnode/backup00.ocrnode 2010/10/06 05:37:29 /u01/app/11.2.0/grid/cdata/clnode/backup01.ocrnode 2010/10/06 01:37:27 /u01/app/11.2.0/grid/cdata/clnode/backup02.ocrnode 2010/10/05 01:37:21 /u01/app/11.2.0/grid/cdata/clnode/day.ocrnode 2010/10/04 13:37:19 /u01/app/11.2.0/grid/cdata/clnode/week.ocrAbove are the automatic backups of the OCR as in earlier versions. Now the manual backup:
[root@node ~]# /u01/app/11.2.0/grid/bin/ocrconfig -manualbackupnode 2010/10/06 13:07:03 /u01/app/11.2.0/grid/cdata/clnode/backup_20101006_130703.ocrI got a manual backup on the default location on my master node. We can define another backup location for the automatic backups as well as for the manual backups – preferrable on a Shared Device that is accessible by all the nodes (which is not the case with /home/oracle, unfortunately ):
[root@node ~]# /u01/app/11.2.0/grid/bin/ocrconfig -backuploc /home/oracle[root@node ~]# /u01/app/11.2.0/grid/bin/ocrconfig -manualbackupnode 2010/10/06 13:10:50 /home/oracle/backup_20101006_131050.ocrnode 2010/10/06 13:07:03 /u01/app/11.2.0/grid/cdata/clnode/backup_20101006_130703.ocr
[root@node ~]# /u01/app/11.2.0/grid/bin/ocrconfig -showbackupnode 2010/10/06 09:37:30 /u01/app/11.2.0/grid/cdata/clnode/backup00.ocrnode 2010/10/06 05:37:29 /u01/app/11.2.0/grid/cdata/clnode/backup01.ocrnode 2010/10/06 01:37:27 /u01/app/11.2.0/grid/cdata/clnode/backup02.ocrnode 2010/10/05 01:37:21 /u01/app/11.2.0/grid/cdata/clnode/day.ocrnode 2010/10/04 13:37:19 /u01/app/11.2.0/grid/cdata/clnode/week.ocrnode 2010/10/06 13:10:50 /home/oracle/backup_20101006_131050.ocrnode 2010/10/06 13:07:03 /u01/app/11.2.0/grid/cdata/clnode/backup_20101006_130703.ocrConclusion: The way to handle Voting Disk and OCR has changed significantly – they can be kept inside of an ASM Diskgroup especially.
No comments:
Post a Comment