Applying PSU Patch on Two Node RAC GRID Oracle Home.   3 comments

Step-1
Take the backup of Grid Home
cd $GRID_HOME
tar -cvpf /u01/app/11.2.0/grid/gridhome_bkp.tar ./
Perform this Backup on Both the RAC Nodes
Step-2
Download  & Copy Latest OPatch
OPatch is the utility used to apply the patch. Download the latest OPatch utility from My Oracle Support patch 6880880. As software home owner, unzip the downloaded OPatch to the $GRID_HOME and $ORACLE_HOME
1
Take Backup of Original OPatch
Mv OPatch OPatch_bk
Now test for new opatch version
3
Step-3
OCM Configuration
During patch apply, OPatch will prompt for the location of the OCM (Oracle Configuration Manager) response file. If you do not have one, run the following command to create it.
cd /u01/app/11.2.0/grid/OPatch/ocm/bin
 4
Make a note of the response file location as we will need it. Or copy this ocm.rsp /tmp
Step-4
Validation of Oracle Inventory
 Before patch application, let check the consistency of the oracle inventory. If the below command succeeds, we are good.
 > $GRID_HOME/OPatch/opatch lsinventory -detail -oh $GRID_HOME
 5 6 



7



8
One-off Patch Conflict Detection and Resolution
 Check for conflicting patches by doing the following for each GI home you are planning to apply the patch on.
 [grid@rac1 db_grid_psu]$ opatch prereq CheckConflictAgainstOHWithDetail -phBaseDir ./16902043
Oracle Interim Patch Installer version 11.2.0.3.5
Copyright (c) 2013, Oracle Corporation.  All rights reserved.
PREREQ session
Oracle Home       : /u01/app/11.2.0/grid
Central Inventory : /u01/app/oraInventory
   from           : /u01/app/11.2.0/grid/oraInst.loc
OPatch version    : 11.2.0.3.5
OUI version       : 11.2.0.3.0
Log file location : /u01/app/11.2.0/grid/cfgtoollogs/opatch/opatch2013-12-09_17-43-37PM_1.log
Invoking prereq "checkconflictagainstohwithdetail"
Prereq "checkConflictAgainstOHWithDetail" passed.
OPatch succeeded.
[grid@rac1 db_grid_psu]$ 


Patch Installation  Note: -- Stop EM agent if it is running on your server before you apply the patch.  

emctl stop agent  

[root@rac1 db_grid_psu]# /u01/app/11.2.0/grid/OPatch/opatch auto /tmp/db_grid_psu/ -oh /u01/app/11.2.0/grid 9[root@rac1 ~]# /u01/app/11.2.0/grid/OPatch/opatch auto /tmp/db_grid_psu/ -oh /u01/app/11.2.0/grid/ 10 b1 b2 [root@rac1 ~]# /u01/app/11.2.0/grid/OPatch/opatch auto /tmp/db_grid_psu/ -oh /u01/app/11.2.0/grid/ Executing /u01/app/11.2.0/grid/perl/bin/perl /u01/app/11.2.0/grid/OPatch/crs/patch11203.pl -patchdir /tmp -patchn db_grid_psu -oh /u01/app/11.2.0/grid/ -paramfile /u01/app/11.2.0/grid/crs/install/crsconfig_params /u01/app/11.2.0/grid/crs/install/crsconfig_params /u01/app/11.2.0/grid/crs/install/s_crsconfig_defs This is the main log file: /u01/app/11.2.0/grid/cfgtoollogs/opatchauto2013-12-09_19-13-07.log This file will show your detected configuration and all the steps that opatchauto attempted to do on your system: /u01/app/11.2.0/grid/cfgtoollogs/opatchauto2013-12-09_19-13-07.report.log 2013-12-09 19:13:07: Starting Clusterware Patch Setup Using configuration parameter file: /u01/app/11.2.0/grid/crs/install/crsconfig_params Enter 'yes' if you have unzipped this patch to an empty directory to proceed  (yes/no):yes OPatch  is bundled with OCM, Enter the absolute OCM response file path: /tmp/ocm.rsp CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'rac1' CRS-2673: Attempting to stop 'ora.crsd' on 'rac1' CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'rac1' CRS-2673: Attempting to stop 'ora.FRA.dg' on 'rac1' CRS-2673: Attempting to stop 'ora.prod.db' on 'rac1' CRS-2673: Attempting to stop 'ora.cvu' on 'rac1' CRS-2673: Attempting to stop 'ora.LISTENER_SCAN1.lsnr' on 'rac1' CRS-2673: Attempting to stop 'ora.oc4j' on 'rac1' CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'rac1' CRS-2677: Stop of 'ora.cvu' on 'rac1' succeeded CRS-2672: Attempting to start 'ora.cvu' on 'rac1' CRS-2677: Stop of 'ora.LISTENER_SCAN1.lsnr' on 'rac1' succeeded CRS-2673: Attempting to stop 'ora.scan1.vip' on 'rac1' CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'rac1' succeeded CRS-2673: Attempting to stop 'ora.rac1.vip' on 'rac1' CRS-2677: Stop of 'ora.scan1.vip' on 'rac1' succeeded CRS-2672: Attempting to start 'ora.scan1.vip' on 'rac1' CRS-2677: Stop of 'ora.rac1.vip' on 'rac1' succeeded CRS-2672: Attempting to start 'ora.rac1.vip' on 'rac1' CRS-2676: Start of 'ora.scan1.vip' on 'rac1' succeeded CRS-2677: Stop of 'ora.prod.db' on 'rac1' succeeded CRS-2673: Attempting to stop 'ora.DATA.dg' on 'rac1' CRS-2676: Start of 'ora.rac1.vip' on 'rac1' succeeded CRS-2672: Attempting to start 'ora.LISTENER_SCAN1.lsnr' on 'rac1' CRS-2676: Start of 'ora.cvu' on 'rac1' succeeded CRS-2676: Start of 'ora.LISTENER_SCAN1.lsnr' on 'rac1' succeeded CRS-2677: Stop of 'ora.oc4j' on 'rac1' succeeded CRS-2672: Attempting to start 'ora.oc4j' on 'rac1' CRS-2677: Stop of 'ora.FRA.dg' on 'rac1' succeeded CRS-2677: Stop of 'ora.DATA.dg' on 'rac1' succeeded CRS-2673: Attempting to stop 'ora.asm' on 'rac1' CRS-2677: Stop of 'ora.asm' on 'rac1' succeeded CRS-2676: Start of 'ora.oc4j' on 'rac1' succeeded CRS-2673: Attempting to stop 'ora.ons' on 'rac1' CRS-2677: Stop of 'ora.ons' on 'rac1' succeeded CRS-2673: Attempting to stop 'ora.net1.network' on 'rac1' CRS-2677: Stop of 'ora.net1.network' on 'rac1' succeeded CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'rac1' has completed CRS-2677: Stop of 'ora.crsd' on 'rac1' succeeded CRS-2673: Attempting to stop 'ora.ctssd' on 'rac1' CRS-2673: Attempting to stop 'ora.evmd' on 'rac1' CRS-2673: Attempting to stop 'ora.asm' on 'rac1' CRS-2673: Attempting to stop 'ora.mdnsd' on 'rac1' CRS-2677: Stop of 'ora.evmd' on 'rac1' succeeded CRS-2677: Stop of 'ora.ctssd' on 'rac1' succeeded CRS-2677: Stop of 'ora.mdnsd' on 'rac1' succeeded CRS-2677: Stop of 'ora.asm' on 'rac1' succeeded CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'rac1' CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'rac1' succeeded CRS-2673: Attempting to stop 'ora.cssd' on 'rac1' CRS-2677: Stop of 'ora.cssd' on 'rac1' succeeded CRS-2673: Attempting to stop 'ora.crf' on 'rac1' CRS-2677: Stop of 'ora.crf' on 'rac1' succeeded CRS-2673: Attempting to stop 'ora.gipcd' on 'rac1' CRS-2677: Stop of 'ora.gipcd' on 'rac1' succeeded CRS-2673: Attempting to stop 'ora.gpnpd' on 'rac1' CRS-2677: Stop of 'ora.gpnpd' on 'rac1' succeeded CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'rac1' has completed CRS-4133: Oracle High Availability Services has been stopped. Successfully unlock /u01/app/11.2.0/grid patch /tmp/db_grid_psu/16902043  apply successful for home  /u01/app/11.2.0/grid CRS-4123: Oracle High Availability Services has been started.  Do the same on rac2 node as well. Before applying PSU patch copy new opatch zip file to GRID Oracle Home  and take the backup of existing OPatch Directory and unzip the p6880880_11200*.zip file under Grid Oracle Home once it is done. rac2 [root@rac2 ~]# /u01/app/11.2.0/grid/OPatch/opatch auto /tmp/db_grid_psu/ -oh /u01/app/11.2.0/grid/ Executing /u01/app/11.2.0/grid/perl/bin/perl /u01/app/11.2.0/grid/OPatch/crs/patch11203.pl -patchdir /tmp -patchn db_grid_psu -oh /u01/app/11.2.0/grid/ -paramfile /u01/app/11.2.0/grid/crs/install/crsconfig_params /u01/app/11.2.0/grid/crs/install/crsconfig_params /u01/app/11.2.0/grid/crs/install/s_crsconfig_defs This is the main log file: /u01/app/11.2.0/grid/cfgtoollogs/opatchauto2013-12-09_19-13-07.log This file will show your detected configuration and all the steps that opatchauto attempted to do on your system: /u01/app/11.2.0/grid/cfgtoollogs/opatchauto2013-12-09_19-13-07.report.log 2013-12-09 19:13:07: Starting Clusterware Patch Setup Using configuration parameter file: /u01/app/11.2.0/grid/crs/install/crsconfig_params Enter 'yes' if you have unzipped this patch to an empty directory to proceed  (yes/no):yes OPatch  is bundled with OCM, Enter the absolute OCM response file path: /tmp/ocm.rsp CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'rac2' CRS-2673: Attempting to stop 'ora.crsd' on 'rac2' CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'rac2' CRS-2673: Attempting to stop 'ora.FRA.dg' on 'rac2' CRS-2673: Attempting to stop 'ora.prod.db' on 'rac2' CRS-2673: Attempting to stop 'ora.cvu' on 'rac2' CRS-2673: Attempting to stop 'ora.LISTENER_SCAN1.lsnr' on 'rac2' CRS-2673: Attempting to stop 'ora.oc4j' on 'rac2' CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'rac2' CRS-2677: Stop of 'ora.cvu' on 'rac2' succeeded CRS-2672: Attempting to start 'ora.cvu' on 'rac1' CRS-2677: Stop of 'ora.LISTENER_SCAN1.lsnr' on 'rac2' succeeded CRS-2673: Attempting to stop 'ora.scan1.vip' on 'rac2' CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'rac2' succeeded CRS-2673: Attempting to stop 'ora.rac2.vip' on 'rac2' CRS-2677: Stop of 'ora.scan1.vip' on 'rac2' succeeded CRS-2672: Attempting to start 'ora.scan1.vip' on 'rac1' CRS-2677: Stop of 'ora.rac2.vip' on 'rac2' succeeded CRS-2672: Attempting to start 'ora.rac2.vip' on 'rac1' CRS-2676: Start of 'ora.scan1.vip' on 'rac1' succeeded CRS-2677: Stop of 'ora.prod.db' on 'rac2' succeeded CRS-2673: Attempting to stop 'ora.DATA.dg' on 'rac2' CRS-2676: Start of 'ora.rac2.vip' on 'rac1' succeeded CRS-2672: Attempting to start 'ora.LISTENER_SCAN1.lsnr' on 'rac1' CRS-2676: Start of 'ora.cvu' on 'rac1' succeeded CRS-2676: Start of 'ora.LISTENER_SCAN1.lsnr' on 'rac1' succeeded CRS-2677: Stop of 'ora.oc4j' on 'rac2' succeeded CRS-2672: Attempting to start 'ora.oc4j' on 'rac1' CRS-2677: Stop of 'ora.FRA.dg' on 'rac2' succeeded CRS-2677: Stop of 'ora.DATA.dg' on 'rac2' succeeded CRS-2673: Attempting to stop 'ora.asm' on 'rac2' CRS-2677: Stop of 'ora.asm' on 'rac2' succeeded CRS-2676: Start of 'ora.oc4j' on 'rac1' succeeded CRS-2673: Attempting to stop 'ora.ons' on 'rac2' CRS-2677: Stop of 'ora.ons' on 'rac2' succeeded CRS-2673: Attempting to stop 'ora.net1.network' on 'rac2' CRS-2677: Stop of 'ora.net1.network' on 'rac2' succeeded CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'rac2' has completed CRS-2677: Stop of 'ora.crsd' on 'rac2' succeeded CRS-2673: Attempting to stop 'ora.ctssd' on 'rac2' CRS-2673: Attempting to stop 'ora.evmd' on 'rac2' CRS-2673: Attempting to stop 'ora.asm' on 'rac2' CRS-2673: Attempting to stop 'ora.mdnsd' on 'rac2' CRS-2677: Stop of 'ora.evmd' on 'rac2' succeeded CRS-2677: Stop of 'ora.ctssd' on 'rac2' succeeded CRS-2677: Stop of 'ora.mdnsd' on 'rac2' succeeded CRS-2677: Stop of 'ora.asm' on 'rac2' succeeded CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'rac2' CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'rac2' succeeded CRS-2673: Attempting to stop 'ora.cssd' on 'rac2' CRS-2677: Stop of 'ora.cssd' on 'rac2' succeeded CRS-2673: Attempting to stop 'ora.crf' on 'rac2' CRS-2677: Stop of 'ora.crf' on 'rac2' succeeded CRS-2673: Attempting to stop 'ora.gipcd' on 'rac2' CRS-2677: Stop of 'ora.gipcd' on 'rac2' succeeded CRS-2673: Attempting to stop 'ora.gpnpd' on 'rac2' CRS-2677: Stop of 'ora.gpnpd' on 'rac2' succeeded CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'rac2' has completed CRS-4133: Oracle High Availability Services has been stopped. Successfully unlock /u01/app/11.2.0/grid patch /tmp/db_grid_psu/16902043  apply successful for home  /u01/app/11.2.0/grid CRS-4123: Oracle High Availability Services has been started. Finally I suggest bounce all the RAC nodes and check whether all the services are up or not. Cross check the patch [grid@rac1 ~]$ $GRID_HOME/OPatch/opatch lsinventory Oracle Interim Patch Installer version 11.2.0.3.5 Copyright (c) 2013, Oracle Corporation. All rights reserved. Oracle Home : /u01/app/11.2.0/grid Central Inventory : /u01/app/oraInventory from : /u01/app/11.2.0/grid/oraInst.loc OPatch version : 11.2.0.3.5 OUI version : 11.2.0.3.0 Log file location : /u01/app/11.2.0/grid/cfgtoollogs/opatch/opatch2013-12-11_20-11-30PM_1.log Lsinventory Output file location : /u01/app/11.2.0/grid/cfgtoollogs/opatch/lsinv/lsinventory2013-12-11_20-11-30PM.txt -------------------------------------------------------------------------------- Installed Top-level Products (1): Oracle Grid Infrastructure 11.2.0.3.0 There are 1 products installed in this Oracle Home. Interim patches (1) : Patch 16902043 : applied on Mon Dec 09 18:27:57 IST 2013 Unique Patch ID: 16676143 Patch description: "Database Patch Set Update : 11.2.0.3.8 (16902043)" Created on 24 Sep 2013, 23:20:58 hrs PST8PDT Sub-patch 16619892; "Database Patch Set Update : 11.2.0.3.7 (16619892)" Sub-patch 16056266; "Database Patch Set Update : 11.2.0.3.6 (16056266)" Sub-patch 14727310; "Database Patch Set Update : 11.2.0.3.5 (14727310)" Sub-patch 14275605; "Database Patch Set Update : 11.2.0.3.4 (14275605)" Sub-patch 13923374; "Database Patch Set Update : 11.2.0.3.3 (13923374)" Sub-patch 13696216; "Database Patch Set Update : 11.2.0.3.2 (13696216)" Sub-patch 13343438; "Database Patch Set Update : 11.2.0.3.1 (13343438)" Bugs fixed: 13593999, 13566938, 10350832, 14138130, 12919564, 14198511, 13561951 13624984, 13588248, 16024441, 13080778, 17333199, 13914613, 13804294 16710324, 14258925, 12873183, 14755945, 13645875, 14472647, 12880299 14664355, 12998795, 14409183, 13719081, 14469008, 13492735, 13496884 12857027, 14263036, 13015379, 14263073, 14188650, 13742433, 13732226 16368108, 16314469, 12905058, 6690853, 13742434, 16212405, 12849688 12950644, 13742435, 13464002, 12899768, 12879027, 13063120, 13534412 13958038, 14613900, 12585543, 12535346, 13790109, 16382448, 12588744 13972394, 11877623, 13072654, 12395918, 13786142, 13814739, 12847466 13649031, 13855490, 13981051, 12582664, 12797765, 17333200, 14262913 17332800, 12923168, 14695377, 13384182, 12912137, 16279401, 13612575 13466801, 13484963, 14207163, 13724193, 13642044, 13772618, 11063191 16694777, 13945708, 13070939, 12797420, 12865902, 13041324, 15869211 13605839, 14003090, 16314467, 16279211, 16314468, 12976376, 12755231 11708510, 13680405, 13742437, 14589750, 13026410, 13737746, 11868640 13742438, 14644185, 13326736, 15841373, 15910002, 13596521, 16362358 14398795, 13001379, 13579992, 16344871, 13099577, 9873405, 13742436 14275605, 9858539, 16372203, 14841812, 16344758, 11715084, 9547706 16231699, 14040433, 9703627, 12662040, 12617123, 16530565, 13483354 14393728, 14207317, 12845115, 12764337, 13354082, 16902043, 14459552 13397104, 14191508, 13913630, 12964067, 12983611, 13550185, 12780983 13810393, 12583611, 14546575, 15862016, 13476583, 13489024, 11840910 13903046, 15862017, 13572659, 16294378, 13718279, 13657605, 14088346 13448206, 16314466, 13419660, 14480676, 13632717, 14668670, 14063281 14110275, 13430938, 13467683, 13420224, 13812031, 14548763, 12646784 16299830, 14512189, 12755116, 17230530, 13616375, 14035825, 13427062 12861463, 12834027, 13092220, 15862021, 13632809, 13377816, 13036331 14727310, 16619892, 13685544, 13499128, 15862018, 16175381, 13584130 12829021, 15862019, 12794305, 14546673, 12791981, 13561750, 13503598 13787482, 10133521, 12744759, 12718090, 13848402, 13399435, 14762511 14023636, 9095696, 13725395, 12401111, 13860201, 12796518, 13257247 13362079, 14176879, 12917230, 13923374, 16014985, 14220725, 12621588 12312133, 13524899, 14480675, 16306019, 13559697, 9706792, 12974860 12940620, 14751895, 14480674, 13916709, 13098318, 14076523, 13773133 16794244, 15905421, 13340388, 13528551, 13366202, 12731940, 12894807 12747437, 13343438, 13454210, 12748240, 14205448, 13385346, 17082364 14127231, 15853081, 14273397, 14467061, 12971775, 13923995, 13582702 14571027, 12784406, 13907462, 12748538, 10242202, 13493847, 13035804 13857111, 16710363, 13544396, 14128555, 13686047, 16382353, 8547978 14226599, 17333203, 14095982, 13591624, 17333197, 14523004, 13440516 9397635, 14007968, 16794241, 13035360, 14062795, 12693626, 12925089 14189694, 12815057, 13332439, 14038787, 13040943, 11071989, 13843646 14062796, 16794243, 12913474, 14841409, 14390252, 13370330, 16314470 14062797, 13059165, 14062794, 12959852, 12345082, 13358781, 17333202 12960925, 16703112, 9659614, 14546638, 13699124, 13936424, 17333198 16794240, 14301592, 13338048, 12938841, 12658411, 12620823, 12656535 14062793, 12678920, 13038684, 14791477, 14062792, 13807411, 16742095 16794238, 15862022, 12594032, 13250244, 12612118, 9761357, 14053457 13742464, 14052474, 13060271, 13911821, 13457582, 13527323, 7509451 13791364, 15862020, 13910420, 12821418, 12780098, 13502183, 13696216 13705338, 14841558, 10263668, 16794242, 15862023, 16056266, 13834065 14351566, 13723052, 16794239, 13554409, 15862024, 13103913, 13645917 14063280, 12772404, 13011409  Rac system comprising of multiple nodes Local node = rac1 Remote node = rac2 -------------------------------------------------------------------------------- OPatch succeeded.

Posted December 11, 2013 by balaoracledba.com in OracleRAC

3 responses to “Applying PSU Patch on Two Node RAC GRID Oracle Home.

Subscribe to comments with RSS.

  1. Nice article. Try to put all screenshots in order (no side-by-side, unless they fit properly) and make sure you are placing full screenshots.

  2. please provide the total information for node 2 and after patching post installation steps as well.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: