如何来分析oracle 11g grid infrastructure root.sh 执行错误诊断？

Troubleshooting 11.2 Grid Infrastructure root.sh Issues (文档 ID 1053970.1)

转到底部

修改时间:2013-3-20类型:TROUBLESHOOTING

In this Document

Purpose

Troubleshooting Steps

Advanced Root.sh Troubleshooting

Community Discussions

References

Applies to:

Oracle Database -Enterprise Edition - Version 11.2.0.1 to 11.2.0.3 [Release 11.2]
Information in this document applies to any platform.

Purpose

This document is to provide a reference fortroubleshooting root.sh issues after installing an 11.2 Grid Infrastructurehome for a cluster. For versions prior to 11.2, seeNote: 240001.1

TroubleshootingSteps

At the end of a grid infrastructureinstallation, the user is prompted to run the "root.sh" script. This script configures and starts the Oracle Clusterware stack. A root.shscript can error out and/or fail under one of the following conditions:

• Problem with the network configuration.
• Problem with the storage location for the OCR and/or voting files.
• Permission problem with/var/tmp (specifically /var/tmp/.oracle).
• Problem with the vendor clusterware (if used).
• Some other configuration issue.
• An Oracle bug.

  Most configuration issues should bedetectable by running the Cluster Verification Utility with the followingsyntax (input the nodelist):

  cd<GRID_HOME>/bin
  ./cluvfy stage -pre crsinst -n <nodelist> -r 11gR2 -verbose

  
  Additional options can be used for a more thorough check:

  USAGE:
  cluvfy stage -pre crsinst -n <node_list> [-r {10gR1|10gR2|11gR1|11gR2}]
  [-c <ocr_location_list>] [-q <voting_disk_list>]
  [-osdba <osdba_group>]
  [-orainv <orainventory_group>]
  [-asm -asmgrp <asmadmin_group>]
  [-asm -asmdev <asm_device_list>]
  [-fixup [-fixupdir <fixup_dir>]] [-verbose]

  
  If the Cluster Verification Utility is unable to find a configuration problemand your root.sh still fails, you may need the assistance of Oracle Support totroubleshoot further and/or see the "Advanced Root.shTroubleshooting" section:

  Advanced Root.sh Troubleshooting

  The root.sh is simply a parent script thatcalls the following scripts:
  
  <GRID_HOME>/install/utl/rootmacro.sh # small - validateshome and user
  <GRID_HOME>/install/utl/rootinstall.sh # small -creates some local files
  <GRID_HOME>/network/install/sqlnet/setowner.sh # small -opens up /tmp permissions
  <GRID_HOME>/rdbms/install/rootadd_rdbms.sh # small - miscfile/permission checks
  <GRID_HOME>/rdbms/install/rootadd_filemap.sh # small - miscfile/permission checks
  <GRID_HOME>/crs/install/rootcrs.pl # MAIN CLUSTERWARE CONFIGSCRIPT
  
  If your root.sh is failing on one of the first 5 scripts, it should be an easyfix since those fix are small and easy to troubleshoot. However, mostproblems are likely going to happen in the rootcrs.pl script which is the mainclusterware config script. This script will log useful trace data to<GRID_HOME>/cfgtoollogs/crsconfig/rootcrs_<nodename>.log. However, you should check the clusterware alert log under<GRID_HOME>/log/<nodename> first for any obvious problems orerrors.
  
  In the following section I will show the log output of a new installation on a2 node cluster (racbde1 and racbde2) where the OCR and Voting files will bestored in ASM on a diskgroup called +SYSTEMDG. This log information isposted for reference. It might be useful to compare the clusterware alertlog from a working root.sh (mine) to a failing one (yours) to see where it wentwrong. I willbold the major landmarks in the clusterwarealert log so that you can see how far you got:
  
  Node 1 (racbde1) Clusterware Alert Log During root.sh:

  Oracle Database11g Clusterware Release 11.2.0.1.0 - Production Copyright 1996, 2009 Oracle.All rights reserved.
  2009-12-23 19:24:33.844
  [client(17368)]CRS-2106:The OLR location /u01/app/grid/cdata/racbde1.olr isinaccessible. Details in /u01/app/grid/log/racbde1/client/ocrconfig_17368.log.
  2009-12-23 19:24:33.956
  [client(17368)]CRS-2101:The OLR was formatted using version 3.
  2009-12-23 19:25:02.495
  [ohasd(17767)]CRS-2112:The OLR service started on node racbde1.
  2009-12-23 19:25:02.833
  [ohasd(17767)]CRS-2772:Server 'racbde1' has been assigned to pool 'Free'.
  2009-12-23 19:25:34.801
  [cssd(18791)]CRS-1713:CSSD daemon is started in exclusive mode
  2009-12-23 19:25:37.126
  [cssd(18791)]CRS-1709:Lease acquisition failed for node racbde1 because novoting file has been configured; Details at (:CSSNM00031:) in/u01/app/grid/log/racbde1/cssd/ocssd.log
  2009-12-23 19:25:54.705
  [cssd(18791)]CRS-1601:CSSD Reconfiguration complete. Active nodes areracbde1 .
  2009-12-23 19:25:55.431
  [ctssd(18848)]CRS-2403:The Cluster Time Synchronization Service on host racbde1is in observer mode.
  2009-12-23 19:25:55.575
  [ctssd(18848)]CRS-2407:The new Cluster Time Synchronization Service referencenode is host racbde1.
  2009-12-23 19:25:56.312
  [ctssd(18848)]CRS-2401:The Cluster Time Synchronization Service started on hostracbde1.
  [client(19034)]CRS-10001:ACFS-9327: Verifying ADVM/ACFS devices.
  [client(19038)]CRS-10001:ACFS-9322: done.
  2009-12-23 19:30:26.790
  [client(19423)]CRS-1006:The OCR location +SYSTEMDG is inaccessible. Details in/u01/app/grid/log/racbde1/client/ocrconfig_19423.log.
  2009-12-23 19:30:27.883
  [client(19423)]CRS-1001:The OCR was formatted using version 3.
  2009-12-23 19:30:40.473
  [crsd(19480)]CRS-1012:The OCR service started on node racbde1.
  2009-12-23 19:31:53.331
  [cssd(18791)]CRS-1605:CSSD voting file is online: /dev/sdb1;details in /u01/app/grid/log/racbde1/cssd/ocssd.log.
  2009-12-23 19:31:53.373
  [cssd(18791)]CRS-1605:CSSD voting file is online: /dev/sdb2;details in /u01/app/grid/log/racbde1/cssd/ocssd.log.
  2009-12-23 19:31:53.417
  [cssd(18791)]CRS-1605:CSSD voting file is online: /dev/sdb3;details in /u01/app/grid/log/racbde1/cssd/ocssd.log.
  2009-12-23 19:31:54.413
  [cssd(18791)]CRS-1626:A Configuration change request completed successfully
  2009-12-23 19:31:54.424
  [cssd(18791)]CRS-1601:CSSD Reconfiguration complete. Active nodes areracbde1 .
  2009-12-23 19:32:10.831
  [ctssd(18848)]CRS-2405:The Cluster Time Synchronization Service on host racbde1is shutdown by user
  2009-12-23 19:32:26.536
  [cssd(18791)]CRS-1603:CSSD on node racbde1 shutdown by user.
  2009-12-23 19:32:26.856
  [cssd(18791)]CRS-1625:Node racbde1, number 1, was manually shut down
  2009-12-23 19:32:44.826
  [cssd(20125)]CRS-1713:CSSD daemon is started in clustered mode
  2009-12-23 19:34:07.568
  [cssd(20125)]CRS-1707:Lease acquisition for node racbde1 number 1completed
  2009-12-23 19:34:07.690
  [cssd(20125)]CRS-1605:CSSD voting file is online: /dev/sdb3; details in/u01/app/grid/log/racbde1/cssd/ocssd.log.
  2009-12-23 19:34:07.731
  [cssd(20125)]CRS-1605:CSSD voting file is online: /dev/sdb2; details in/u01/app/grid/log/racbde1/cssd/ocssd.log.
  2009-12-23 19:34:07.774
  [cssd(20125)]CRS-1605:CSSD voting file is online: /dev/sdb1; details in/u01/app/grid/log/racbde1/cssd/ocssd.log.
  2009-12-23 19:34:25.380
  [cssd(20125)]CRS-1601:CSSD Reconfiguration complete. Active nodes areracbde1 .
  2009-12-23 19:34:26.324
  [ctssd(20269)]CRS-2403:The Cluster Time Synchronization Service on host racbde1is in observer mode.
  2009-12-23 19:34:26.448
  [ctssd(20269)]CRS-2407:The new Cluster Time Synchronization Service referencenode is host racbde1.
  2009-12-23 19:34:27.278
  [ctssd(20269)]CRS-2401:The Cluster Time Synchronization Service startedon host racbde1.
  2009-12-23 19:34:41.941
  [crsd(20392)]CRS-1012:The OCR service started on node racbde1.
  2009-12-23 19:34:44.734
  [crsd(20392)]CRS-1201:CRSD started on node racbde1.

  
  
  Node 2 (racbde2) Clusterware Alert Log During root.sh:

  Oracle Database11g Clusterware Release 11.2.0.1.0 - Production Copyright 1996, 2009 Oracle.All rights reserved.
  2009-12-23 19:33:43.687
  [client(12019)]CRS-2106:The OLR location /u01/app/grid/cdata/racbde2.olr isinaccessible. Details in /u01/app/grid/log/racbde2/client/ocrconfig_12019.log.
  2009-12-23 19:33:43.700
  [client(12019)]CRS-2101:The OLR was formatted using version 3.
  2009-12-23 19:33:50.660
  [ohasd(12058)]CRS-2112:The OLR service started on node racbde2.
  2009-12-23 19:33:50.946
  [ohasd(12058)]CRS-2772:Server 'racbde2' has been assigned to pool 'Free'.
  2009-12-23 19:34:15.140
  [ohasd(12058)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPDdaemon is not running).
  2009-12-23 19:34:17.910
  [cssd(13108)]CRS-1713:CSSD daemon is started in exclusive mode
  2009-12-23 19:35:39.019
  [cssd(13108)]CRS-1707:Lease acquisition for node racbde2 number 2completed
  [cssd(13108)]CRS-1636:The CSS daemon was started in exclusive mode but found anactive CSS daemon on node racbde1 and is terminating; details at (:CSSNM00006:)in /u01/app/grid/log/racbde2/cssd/ocssd.log
  2009-12-23 19:35:39.043
  [cssd(13108)]CRS-1603:CSSD on node racbde2 shutdown by user.
  2009-12-23 19:35:39.152
  [ohasd(12058)]CRS-2765:Resource 'ora.cssdmonitor' has failed on server'racbde2'.
  2009-12-23 19:36:00.206
  [cssd(13376)]CRS-1713:CSSD daemon is started in clustered mode
  2009-12-23 19:36:19.648
  [cssd(13376)]CRS-1707:Lease acquisition for node racbde2 number 2completed
  2009-12-23 19:36:19.762
  [cssd(13376)]CRS-1605:CSSD voting file is online: /dev/sdb1;details in /u01/app/grid/log/racbde2/cssd/ocssd.log.
  2009-12-23 19:36:19.810
  [cssd(13376)]CRS-1605:CSSD voting file is online: /dev/sdb3;details in /u01/app/grid/log/racbde2/cssd/ocssd.log.
  2009-12-23 19:36:19.857
  [cssd(13376)]CRS-1605:CSSD voting file is online: /dev/sdb2;details in /u01/app/grid/log/racbde2/cssd/ocssd.log.
  2009-12-23 19:36:31.342
  [cssd(13376)]CRS-1601:CSSD Reconfiguration complete. Active nodes areracbde1 racbde2 .
  2009-12-23 19:36:32.707
  [ctssd(13443)]CRS-2403:The Cluster Time Synchronization Service on host racbde2is in observer mode.
  2009-12-23 19:36:32.860
  [ctssd(13443)]CRS-2407:The new Cluster Time Synchronization Service referencenode is host racbde1.
  2009-12-23 19:36:33.600
  [ctssd(13443)]CRS-2401:The Cluster Time Synchronization Service startedon host racbde2.
  [client(13473)]CRS-10001:ACFS-9327: Verifying ADVM/ACFS devices.
  [client(13477)]CRS-10001:ACFS-9322: done.
  2009-12-23 19:39:27.166
  [crsd(13606)]CRS-1012:The OCR service started on node racbde2.
  2009-12-23 19:39:30.419
  [crsd(13606)]CRS-1201:CRSD started on node racbde2.

  
  
  If further analysis is needed, it might be useful to compare a working rootcrsoutput (mine) to one that is failing (yours) to see what went wrong. Again the rootcrs log is in <GRID_HOME>/cfgtoollogs/crsconfig/rootcrs_<nodename>.log. I will divide the log into the following rootcrs sections:

  • First Node Initial Setup (racbde1)
  • First Node Setup OLR for storing Oracle local registry data
  • First Node Setup GPnP wallet and profile
  • First Node Setup and copy files for OHASD daemon
  • First Node Start OHASD Daemon
  • First Node Copy required CRS resources for OHASD to start
  • First Node Start in Exclusive Mode and Configure Diskgroup
  • First Node Push GPnP Profile to Remote Node(s)
  • First Node Start Full Clusterware Stack
  • First Node Adding Clusterware Resources
  • Secondary Note Initial Setup (racbde2)
  • Secondary Note Get GPnP Profile
  • Secondary Node Setup OLR for storing Oracle local registry data
  • Secondary Node Setup and copy files for OHASD daemon
  • Secondary Node Start OHASD Daemon
  • Secondary Node Copy required CRS resources for OHASD to start
  • Secondary Node Start Full Clusterware Stack
  • Secondary Node Adding Clusterware Resources

    
    First Node Initial Setup (racbde1):

    2009-12-2319:24:30: The configuration parameter file/u01/app/grid/crs/install/crsconfig_params is valid
    2009-12-23 19:24:30: Checking for super user privileges
    2009-12-23 19:24:30: User has super user privileges
    2009-12-23 19:24:30: ### Printing the configuration values from files:
    2009-12-23 19:24:30: /u01/app/grid/crs/install/crsconfig_params
    2009-12-23 19:24:30: /u01/app/grid/crs/install/s_crsconfig_defs
    2009-12-23 19:24:30: ASM_DISCOVERY_STRING=/dev/sdb*
    2009-12-23 19:24:30: ASM_DISKS=/dev/sdb1,/dev/sdb2,/dev/sdb3
    2009-12-23 19:24:30: ASM_DISK_GROUP=SYSTEMDG
    2009-12-23 19:24:30: ASM_REDUNDANCY=NORMAL
    2009-12-23 19:24:30: ASM_SPFILE=
    2009-12-23 19:24:30: ASM_UPGRADE=false
    2009-12-23 19:24:30: CLSCFG_MISSCOUNT=
    2009-12-23 19:24:30: CLUSTER_GUID=
    2009-12-23 19:24:30: CLUSTER_NAME=racbde-scan
    2009-12-23 19:24:30:CRS_NODEVIPS='racbde1-vip/255.255.254.0/eth1,racbde2-vip/255.255.254.0/eth1'
    2009-12-23 19:24:30: CRS_STORAGE_OPTION=1
    2009-12-23 19:24:30: CSS_LEASEDURATION=400
    2009-12-23 19:24:30: DIRPREFIX=
    2009-12-23 19:24:30: DISABLE_OPROCD=0
    2009-12-23 19:24:30: EMBASEJAR_NAME=oemlt.jar
    2009-12-23 19:24:30: EWTJAR_NAME=ewt3.jar
    2009-12-23 19:24:30: EXTERNAL_ORACLE_BIN=/opt/oracle/bin
    2009-12-23 19:24:30: GNS_ADDR_LIST=
    2009-12-23 19:24:30: GNS_ALLOW_NET_LIST=
    2009-12-23 19:24:30: GNS_CONF=false
    2009-12-23 19:24:30: GNS_DENY_ITF_LIST=
    2009-12-23 19:24:30: GNS_DENY_NET_LIST=
    2009-12-23 19:24:30: GNS_DOMAIN_LIST=
    2009-12-23 19:24:30: GPNPCONFIGDIR=/u01/app/grid
    2009-12-23 19:24:30: GPNPGCONFIGDIR=/u01/app/grid
    2009-12-23 19:24:30: GPNP_PA=
    2009-12-23 19:24:30: HELPJAR_NAME=help4.jar
    2009-12-23 19:24:30: HOST_NAME_LIST=racbde1,racbde2
    2009-12-23 19:24:30: ID=/etc/init.d
    2009-12-23 19:24:30: INIT=/sbin/init
    2009-12-23 19:24:30: IT=/etc/inittab
    2009-12-23 19:24:30: JEWTJAR_NAME=jewt4.jar
    2009-12-23 19:24:30: JLIBDIR=/u01/app/grid/jlib
    2009-12-23 19:24:30: JREDIR=/u01/app/grid/jdk/jre/
    2009-12-23 19:24:30: LANGUAGE_ID=AMERICAN_AMERICA.AL32UTF8
    2009-12-23 19:24:30: MSGFILE=/var/adm/messages
    2009-12-23 19:24:30: NETCFGJAR_NAME=netcfg.jar
    2009-12-23 19:24:30:NETWORKS="eth1"/10.141.154.0:public,"eth0"/192.168.0.0:cluster_interconnect
    2009-12-23 19:24:30: NEW_HOST_NAME_LIST=
    2009-12-23 19:24:30:NEW_NODEVIPS='racbde1-vip/255.255.254.0/eth1,racbde2-vip/255.255.254.0/eth1'
    2009-12-23 19:24:30: NEW_NODE_NAME_LIST=
    2009-12-23 19:24:30: NEW_PRIVATE_NAME_LIST=
    2009-12-23 19:24:30: NODELIST=racbde1,racbde2
    2009-12-23 19:24:30: NODE_NAME_LIST=racbde1,racbde2
    2009-12-23 19:24:30: OCFS_CONFIG=
    2009-12-23 19:24:30: OCRCONFIG=/etc/oracle/ocr.loc
    2009-12-23 19:24:30: OCRCONFIGDIR=/etc/oracle
    2009-12-23 19:24:30: OCRID=
    2009-12-23 19:24:30: OCRLOC=ocr.loc
    2009-12-23 19:24:30: OCR_LOCATIONS=NO_VAL
    2009-12-23 19:24:30: OLASTGASPDIR=/etc/oracle/lastgasp
    2009-12-23 19:24:30: OLRCONFIG=/etc/oracle/olr.loc
    2009-12-23 19:24:30: OLRCONFIGDIR=/etc/oracle
    2009-12-23 19:24:30: OLRLOC=olr.loc
    2009-12-23 19:24:30: OPROCDCHECKDIR=/etc/oracle/oprocd/check
    2009-12-23 19:24:30: OPROCDDIR=/etc/oracle/oprocd
    2009-12-23 19:24:30: OPROCDFATALDIR=/etc/oracle/oprocd/fatal
    2009-12-23 19:24:30: OPROCDSTOPDIR=/etc/oracle/oprocd/stop
    2009-12-23 19:24:30: ORACLE_BASE=/u01/app/oracle
    2009-12-23 19:24:30: ORACLE_HOME=/u01/app/grid
    2009-12-23 19:24:30: ORACLE_OWNER=oracle
    2009-12-23 19:24:30: ORA_ASM_GROUP=oinstall
    2009-12-23 19:24:30: ORA_DBA_GROUP=oinstall
    2009-12-23 19:24:30: PRIVATE_NAME_LIST=
    2009-12-23 19:24:30: RCALLDIR=/etc/rc.d/rc0.d /etc/rc.d/rc1.d /etc/rc.d/rc2.d/etc/rc.d/rc3.d /etc/rc.d/rc4.d /etc/rc.d/rc5.d /etc/rc.d/rc6.d
    2009-12-23 19:24:30: RCKDIR=/etc/rc.d/rc0.d /etc/rc.d/rc1.d /etc/rc.d/rc2.d/etc/rc.d/rc4.d /etc/rc.d/rc6.d
    2009-12-23 19:24:30: RCSDIR=/etc/rc.d/rc3.d /etc/rc.d/rc5.d
    2009-12-23 19:24:30: RC_KILL=K19
    2009-12-23 19:24:30: RC_KILL_OLD=K96
    2009-12-23 19:24:30: RC_START=S96
    2009-12-23 19:24:30: SCAN_NAME=racbde-scan.us.oracle.com
    2009-12-23 19:24:30: SCAN_PORT=1521
    2009-12-23 19:24:30: SCRBASE=/etc/oracle/scls_scr
    2009-12-23 19:24:30: SHAREJAR_NAME=share.jar
    2009-12-23 19:24:30: SILENT=false
    2009-12-23 19:24:30: SO_EXT=so
    2009-12-23 19:24:30: SRVCFGLOC=srvConfig.loc
    2009-12-23 19:24:30: SRVCONFIG=/var/opt/oracle/srvConfig.loc
    2009-12-23 19:24:30: SRVCONFIGDIR=/var/opt/oracle
    2009-12-23 19:24:30: VNDR_CLUSTER=false
    2009-12-23 19:24:30: VOTING_DISKS=NO_VAL
    2009-12-23 19:24:30: ### Printing other configuration values ###
    2009-12-23 19:24:30: CLSCFG_EXTRA_PARMS=
    2009-12-23 19:24:30: CRSDelete=0
    2009-12-23 19:24:30: CRSPatch=0
    2009-12-23 19:24:30: DEBUG=
    2009-12-23 19:24:30: DOWNGRADE=
    2009-12-23 19:24:30: HAS_GROUP=oinstall
    2009-12-23 19:24:30: HAS_USER=root
    2009-12-23 19:24:30: HOST=racbde1
    2009-12-23 19:24:30: IS_SIHA=0
    2009-12-23 19:24:30: OLR_DIRECTORY=/u01/app/grid/cdata
    2009-12-23 19:24:30: OLR_LOCATION=/u01/app/grid/cdata/racbde1.olr
    2009-12-23 19:24:30: ORA_CRS_HOME=/u01/app/grid
    2009-12-23 19:24:30: SUPERUSER=root
    2009-12-23 19:24:30: UPGRADE=
    2009-12-23 19:24:30: VF_DISCOVERY_STRING=
    2009-12-23 19:24:30: addfile=/u01/app/grid/crs/install/crsconfig_addparams
    2009-12-23 19:24:30: crscfg_trace=1
    2009-12-23 19:24:30: crscfg_trace_file=/u01/app/grid/cfgtoollogs/crsconfig/rootcrs_racbde1.log
    2009-12-23 19:24:30: hosts=
    2009-12-23 19:24:30: oldcrshome=
    2009-12-23 19:24:30: oldcrsver=
    2009-12-23 19:24:30: osdfile=/u01/app/grid/crs/install/s_crsconfig_defs
    2009-12-23 19:24:30: parameters_valid=1
    2009-12-23 19:24:30: paramfile=/u01/app/grid/crs/install/crsconfig_params
    2009-12-23 19:24:30: platform_family=unix
    2009-12-23 19:24:30: srvctl_trc_suff=0
    2009-12-23 19:24:30: unlock_crshome=
    2009-12-23 19:24:30: user_is_superuser=1
    2009-12-23 19:24:30: ### Printing of configuration values complete ###
    2009-12-23 19:24:30: Oracle CRS stack is not configured yet
    2009-12-23 19:24:30: CRS is not yet configured. Hence, will proceed toconfigure CRS
    2009-12-23 19:24:30: Cluster-wide one-time actions... Done!
    2009-12-23 19:24:32: Oracle CRS home = /u01/app/grid
    2009-12-23 19:24:32: Host name = racbde1
    2009-12-23 19:24:32: CRS user = oracle
    2009-12-23 19:24:32: Oracle CRS home = /u01/app/grid
    2009-12-23 19:24:32: GPnP host = racbde1
    2009-12-23 19:24:32: Oracle GPnP home = /u01/app/grid/gpnp
    2009-12-23 19:24:32: Oracle GPnP local home = /u01/app/grid/gpnp/racbde1
    2009-12-23 19:24:32: GPnP directories verified.
    2009-12-23 19:24:32: Checking to see if Oracle CRS stack is already configured
    2009-12-23 19:24:32: Oracle CRS stack is not configured yet
    2009-12-23 19:24:32: ---Checking local gpnp setup...
    2009-12-23 19:24:32: The setup file"/u01/app/grid/gpnp/racbde1/profiles/peer/profile.xml" does not exist
    2009-12-23 19:24:32: The setup file"/u01/app/grid/gpnp/racbde1/wallets/peer/cwallet.sso" does not exist
    2009-12-23 19:24:32: The setup file"/u01/app/grid/gpnp/racbde1/wallets/prdr/cwallet.sso" does not exist
    2009-12-23 19:24:32: chk gpnphome /u01/app/grid/gpnp/racbde1: profile_ok 0wallet_ok 0 r/o_wallet_ok 0
    2009-12-23 19:24:32: chk gpnphome /u01/app/grid/gpnp/racbde1: INVALID (badprofile/wallet)
    2009-12-23 19:24:32: ---Checking cluster-wide gpnp setup...
    2009-12-23 19:24:32: The setup file"/u01/app/grid/gpnp/profiles/peer/profile.xml" does not exist
    2009-12-23 19:24:32: The setup file "/u01/app/grid/gpnp/wallets/peer/cwallet.sso"does not exist
    2009-12-23 19:24:32: The setup file"/u01/app/grid/gpnp/wallets/prdr/cwallet.sso" does not exist
    2009-12-23 19:24:32: chk gpnphome /u01/app/grid/gpnp: profile_ok 0 wallet_ok 0r/o_wallet_ok 0
    2009-12-23 19:24:32: chk gpnphome /u01/app/grid/gpnp: INVALID (badprofile/wallet)
    2009-12-23 19:24:32: gpnp setup checked: local valid? 0 cluster-wide valid? 0
    2009-12-23 19:24:32: gpnp setup: NONE
    2009-12-23 19:24:32: GPNP configuration required
    2009-12-23 19:24:32: Validating for SI-CSS configuration

    
    First Node Setup OLR for storing Oracle local registry data:

    2009-12-2319:24:32: Retrieving OCR main disk location
    2009-12-23 19:24:32: Opening file OCRCONFIG
    2009-12-23 19:24:32: Value () is set for key=ocrconfig_loc
    2009-12-23 19:24:32: Unable to retrieve ocr disk info
    2009-12-23 19:24:32: Checking to see if any 9i GSD is up
    2009-12-23 19:24:32: libskgxnBase_lib = /etc/ORCLcluster/oracm/lib/libskgxn2.so
    2009-12-23 19:24:32: libskgxn_lib = /opt/ORCLcluster/lib/libskgxn2.so
    2009-12-23 19:24:32: SKGXN library file does not exists
    2009-12-23 19:24:32: OLR location = /u01/app/grid/cdata/racbde1.olr
    2009-12-23 19:24:32: Oracle CRS Home = /u01/app/grid
    2009-12-23 19:24:32: Validating /etc/oracle/olr.loc file for OLR location/u01/app/grid/cdata/racbde1.olr
    2009-12-23 19:24:32: /etc/oracle/olr.loc already exists. Backing up/etc/oracle/olr.loc to /etc/oracle/olr.loc.orig
    2009-12-23 19:24:32: Oracle CRS home = /u01/app/grid
    2009-12-23 19:24:32: Oracle cluster name = racbde-scan
    2009-12-23 19:24:32: OCR locations = +SYSTEMDG
    2009-12-23 19:24:32: Validating OCR
    2009-12-23 19:24:32: Retrieving OCR location used by previous installations
    2009-12-23 19:24:32: Opening file OCRCONFIG
    2009-12-23 19:24:32: Value () is set for key=ocrconfig_loc
    2009-12-23 19:24:32: Opening file OCRCONFIG
    2009-12-23 19:24:32: Value () is set for key=ocrmirrorconfig_loc
    2009-12-23 19:24:32: Opening file OCRCONFIG
    2009-12-23 19:24:32: Value () is set for key=ocrconfig_loc3
    2009-12-23 19:24:32: Opening file OCRCONFIG
    2009-12-23 19:24:32: Value () is set for key=ocrconfig_loc4
    2009-12-23 19:24:32: Opening file OCRCONFIG
    2009-12-23 19:24:32: Value () is set for key=ocrconfig_loc5
    2009-12-23 19:24:32: Checking if OCR sync file exists
    2009-12-23 19:24:32: No need to sync OCR file
    2009-12-23 19:24:32: OCR_LOCATION=+SYSTEMDG
    2009-12-23 19:24:32: OCR_MIRROR_LOCATION=
    2009-12-23 19:24:32: OCR_MIRROR_LOC3=
    2009-12-23 19:24:32: OCR_MIRROR_LOC4=
    2009-12-23 19:24:32: OCR_MIRROR_LOC5=
    2009-12-23 19:24:32: Current OCR location=
    2009-12-23 19:24:32: Current OCR mirror location=
    2009-12-23 19:24:32: Current OCR mirror loc3=
    2009-12-23 19:24:32: Current OCR mirror loc4=
    2009-12-23 19:24:32: Current OCR mirror loc5=
    2009-12-23 19:24:32: Verifying current OCR settings with user entered values
    2009-12-23 19:24:32: Setting OCR locations in /etc/oracle/ocr.loc
    2009-12-23 19:24:32: Validating OCR locations in /etc/oracle/ocr.loc
    2009-12-23 19:24:32: Checking for existence of /etc/oracle/ocr.loc
    2009-12-23 19:24:32: Backing up /etc/oracle/ocr.loc to /etc/oracle/ocr.loc.orig
    2009-12-23 19:24:32: Setting ocr location +SYSTEMDG
    2009-12-23 19:24:32: Creating or upgrading Oracle Local Registry (OLR)
    2009-12-23 19:24:34: OLR successfully created or upgraded
    2009-12-23 19:24:34: /u01/app/grid/bin/clscfg -localadd
    2009-12-23 19:24:34: Keys created in the OLR successfully

    
    
    First Node Setup GPnP wallet and profile:

    2009-12-2319:24:34: GPnP setup state: none
    2009-12-23 19:24:34: Creating local GPnP setup for clustered node...
    2009-12-23 19:24:34: Oracle CRS home = /u01/app/grid
    2009-12-23 19:24:34: Oracle GPnP wallets home =/u01/app/grid/gpnp/racbde1/wallets
    2009-12-23 19:24:34: Checking if GPnP setup exists
    2009-12-23 19:24:34: /u01/app/grid/gpnp/racbde1/wallets/peer/cwallet.sso walletmust be created
    2009-12-23 19:24:34: Removing old wallets/certificates, if any
    2009-12-23 19:24:34: Creating GPnP Root Wallet...
    2009-12-23 19:24:34: /u01/app/grid/bin/orapki wallet create -wallet"/u01/app/grid/gpnp/racbde1/wallets/root" -pwd gpnp_wallet1 -nologo
    2009-12-23 19:24:35: Creating GPnP Root Certificate...
    2009-12-23 19:24:35: /u01/app/grid/bin/orapki wallet add -wallet"/u01/app/grid/gpnp/racbde1/wallets/root" -pwd gpnp_wallet1-self_signed -dn "CN=GPnP_root" -keysize 1024 -validity 9999 -nologo
    2009-12-23 19:24:37: Exporting GPnP Root Certificate...
    2009-12-23 19:24:37: /u01/app/grid/bin/orapki wallet export -wallet"/u01/app/grid/gpnp/racbde1/wallets/root" -pwd gpnp_wallet1 -dn"CN=GPnP_root" -cert"/u01/app/grid/gpnp/racbde1/wallets/root/b64certificate.txt" -nologo
    2009-12-23 19:24:38: Creating GPnP Peer Wallet...
    2009-12-23 19:24:38: /u01/app/grid/bin/orapki wallet create -wallet"/u01/app/grid/gpnp/racbde1/wallets/peer" -pwd gpnp_wallet1-auto_login -nologo
    2009-12-23 19:24:38: Creating GPnP Profile Reader Wallet...
    2009-12-23 19:24:38: /u01/app/grid/bin/orapki wallet create -wallet"/u01/app/grid/gpnp/racbde1/wallets/prdr" -pwd gpnp_wallet1-auto_login -nologo
    2009-12-23 19:24:39: Creating GPnP PA Wallet...
    2009-12-23 19:24:39: /u01/app/grid/bin/orapki wallet create -wallet"/u01/app/grid/gpnp/racbde1/wallets/pa" -pwd gpnp_wallet1 -auto_login-nologo
    2009-12-23 19:24:40: Adding private key to GPnP Peer Wallet...
    2009-12-23 19:24:40: /u01/app/grid/bin/orapki wallet add -wallet"/u01/app/grid/gpnp/racbde1/wallets/peer" -pwd gpnp_wallet1 -dn"CN=GPnP_peer" -keysize 1024 -nologo
    2009-12-23 19:24:41: Adding private key to GPnP PA Wallet...
    2009-12-23 19:24:41: /u01/app/grid/bin/orapki wallet add -wallet"/u01/app/grid/gpnp/racbde1/wallets/pa" -pwd gpnp_wallet1 -dn"CN=GPnP_pa" -keysize 1024 -nologo
    2009-12-23 19:24:42: Creating certificate request for GPnP Peer Wallet...
    2009-12-23 19:24:42: /u01/app/grid/bin/orapki wallet export -wallet"/u01/app/grid/gpnp/racbde1/wallets/peer" -pwd gpnp_wallet1 -dn"CN=GPnP_peer" -request"/u01/app/grid/gpnp/racbde1/wallets/peer/certreq.txt" -nologo
    2009-12-23 19:24:43: Creating certificate request for GPnP PA Wallet...
    2009-12-23 19:24:43: /u01/app/grid/bin/orapki wallet export -wallet"/u01/app/grid/gpnp/racbde1/wallets/pa" -pwd gpnp_wallet1 -dn"CN=GPnP_pa" -request"/u01/app/grid/gpnp/racbde1/wallets/pa/certreq.txt" -nologo
    2009-12-23 19:24:44: Creating certificate for GPnP Peer Wallet...
    2009-12-23 19:24:44: /u01/app/grid/bin/orapki cert create -wallet "/u01/app/grid/gpnp/racbde1/wallets/root"-pwd gpnp_wallet1 -request"/u01/app/grid/gpnp/racbde1/wallets/peer/certreq.txt" -cert"/u01/app/grid/gpnp/racbde1/wallets/peer/cert.txt" -validity 9999-nologo
    2009-12-23 19:24:45: Creating certificate for GPnP PA Wallet...
    2009-12-23 19:24:45: /u01/app/grid/bin/orapki cert create -wallet"/u01/app/grid/gpnp/racbde1/wallets/root" -pwd gpnp_wallet1 -request"/u01/app/grid/gpnp/racbde1/wallets/pa/certreq.txt" -cert"/u01/app/grid/gpnp/racbde1/wallets/pa/cert.txt" -validity 9999-nologo
    2009-12-23 19:24:46: Adding Root Certificate TP to GPnP Peer Wallet...
    2009-12-23 19:24:46: /u01/app/grid/bin/orapki wallet add -wallet"/u01/app/grid/gpnp/racbde1/wallets/peer" -pwd gpnp_wallet1-trusted_cert -cert "/u01/app/grid/gpnp/racbde1/wallets/root/b64certificate.txt"-nologo
    2009-12-23 19:24:47: Adding Root Certificate TP to GPnP Profile ReaderWallet...
    2009-12-23 19:24:47: /u01/app/grid/bin/orapki wallet add -wallet"/u01/app/grid/gpnp/racbde1/wallets/prdr" -pwd gpnp_wallet1 -trusted_cert-cert "/u01/app/grid/gpnp/racbde1/wallets/root/b64certificate.txt"-nologo
    2009-12-23 19:24:48: Adding Root Certificate TP to GPnP PA Wallet...
    2009-12-23 19:24:48: /u01/app/grid/bin/orapki wallet add -wallet"/u01/app/grid/gpnp/racbde1/wallets/pa" -pwd gpnp_wallet1-trusted_cert -cert"/u01/app/grid/gpnp/racbde1/wallets/root/b64certificate.txt" -nologo
    2009-12-23 19:24:49: Adding PA Certificate as a TP into a GPnP Peer Wallet...
    2009-12-23 19:24:49: /u01/app/grid/bin/orapki wallet add -wallet "/u01/app/grid/gpnp/racbde1/wallets/peer"-pwd gpnp_wallet1 -trusted_cert -cert"/u01/app/grid/gpnp/racbde1/wallets/pa/cert.txt" -nologo
    2009-12-23 19:24:50: Adding peer Certificate as a TP into a GPnP PA Wallet...
    2009-12-23 19:24:50: /u01/app/grid/bin/orapki wallet add -wallet"/u01/app/grid/gpnp/racbde1/wallets/pa" -pwd gpnp_wallet1-trusted_cert -cert"/u01/app/grid/gpnp/racbde1/wallets/peer/cert.txt" -nologo
    2009-12-23 19:24:51: Adding PA Certificate as a TP into a GPnP Profile ReaderWallet...
    2009-12-23 19:24:51: /u01/app/grid/bin/orapki wallet add -wallet"/u01/app/grid/gpnp/racbde1/wallets/prdr" -pwd gpnp_wallet1-trusted_cert -cert "/u01/app/grid/gpnp/racbde1/wallets/pa/cert.txt"-nologo
    2009-12-23 19:24:52: Adding peer Certificate as a TP into a GPnP Profile ReaderWallet...
    2009-12-23 19:24:52: /u01/app/grid/bin/orapki wallet add -wallet"/u01/app/grid/gpnp/racbde1/wallets/prdr" -pwd gpnp_wallet1-trusted_cert -cert"/u01/app/grid/gpnp/racbde1/wallets/peer/cert.txt" -nologo
    2009-12-23 19:24:53: Adding PA Certificate as a TP into a GPnP Peer Wallet...
    2009-12-23 19:24:53: /u01/app/grid/bin/orapki wallet add -wallet"/u01/app/grid/gpnp/racbde1/wallets/peer" -pwd gpnp_wallet1-user_cert -cert "/u01/app/grid/gpnp/racbde1/wallets/peer/cert.txt"-nologo
    2009-12-23 19:24:54: Adding peer Certificate as a TP into a GPnP PA Wallet...
    2009-12-23 19:24:54: /u01/app/grid/bin/orapki wallet add -wallet"/u01/app/grid/gpnp/racbde1/wallets/pa" -pwd gpnp_wallet1 -user_cert-cert "/u01/app/grid/gpnp/racbde1/wallets/pa/cert.txt" -nologo
    2009-12-23 19:24:55: GPnP Wallets ownership/permissions successfully set.
    2009-12-23 19:24:55: GPnP Wallets successfully created.
    2009-12-23 19:24:55: <--- GPnP wallets successfully created
    2009-12-23 19:24:55: Creating GPnP peer profile --->
    2009-12-23 19:24:55: Oracle CRS home = /u01/app/grid
    2009-12-23 19:24:55: Oracle GPnP profiles home =/u01/app/grid/gpnp/racbde1/profiles
    2009-12-23 19:24:55: Oracle GPnP profiles parameters:
    2009-12-23 19:24:55: paloc==
    2009-12-23 19:24:55: cname=racbde-scan=
    2009-12-23 19:24:55: cssdisco==
    2009-12-23 19:24:55: cssld=400=
    2009-12-23 19:24:55: asmdisco=/dev/sdb*=
    2009-12-23 19:24:55: asmspf==
    2009-12-23 19:24:55: netlst="eth1"/10.141.154.0:public,"eth0"/192.168.0.0:cluster_interconnect=
    2009-12-23 19:24:55: ocrid==
    2009-12-23 19:24:55: clusterguid==
    2009-12-23 19:24:55: Checking if GPnP setup exists
    2009-12-23 19:24:55: /u01/app/grid/gpnp/racbde1/profiles/peer/profile.xmlprofile must be created
    2009-12-23 19:24:55: OCRID is not available, hence not set in GPnP Profile
    2009-12-23 19:24:55: ClusterGUID is not available, hence not set in GPnPProfile
    2009-12-23 19:24:55: gpnptool: run /u01/app/grid/bin/gpnptool create-o="/u01/app/grid/gpnp/racbde1/profiles/peer/profile.xml" -ovr -prf-prf_sq=1 -prf_cn=racbde-scan -prf_pa="" -hnet=gen-gen:hnet_nm="*" -gen:net=net1 -net1:net_ip="10.141.154.0"-net1:net_ada="eth1" -net1:net_use="public" -gen:net=net2-net2:net_ip="192.168.0.0" -net2:net_ada="eth0"-net2:net_use="cluster_interconnect" -css=css-css:css_dis="" -css:css_ld=400 -asm=asm-asm:asm_dis="/dev/sdb*" -asm:asm_spf=""
    2009-12-23 19:24:55: Running as user oracle: /u01/app/grid/bin/gpnptool create-o="/u01/app/grid/gpnp/racbde1/profiles/peer/profile.xml" -ovr -prf-prf_sq=1 -prf_cn=racbde-scan -prf_pa="" -hnet=gen-gen:hnet_nm="*" -gen:net=net1 -net1:net_ip="10.141.154.0"-net1:net_ada="eth1" -net1:net_use="public" -gen:net=net2-net2:net_ip="192.168.0.0" -net2:net_ada="eth0"-net2:net_use="cluster_interconnect" -css=css -css:css_dis=""-css:css_ld=400 -asm=asm -asm:asm_dis="/dev/sdb*"-asm:asm_spf=""
    2009-12-23 19:24:55: s_run_as_user2: Running /bin/su oracle -c '/u01/app/grid/bin/gpnptool create-o="/u01/app/grid/gpnp/racbde1/profiles/peer/profile.xml" -ovr -prf-prf_sq=1 -prf_cn=racbde-scan -prf_pa="" -hnet=gen-gen:hnet_nm="*" -gen:net=net1 -net1:net_ip="10.141.154.0"-net1:net_ada="eth1" -net1:net_use="public" -gen:net=net2-net2:net_ip="192.168.0.0" -net2:net_ada="eth0"-net2:net_use="cluster_interconnect" -css=css-css:css_dis="" -css:css_ld=400 -asm=asm-asm:asm_dis="/dev/sdb*" -asm:asm_spf="" '
    2009-12-23 19:24:55: Removing file /tmp/fileDple0c
    2009-12-23 19:24:55: Successfully removed file: /tmp/fileDple0c
    2009-12-23 19:24:55: /bin/su successfully executed
    
    2009-12-23 19:24:55: gpnptool: rc=0
    2009-12-23 19:24:55: gpnptool output:
    Resulting profile written to"/u01/app/grid/gpnp/racbde1/profiles/peer/profile.xml".
    Success.
    
    2009-12-23 19:24:55: gpnptool: run /u01/app/grid/bin/gpnptool sign-p="/u01/app/grid/gpnp/racbde1/profiles/peer/profile.xml"-o="/u01/app/grid/gpnp/racbde1/profiles/peer/profile.xml" -ovr-w="file:/u01/app/grid/gpnp/racbde1/wallets/peer" -rmws
    2009-12-23 19:24:55: Running as user oracle: /u01/app/grid/bin/gpnptool sign-p="/u01/app/grid/gpnp/racbde1/profiles/peer/profile.xml"-o="/u01/app/grid/gpnp/racbde1/profiles/peer/profile.xml" -ovr-w="file:/u01/app/grid/gpnp/racbde1/wallets/peer" -rmws
    2009-12-23 19:24:55: s_run_as_user2: Running /bin/su oracle -c '/u01/app/grid/bin/gpnptool sign -p="/u01/app/grid/gpnp/racbde1/profiles/peer/profile.xml"-o="/u01/app/grid/gpnp/racbde1/profiles/peer/profile.xml" -ovr-w="file:/u01/app/grid/gpnp/racbde1/wallets/peer" -rmws '
    2009-12-23 19:24:55: Removing file /tmp/fileWLaWwU
    2009-12-23 19:24:55: Successfully removed file: /tmp/fileWLaWwU
    2009-12-23 19:24:55: /bin/su successfully executed
    
    2009-12-23 19:24:55: gpnptool: rc=0
    2009-12-23 19:24:55: gpnptool output:
    Resulting profile written to"/u01/app/grid/gpnp/racbde1/profiles/peer/profile.xml".
    Success.
    
    2009-12-23 19:24:55: GPnP peer profile create successfully completed.
    2009-12-23 19:24:55: <--- GPnP peer profile successfully created
    2009-12-23 19:24:55: GPnP local setup successfully created

    
    
    First Node Setup and copy files for OHASD daemon:

    2009-12-2319:24:55: Registering ohasd
    2009-12-23 19:24:55: init file = /u01/app/grid/crs/init/init.ohasd
    2009-12-23 19:24:55: Copying file /u01/app/grid/crs/init/init.ohasd to/etc/init.d directory
    2009-12-23 19:24:55: Setting init.ohasd permission in /etc/init.d directory
    2009-12-23 19:24:55: init file = /u01/app/grid/crs/init/ohasd
    2009-12-23 19:24:55: Copying file /u01/app/grid/crs/init/ohasd to /etc/init.ddirectory
    2009-12-23 19:24:55: Setting ohasd permission in /etc/init.d directory
    2009-12-23 19:24:55: Removing "/etc/rc.d/rc3.d/S96ohasd"
    2009-12-23 19:24:55: Removing file /etc/rc.d/rc3.d/S96ohasd
    2009-12-23 19:24:55: Failure with return code 1 from command rm/etc/rc.d/rc3.d/S96ohasd
    2009-12-23 19:24:55: Failed to remove file:
    2009-12-23 19:24:55: Creating a link "/etc/rc.d/rc3.d/S96ohasd"pointing to /etc/init.d/ohasd
    2009-12-23 19:24:55: Removing "/etc/rc.d/rc5.d/S96ohasd"
    2009-12-23 19:24:55: Removing file /etc/rc.d/rc5.d/S96ohasd
    2009-12-23 19:24:55: Failure with return code 1 from command rm/etc/rc.d/rc5.d/S96ohasd
    2009-12-23 19:24:55: Failed to remove file:
    2009-12-23 19:24:55: Creating a link "/etc/rc.d/rc5.d/S96ohasd"pointing to /etc/init.d/ohasd
    2009-12-23 19:24:55: Removing "/etc/rc.d/rc0.d/K19ohasd"
    2009-12-23 19:24:55: Removing file /etc/rc.d/rc0.d/K19ohasd
    2009-12-23 19:24:55: Failure with return code 1 from command rm/etc/rc.d/rc0.d/K19ohasd
    2009-12-23 19:24:55: Failed to remove file:
    2009-12-23 19:24:55: Creating a link "/etc/rc.d/rc0.d/K19ohasd"pointing to /etc/init.d/ohasd
    2009-12-23 19:24:55: Removing "/etc/rc.d/rc1.d/K19ohasd"
    2009-12-23 19:24:55: Removing file /etc/rc.d/rc1.d/K19ohasd
    2009-12-23 19:24:55: Failure with return code 1 from command rm/etc/rc.d/rc1.d/K19ohasd
    2009-12-23 19:24:55: Failed to remove file:
    2009-12-23 19:24:55: Creating a link "/etc/rc.d/rc1.d/K19ohasd"pointing to /etc/init.d/ohasd
    2009-12-23 19:24:55: Removing "/etc/rc.d/rc2.d/K19ohasd"
    2009-12-23 19:24:55: Removing file /etc/rc.d/rc2.d/K19ohasd
    2009-12-23 19:24:55: Failure with return code 1 from command rm/etc/rc.d/rc2.d/K19ohasd
    2009-12-23 19:24:55: Failed to remove file:
    2009-12-23 19:24:55: Creating a link "/etc/rc.d/rc2.d/K19ohasd"pointing to /etc/init.d/ohasd
    2009-12-23 19:24:55: Removing "/etc/rc.d/rc4.d/K19ohasd"
    2009-12-23 19:24:55: Removing file /etc/rc.d/rc4.d/K19ohasd
    2009-12-23 19:24:56: Failure with return code 1 from command rm/etc/rc.d/rc4.d/K19ohasd
    2009-12-23 19:24:56: Failed to remove file:
    2009-12-23 19:24:56: Creating a link "/etc/rc.d/rc4.d/K19ohasd"pointing to /etc/init.d/ohasd
    2009-12-23 19:24:56: Removing "/etc/rc.d/rc6.d/K19ohasd"
    2009-12-23 19:24:56: Removing file /etc/rc.d/rc6.d/K19ohasd
    2009-12-23 19:24:56: Failure with return code 1 from command rm/etc/rc.d/rc6.d/K19ohasd
    2009-12-23 19:24:56: Failed to remove file:
    2009-12-23 19:24:56: Creating a link "/etc/rc.d/rc6.d/K19ohasd"pointing to /etc/init.d/ohasd
    2009-12-23 19:24:56: The file ohasd has been successfully linked to the RCdirectories

    
    
    First Node Start OHASD Daemon:

    2009-12-2319:24:56: Starting ohasd
    2009-12-23 19:24:56: itab entries=
    2009-12-23 19:25:01: Created backup /etc/inittab.no_crs
    2009-12-23 19:25:01: Appending to /etc/inittab.tmp:
    2009-12-23 19:25:01: h1:35:respawn:/etc/init.d/init.ohasd run >/dev/null2>&1 </dev/null
    
    2009-12-23 19:25:01: Done updating /etc/inittab.tmp
    2009-12-23 19:25:01: Saved /etc/inittab.crs
    2009-12-23 19:25:01: Installed new /etc/inittab
    2009-12-23 19:25:06: ohasd is starting
    2009-12-23 19:25:06: Checking ohasd
    2009-12-23 19:25:06: ohasd started successfully

    
    
    First Node Copy required CRS resources for OHASD to start:

    2009-12-2319:25:06: Creating CRS resources and dependencies
    2009-12-23 19:25:06: Configuring HASD
    2009-12-23 19:25:06: Registering type ora.daemon.type
    2009-12-23 19:25:07: Registering type ora.mdns.type
    2009-12-23 19:25:07: Registering type ora.gpnp.type
    2009-12-23 19:25:07: Registering type ora.gipc.type
    2009-12-23 19:25:07: Registering type ora.cssd.type
    2009-12-23 19:25:08: Registering type ora.cssdmonitor.type
    2009-12-23 19:25:08: Registering type ora.crs.type
    2009-12-23 19:25:08: Registering type ora.evm.type
    2009-12-23 19:25:08: Registering type ora.ctss.type
    2009-12-23 19:25:08: Registering type ora.asm.type
    2009-12-23 19:25:09: Registering type ora.drivers.acfs.type
    2009-12-23 19:25:09: Registering type ora.diskmon.type
    2009-12-23 19:25:28: ADVM/ACFS is configured
    
    2009-12-23 19:25:28: Successfully created CRS resources for cluster daemon andASM
    2009-12-23 19:25:28: Checking if initial configuration has been performed

    
    
    First Node Start in Exclusive Mode and Configure Diskgroup:

    2009-12-2319:25:28: Starting CSS in exclusive mode
    2009-12-23 19:25:55: CRS-2672: Attempting to start 'ora.gipcd' on 'racbde1'
    2009-12-23 19:25:55: CRS-2672: Attempting to start 'ora.mdnsd' on 'racbde1'
    2009-12-23 19:25:55: CRS-2676: Start of 'ora.gipcd' on 'racbde1' succeeded
    2009-12-23 19:25:55: CRS-2676: Start of 'ora.mdnsd' on 'racbde1' succeeded
    2009-12-23 19:25:55: CRS-2672: Attempting to start 'ora.gpnpd' on 'racbde1'
    2009-12-23 19:25:55: CRS-2676: Start of 'ora.gpnpd' on 'racbde1' succeeded
    2009-12-23 19:25:55: CRS-2672: Attempting to start 'ora.cssdmonitor' on'racbde1'
    2009-12-23 19:25:55: CRS-2676: Start of 'ora.cssdmonitor' on 'racbde1'succeeded
    2009-12-23 19:25:55: CRS-2672: Attempting to start 'ora.cssd' on 'racbde1'
    2009-12-23 19:25:55: CRS-2672: Attempting to start 'ora.diskmon' on 'racbde1'
    2009-12-23 19:25:55: CRS-2676: Start of 'ora.diskmon' on 'racbde1' succeeded
    2009-12-23 19:25:55: CRS-2676: Start of 'ora.cssd' on 'racbde1' succeeded
    2009-12-23 19:25:55: Querying for existing CSS voting disks
    2009-12-23 19:25:55: Performing initial configuration for cluster
    2009-12-23 19:25:56: Start of resource "ora.ctssd -init" Succeeded
    2009-12-23 19:25:56: Configuring ASM via ASMCA
    2009-12-23 19:25:56: Executing as oracle: /u01/app/grid/bin/asmca -silent-diskGroupName SYSTEMDG -diskList /dev/sdb1,/dev/sdb2,/dev/sdb3 -redundancyNORMAL -diskString '/dev/sdb*' -configureLocalASM
    2009-12-23 19:25:56: Running as user oracle: /u01/app/grid/bin/asmca -silent-diskGroupName SYSTEMDG -diskList /dev/sdb1,/dev/sdb2,/dev/sdb3 -redundancyNORMAL -diskString '/dev/sdb*' -configureLocalASM
    2009-12-23 19:25:56: Invoking "/u01/app/grid/bin/asmca -silent-diskGroupName SYSTEMDG -diskList /dev/sdb1,/dev/sdb2,/dev/sdb3 -redundancyNORMAL -diskString '/dev/sdb*' -configureLocalASM" as user"oracle"
    2009-12-23 19:30:21: Creating or upgrading OCR keys
    2009-12-23 19:30:31: OCR keys are successfully populated
    2009-12-23 19:30:31: Invalidating repository location for Oracle 9i deployments
    2009-12-23 19:30:31: Executing clscfg
    2009-12-23 19:30:38: Oracle Cluster Registry initialization completed
    2009-12-23 19:30:40: Start of resource "ora.crsd -init" Succeeded
    2009-12-23 19:30:40: Creating voting files
    2009-12-23 19:30:40: Creating voting files in ASM diskgroup SYSTEMDG
    2009-12-23 19:30:40: Executing crsctl replace votedisk +SYSTEMDG

    
    First Node Push GPnP Profile to Remote Node(s):

    2009-12-2319:31:55: Promoting local gpnp setup to cluster-wide. Nodes {racbde1,racbde2}
    2009-12-23 19:31:55: Pushing local gpnpsetup to cluster nodes:{racbde1,racbde2}
    2009-12-23 19:31:55: /tmp/fileg6883M => /u01/app/grid/gpnp/manifest.txt
    2009-12-23 19:31:55: rmtcpy:/u01/app/grid/bin/cluutil -sourcefile /tmp/fileg6883M -destfile /u01/app/grid/gpnp/manifest.txt-nodelist racbde1,racbde2
    2009-12-23 19:31:55: Running as user oracle: /u01/app/grid/bin/cluutil-sourcefile /tmp/fileg6883M -destfile /u01/app/grid/gpnp/manifest.txt -nodelistracbde1,racbde2
    2009-12-23 19:31:55: s_run_as_user2: Running /bin/su oracle -c '/u01/app/grid/bin/cluutil -sourcefile /tmp/fileg6883M -destfile/u01/app/grid/gpnp/manifest.txt -nodelist racbde1,racbde2 '
    2009-12-23 19:31:56: Removing file /tmp/fileMlmyGF
    2009-12-23 19:31:56: Successfully removed file: /tmp/fileMlmyGF
    2009-12-23 19:31:56: /bin/su successfully executed
    
    2009-12-23 19:31:56: /u01/app/grid/gpnp/racbde1/profiles/peer/profile.xml => /u01/app/grid/gpnp/profiles/peer/profile.xml
    2009-12-23 19:31:56: rmtcpy:/u01/app/grid/bin/cluutil -sourcefile/u01/app/grid/gpnp/racbde1/profiles/peer/profile.xml -destfile/u01/app/grid/gpnp/profiles/peer/profile.xml -nodelist racbde1,racbde2
    2009-12-23 19:31:56: Running as user oracle: /u01/app/grid/bin/cluutil-sourcefile /u01/app/grid/gpnp/racbde1/profiles/peer/profile.xml -destfile/u01/app/grid/gpnp/profiles/peer/profile.xml -nodelist racbde1,racbde2
    2009-12-23 19:31:56: s_run_as_user2: Running /bin/su oracle -c '/u01/app/grid/bin/cluutil -sourcefile/u01/app/grid/gpnp/racbde1/profiles/peer/profile.xml -destfile/u01/app/grid/gpnp/profiles/peer/profile.xml -nodelist racbde1,racbde2 '
    2009-12-23 19:31:56: Removing file /tmp/filePm9QYA
    2009-12-23 19:31:56: Successfully removed file: /tmp/filePm9QYA
    2009-12-23 19:31:56: /bin/su successfully executed
    
    2009-12-23 19:31:56: /u01/app/grid/gpnp/racbde1/wallets/peer/cwallet.sso => /u01/app/grid/gpnp/wallets/peer/cwallet.sso
    2009-12-23 19:31:56: rmtcpy:/u01/app/grid/bin/cluutil -sourcefile/u01/app/grid/gpnp/racbde1/wallets/peer/cwallet.sso -destfile /u01/app/grid/gpnp/wallets/peer/cwallet.sso-nodelist racbde1,racbde2
    2009-12-23 19:31:56: Running as user oracle: /u01/app/grid/bin/cluutil-sourcefile /u01/app/grid/gpnp/racbde1/wallets/peer/cwallet.sso -destfile/u01/app/grid/gpnp/wallets/peer/cwallet.sso -nodelist racbde1,racbde2
    2009-12-23 19:31:56: s_run_as_user2: Running /bin/su oracle -c '/u01/app/grid/bin/cluutil -sourcefile/u01/app/grid/gpnp/racbde1/wallets/peer/cwallet.sso -destfile/u01/app/grid/gpnp/wallets/peer/cwallet.sso -nodelist racbde1,racbde2 '
    2009-12-23 19:31:57: Removing file /tmp/file2trrwx
    2009-12-23 19:31:57: Successfully removed file: /tmp/file2trrwx
    2009-12-23 19:31:57: /bin/su successfully executed
    
    2009-12-23 19:31:57: /u01/app/grid/gpnp/racbde1/profiles/peer/profile_orig.xml => /u01/app/grid/gpnp/profiles/peer/profile_orig.xml
    2009-12-23 19:31:57: rmtcpy:/u01/app/grid/bin/cluutil -sourcefile/u01/app/grid/gpnp/racbde1/profiles/peer/profile_orig.xml -destfile/u01/app/grid/gpnp/profiles/peer/profile_orig.xml -nodelist racbde1,racbde2
    2009-12-23 19:31:57: Running as user oracle: /u01/app/grid/bin/cluutil-sourcefile /u01/app/grid/gpnp/racbde1/profiles/peer/profile_orig.xml -destfile/u01/app/grid/gpnp/profiles/peer/profile_orig.xml -nodelist racbde1,racbde2
    2009-12-23 19:31:57: s_run_as_user2: Running /bin/su oracle -c '/u01/app/grid/bin/cluutil -sourcefile/u01/app/grid/gpnp/racbde1/profiles/peer/profile_orig.xml -destfile/u01/app/grid/gpnp/profiles/peer/profile_orig.xml -nodelist racbde1,racbde2 '
    2009-12-23 19:31:57: Removing file /tmp/fileZqRXjv
    2009-12-23 19:31:57: Successfully removed file: /tmp/fileZqRXjv
    2009-12-23 19:31:57: /bin/su successfully executed
    
    2009-12-23 19:31:57: /u01/app/grid/gpnp/racbde1/wallets/root/ewallet.p12 => /u01/app/grid/gpnp/wallets/root/ewallet.p12
    2009-12-23 19:31:57: rmtcpy:/u01/app/grid/bin/cluutil -sourcefile/u01/app/grid/gpnp/racbde1/wallets/root/ewallet.p12 -destfile/u01/app/grid/gpnp/wallets/root/ewallet.p12 -nodelist racbde1,racbde2
    2009-12-23 19:31:57: Running as user oracle: /u01/app/grid/bin/cluutil-sourcefile /u01/app/grid/gpnp/racbde1/wallets/root/ewallet.p12 -destfile/u01/app/grid/gpnp/wallets/root/ewallet.p12 -nodelist racbde1,racbde2
    2009-12-23 19:31:57: s_run_as_user2: Running /bin/su oracle -c '/u01/app/grid/bin/cluutil -sourcefile/u01/app/grid/gpnp/racbde1/wallets/root/ewallet.p12 -destfile/u01/app/grid/gpnp/wallets/root/ewallet.p12 -nodelist racbde1,racbde2 '
    2009-12-23 19:31:57: Removing file /tmp/filecX5Reu
    2009-12-23 19:31:57: Successfully removed file: /tmp/filecX5Reu
    2009-12-23 19:31:57: /bin/su successfully executed
    
    2009-12-23 19:31:57: /u01/app/grid/gpnp/racbde1/wallets/prdr/cwallet.sso => /u01/app/grid/gpnp/wallets/prdr/cwallet.sso
    2009-12-23 19:31:57: rmtcpy:/u01/app/grid/bin/cluutil -sourcefile/u01/app/grid/gpnp/racbde1/wallets/prdr/cwallet.sso -destfile/u01/app/grid/gpnp/wallets/prdr/cwallet.sso -nodelist racbde1,racbde2
    2009-12-23 19:31:57: Running as user oracle: /u01/app/grid/bin/cluutil-sourcefile /u01/app/grid/gpnp/racbde1/wallets/prdr/cwallet.sso -destfile/u01/app/grid/gpnp/wallets/prdr/cwallet.sso -nodelist racbde1,racbde2
    2009-12-23 19:31:57: s_run_as_user2: Running /bin/su oracle -c '/u01/app/grid/bin/cluutil -sourcefile/u01/app/grid/gpnp/racbde1/wallets/prdr/cwallet.sso -destfile/u01/app/grid/gpnp/wallets/prdr/cwallet.sso -nodelist racbde1,racbde2 '
    2009-12-23 19:31:58: Removing file /tmp/filejENXcu
    2009-12-23 19:31:58: Successfully removed file: /tmp/filejENXcu
    2009-12-23 19:31:58: /bin/su successfully executed
    
    2009-12-23 19:31:58: /u01/app/grid/gpnp/racbde1/wallets/pa/cwallet.sso => /u01/app/grid/gpnp/wallets/pa/cwallet.sso
    2009-12-23 19:31:58: rmtcpy:/u01/app/grid/bin/cluutil -sourcefile/u01/app/grid/gpnp/racbde1/wallets/pa/cwallet.sso -destfile/u01/app/grid/gpnp/wallets/pa/cwallet.sso -nodelist racbde1,racbde2
    2009-12-23 19:31:58: Running as user oracle: /u01/app/grid/bin/cluutil-sourcefile /u01/app/grid/gpnp/racbde1/wallets/pa/cwallet.sso -destfile/u01/app/grid/gpnp/wallets/pa/cwallet.sso -nodelist racbde1,racbde2
    2009-12-23 19:31:58: s_run_as_user2: Running /bin/su oracle -c '/u01/app/grid/bin/cluutil -sourcefile/u01/app/grid/gpnp/racbde1/wallets/pa/cwallet.sso -destfile/u01/app/grid/gpnp/wallets/pa/cwallet.sso -nodelist racbde1,racbde2 '
    2009-12-23 19:31:58: Removing file /tmp/filed8XZpv
    2009-12-23 19:31:58: Successfully removed file: /tmp/filed8XZpv
    2009-12-23 19:31:58: /bin/su successfully executed
    
    2009-12-23 19:31:58: /u01/app/grid/gpnp/racbde1/wallets/root/b64certificate.txt => /u01/app/grid/gpnp/wallets/root/b64certificate.txt
    2009-12-23 19:31:58: rmtcpy:/u01/app/grid/bin/cluutil -sourcefile/u01/app/grid/gpnp/racbde1/wallets/root/b64certificate.txt -destfile/u01/app/grid/gpnp/wallets/root/b64certificate.txt -nodelist racbde1,racbde2
    2009-12-23 19:31:58: Running as user oracle: /u01/app/grid/bin/cluutil-sourcefile /u01/app/grid/gpnp/racbde1/wallets/root/b64certificate.txt-destfile /u01/app/grid/gpnp/wallets/root/b64certificate.txt -nodelistracbde1,racbde2
    2009-12-23 19:31:58: s_run_as_user2: Running /bin/su oracle -c '/u01/app/grid/bin/cluutil -sourcefile/u01/app/grid/gpnp/racbde1/wallets/root/b64certificate.txt -destfile/u01/app/grid/gpnp/wallets/root/b64certificate.txt -nodelist racbde1,racbde2 '
    2009-12-23 19:31:59: Removing file /tmp/file2UPPUx
    2009-12-23 19:31:59: Successfully removed file: /tmp/file2UPPUx
    2009-12-23 19:31:59: /bin/su successfully executed
    
    2009-12-23 19:31:59: /u01/app/grid/gpnp/racbde1/wallets/peer/cert.txt => /u01/app/grid/gpnp/wallets/peer/cert.txt
    2009-12-23 19:31:59: rmtcpy:/u01/app/grid/bin/cluutil -sourcefile/u01/app/grid/gpnp/racbde1/wallets/peer/cert.txt -destfile/u01/app/grid/gpnp/wallets/peer/cert.txt -nodelist racbde1,racbde2
    2009-12-23 19:31:59: Running as user oracle: /u01/app/grid/bin/cluutil -sourcefile/u01/app/grid/gpnp/racbde1/wallets/peer/cert.txt -destfile/u01/app/grid/gpnp/wallets/peer/cert.txt -nodelist racbde1,racbde2
    2009-12-23 19:31:59: s_run_as_user2: Running /bin/su oracle -c '/u01/app/grid/bin/cluutil -sourcefile /u01/app/grid/gpnp/racbde1/wallets/peer/cert.txt-destfile /u01/app/grid/gpnp/wallets/peer/cert.txt -nodelist racbde1,racbde2 '
    2009-12-23 19:31:59: Removing file /tmp/fileRL2LFB
    2009-12-23 19:31:59: Successfully removed file: /tmp/fileRL2LFB
    2009-12-23 19:31:59: /bin/su successfully executed
    
    2009-12-23 19:31:59: /u01/app/grid/gpnp/racbde1/wallets/pa/cert.txt=> /u01/app/grid/gpnp/wallets/pa/cert.txt
    2009-12-23 19:31:59: rmtcpy:/u01/app/grid/bin/cluutil -sourcefile/u01/app/grid/gpnp/racbde1/wallets/pa/cert.txt -destfile/u01/app/grid/gpnp/wallets/pa/cert.txt -nodelist racbde1,racbde2
    2009-12-23 19:31:59: Running as user oracle: /u01/app/grid/bin/cluutil-sourcefile /u01/app/grid/gpnp/racbde1/wallets/pa/cert.txt -destfile/u01/app/grid/gpnp/wallets/pa/cert.txt -nodelist racbde1,racbde2
    2009-12-23 19:31:59: s_run_as_user2: Running /bin/su oracle -c '/u01/app/grid/bin/cluutil -sourcefile/u01/app/grid/gpnp/racbde1/wallets/pa/cert.txt -destfile/u01/app/grid/gpnp/wallets/pa/cert.txt -nodelist racbde1,racbde2 '
    2009-12-23 19:32:00: Removing file /tmp/fileWwdzFG
    2009-12-23 19:32:00: Successfully removed file: /tmp/fileWwdzFG
    2009-12-23 19:32:00: /bin/su successfully executed
    
    2009-12-23 19:32:00: Exiting exclusive mode

    
    
    First Node Start Full Clusterware Stack:

    2009-12-2319:32:39: Starting
    2009-12-23 19:32:40: Start of resource "ora.mdnsd -init" Succeeded
    2009-12-23 19:32:41: Start of resource "ora.gipcd -init" Succeeded
    2009-12-23 19:32:43: Start of resource "ora.gpnpd -init" Succeeded
    2009-12-23 19:32:43: Successfully started requested Oracle stack daemons
    2009-12-23 19:32:43: Starting CSS in clustered mode
    2009-12-23 19:34:26: CRS-2672: Attempting to start 'ora.cssdmonitor' on'racbde1'
    2009-12-23 19:34:26: CRS-2676: Start of 'ora.cssdmonitor' on 'racbde1' succeeded
    2009-12-23 19:34:26: CRS-2672: Attempting to start 'ora.cssd' on 'racbde1'
    2009-12-23 19:34:26: CRS-2672: Attempting to start 'ora.diskmon' on 'racbde1'
    2009-12-23 19:34:26: CRS-2676: Start of 'ora.diskmon' on 'racbde1' succeeded
    2009-12-23 19:34:26: CRS-2676: Start of 'ora.cssd' on 'racbde1' succeeded
    2009-12-23 19:34:27: Start of resource "ora.ctssd -init -envUSR_ORA_ENV=CTSS_REBOOT=TRUE" Succeeded
    2009-12-23 19:34:40: Start of resource "ora.asm -init" Succeeded
    2009-12-23 19:34:41: Start of resource "ora.crsd -init" Succeeded
    2009-12-23 19:34:42: Start of resource "ora.evmd -init" Succeeded
    2009-12-23 19:34:42: Successfully started Oracle clusterware stack
    2009-12-23 19:34:42: Waiting for Oracle CRSD and EVMD to start
    2009-12-23 19:34:48: Oracle CRS stack installed and running

    
    
    First Node Adding Clusterware Resources:

    2009-12-2319:34:48: Configuring node
    2009-12-23 19:34:48: adding nodeapps...
    2009-12-23 19:34:48: upgrade_opt=
    2009-12-23 19:34:48: nodevip=racbde1-vip/255.255.254.0/eth1
    2009-12-23 19:34:48: DHCP_flag=0
    2009-12-23 19:34:48: nodes_to_add=racbde1
    2009-12-23 19:34:48: add nodeapps for static IP
    2009-12-23 19:34:48: Running srvctl config nodeapps to detect if VIP exists
    2009-12-23 19:34:49: output=PRKO-2312 : GSD does not exist.
    PRKO-2331 : ONS daemon does not exist.
    PRKO-2339 : eONS daemon does not exist.
    
    2009-12-23 19:34:49: Invoking "/u01/app/grid/bin/srvctl add nodeapps -nracbde1 -A "racbde1-vip/255.255.254.0/eth1" "
    2009-12-23 19:34:49: trace file=/u01/app/grid/cfgtoollogs/crsconfig/srvmcfg0.log
    2009-12-23 19:35:16: add nodeapps -n racbde1 -A racbde1-vip/255.255.254.0/eth1on node=racbde1 ... passed
    2009-12-23 19:35:16: nodes_to_start=racbde1
    2009-12-23 19:35:16: Configuring first node
    2009-12-23 19:35:16: DHCP_flag=0
    2009-12-23 19:35:16: nodes_to_start=racbde1
    2009-12-23 19:35:17: check ASM exists done and ASM does not exist
    2009-12-23 19:35:17: Prior version ASM does not exist , Invoking add asm
    2009-12-23 19:35:17: Invoking "/u01/app/grid/bin/srvctl add asm"
    2009-12-23 19:35:17: tracefile=/u01/app/grid/cfgtoollogs/crsconfig/srvmcfg1.log
    2009-12-23 19:35:17: Running as user oracle: /u01/app/grid/bin/srvctl add asm
    2009-12-23 19:35:17: Invoking "/u01/app/grid/bin/srvctl addasm" as user "oracle"
    2009-12-23 19:35:24: add asm ... success
    2009-12-23 19:35:24: Adding ASM diskgroup resource
    2009-12-23 19:35:24: Running as user oracle: /u01/app/grid/bin/crsctl creatediskgroup SYSTEMDG
    2009-12-23 19:35:24: Invoking "/u01/app/grid/bin/crsctl creatediskgroup SYSTEMDG" as user "oracle"
    2009-12-23 19:35:26: create diskgroup SYSTEMDG ... success
    2009-12-23 19:35:26: Successfully created disk group resource
    2009-12-23 19:35:27: Invoking: /u01/app/grid/bin/crsctl add typeora.registry.acfs.type -basetype ora.local_resource.type -file /u01/app/grid/crs/template/registry.acfs.type
    2009-12-23 19:35:29: add ora.registry.acfs.type ... success
    2009-12-23 19:35:29: Invoking: /u01/app/grid/bin/crsctl add resourceora.registry.acfs -attr ACL='owner:root:rwx,pgrp:oinstall:r-x,other::r--' -typeora.registry.acfs.type -f
    2009-12-23 19:35:30: add resource ora.registry.acfs ... success
    2009-12-23 19:35:30: GNS is not to be configured - skipping
    2009-12-23 19:35:30: Invoking "/u01/app/grid/bin/srvctl add scan -nracbde-scan.us.oracle.com"
    2009-12-23 19:35:30: tracefile=/u01/app/grid/cfgtoollogs/crsconfig/srvmcfg2.log
    2009-12-23 19:35:35: add scan=racbde-scan.us.oracle.com ... success
    2009-12-23 19:35:35: Invoking "/u01/app/grid/bin/srvctl add scan_listener-p 1521"
    2009-12-23 19:35:35: trace file=/u01/app/grid/cfgtoollogs/crsconfig/srvmcfg3.log
    2009-12-23 19:35:35: Running as user oracle: /u01/app/grid/bin/srvctl addscan_listener -p 1521
    2009-12-23 19:35:35: Invoking "/u01/app/grid/bin/srvctl addscan_listener -p 1521" as user "oracle"
    2009-12-23 19:35:41: add scan listener ... success
    2009-12-23 19:35:41: Running as user oracle: /u01/app/grid/bin/srvctl add oc4j
    2009-12-23 19:35:41: Invoking "/u01/app/grid/bin/srvctl addoc4j" as user "oracle"
    2009-12-23 19:35:44: J2EE (OC4J) Container Resource Add ... passed ...
    2009-12-23 19:35:44: starting nodeapps...
    2009-12-23 19:35:44: DHCP_flag=0
    2009-12-23 19:35:44: nodes_to_start=racbde1
    2009-12-23 19:35:54: exit value of start nodeapps/vip is 0
    2009-12-23 19:35:54: GNS is not to be configured - skipping
    2009-12-23 19:35:54: Invoking "/u01/app/grid/bin/srvctl start scan"
    2009-12-23 19:35:54: tracefile=/u01/app/grid/cfgtoollogs/crsconfig/srvmcfg5.log
    2009-12-23 19:36:04: start scan ... success
    2009-12-23 19:36:04: Invoking "/u01/app/grid/bin/srvctl start scan_listener"
    2009-12-23 19:36:04: tracefile=/u01/app/grid/cfgtoollogs/crsconfig/srvmcfg6.log
    2009-12-23 19:36:04: Running as user oracle: /u01/app/grid/bin/srvctl startscan_listener
    2009-12-23 19:36:04: Invoking "/u01/app/grid/bin/srvctl startscan_listener" as user "oracle"
    2009-12-23 19:36:07: start scan listener ... success
    2009-12-23 19:36:07: Running as user oracle: /u01/app/grid/bin/srvctl disableoc4j
    2009-12-23 19:36:07: Invoking "/u01/app/grid/bin/srvctldisable oc4j" as user "oracle"
    2009-12-23 19:36:08: J2EE (OC4J) Container Resource Disable ... passed ...
    2009-12-23 19:36:08: starting acfs_registry...
    2009-12-23 19:36:08: nodes_to_start=racbde1
    2009-12-23 19:36:09: /u01/app/grid/bin/crsctl start res ora.registry.acfs -nracbde1 ... success
    2009-12-23 19:36:09: SRVCONFIG=/var/opt/oracle/srvConfig.loc
    2009-12-23 19:36:09: Oracle 92 configuration and SKGXN library does not exists
    2009-12-23 19:36:09: /u01/app/grid/bin/ocrconfig -local -manualbackup ...passed
    2009-12-23 19:36:09: Install cvuqdisk rpm on Linux...
    2009-12-23 19:36:09: New package to install is/u01/app/grid/cv/rpm/cvuqdisk-1.0.7-1.rpm
    2009-12-23 19:36:09: Invoking "/bin/rpm -q cvuqdisk" command
    2009-12-23 19:36:10: no existing cvuqdisk found
    2009-12-23 19:36:10: removing old rpm
    2009-12-23 19:36:10: installing/upgrading new rpm
    2009-12-23 19:36:11: Configure Oracle Grid Infrastructure for a Cluster ...succeeded

    
    
    Secondary Note Initial Setup (racbde2):

    2009-12-2319:33:41: The configuration parameter file /u01/app/grid/crs/install/crsconfig_paramsis valid
    2009-12-23 19:33:41: Checking for super user privileges
    2009-12-23 19:33:41: User has super user privileges
    2009-12-23 19:33:41: ### Printing the configuration values from files:
    2009-12-23 19:33:41: /u01/app/grid/crs/install/crsconfig_params
    2009-12-23 19:33:41: /u01/app/grid/crs/install/s_crsconfig_defs
    2009-12-23 19:33:41: ASM_DISCOVERY_STRING=/dev/sdb*
    2009-12-23 19:33:41: ASM_DISKS=/dev/sdb1,/dev/sdb2,/dev/sdb3
    2009-12-23 19:33:41: ASM_DISK_GROUP=SYSTEMDG
    2009-12-23 19:33:41: ASM_REDUNDANCY=NORMAL
    2009-12-23 19:33:41: ASM_SPFILE=
    2009-12-23 19:33:41: ASM_UPGRADE=false
    2009-12-23 19:33:41: CLSCFG_MISSCOUNT=
    2009-12-23 19:33:41: CLUSTER_GUID=
    2009-12-23 19:33:41: CLUSTER_NAME=racbde-scan
    2009-12-23 19:33:41: CRS_NODEVIPS='racbde1-vip/255.255.254.0/eth1,racbde2-vip/255.255.254.0/eth1'
    2009-12-23 19:33:41: CRS_STORAGE_OPTION=1
    2009-12-23 19:33:41: CSS_LEASEDURATION=400
    2009-12-23 19:33:41: DIRPREFIX=
    2009-12-23 19:33:41: DISABLE_OPROCD=0
    2009-12-23 19:33:41: EMBASEJAR_NAME=oemlt.jar
    2009-12-23 19:33:41: EWTJAR_NAME=ewt3.jar
    2009-12-23 19:33:41: EXTERNAL_ORACLE_BIN=/opt/oracle/bin
    2009-12-23 19:33:41: GNS_ADDR_LIST=
    2009-12-23 19:33:41: GNS_ALLOW_NET_LIST=
    2009-12-23 19:33:41: GNS_CONF=false
    2009-12-23 19:33:41: GNS_DENY_ITF_LIST=
    2009-12-23 19:33:41: GNS_DENY_NET_LIST=
    2009-12-23 19:33:41: GNS_DOMAIN_LIST=
    2009-12-23 19:33:41: GPNPCONFIGDIR=/u01/app/grid
    2009-12-23 19:33:41: GPNPGCONFIGDIR=/u01/app/grid
    2009-12-23 19:33:41: GPNP_PA=
    2009-12-23 19:33:41: HELPJAR_NAME=help4.jar
    2009-12-23 19:33:41: HOST_NAME_LIST=racbde1,racbde2
    2009-12-23 19:33:41: ID=/etc/init.d
    2009-12-23 19:33:41: INIT=/sbin/init
    2009-12-23 19:33:41: IT=/etc/inittab
    2009-12-23 19:33:41: JEWTJAR_NAME=jewt4.jar
    2009-12-23 19:33:41: JLIBDIR=/u01/app/grid/jlib
    2009-12-23 19:33:41: JREDIR=/u01/app/grid/jdk/jre/
    2009-12-23 19:33:41: LANGUAGE_ID=AMERICAN_AMERICA.AL32UTF8
    2009-12-23 19:33:41: MSGFILE=/var/adm/messages
    2009-12-23 19:33:41: NETCFGJAR_NAME=netcfg.jar
    2009-12-23 19:33:41: NETWORKS="eth1"/10.141.154.0:public,"eth0"/192.168.0.0:cluster_interconnect
    2009-12-23 19:33:41: NEW_HOST_NAME_LIST=
    2009-12-23 19:33:41:NEW_NODEVIPS='racbde1-vip/255.255.254.0/eth1,racbde2-vip/255.255.254.0/eth1'
    2009-12-23 19:33:41: NEW_NODE_NAME_LIST=
    2009-12-23 19:33:41: NEW_PRIVATE_NAME_LIST=
    2009-12-23 19:33:41: NODELIST=racbde1,racbde2
    2009-12-23 19:33:41: NODE_NAME_LIST=racbde1,racbde2
    2009-12-23 19:33:41: OCFS_CONFIG=
    2009-12-23 19:33:41: OCRCONFIG=/etc/oracle/ocr.loc
    2009-12-23 19:33:41: OCRCONFIGDIR=/etc/oracle
    2009-12-23 19:33:41: OCRID=
    2009-12-23 19:33:41: OCRLOC=ocr.loc
    2009-12-23 19:33:41: OCR_LOCATIONS=NO_VAL
    2009-12-23 19:33:41: OLASTGASPDIR=/etc/oracle/lastgasp
    2009-12-23 19:33:41: OLRCONFIG=/etc/oracle/olr.loc
    2009-12-23 19:33:41: OLRCONFIGDIR=/etc/oracle
    2009-12-23 19:33:41: OLRLOC=olr.loc
    2009-12-23 19:33:41: OPROCDCHECKDIR=/etc/oracle/oprocd/check
    2009-12-23 19:33:41: OPROCDDIR=/etc/oracle/oprocd
    2009-12-23 19:33:41: OPROCDFATALDIR=/etc/oracle/oprocd/fatal
    2009-12-23 19:33:41: OPROCDSTOPDIR=/etc/oracle/oprocd/stop
    2009-12-23 19:33:41: ORACLE_BASE=/u01/app/oracle
    2009-12-23 19:33:41: ORACLE_HOME=/u01/app/grid
    2009-12-23 19:33:41: ORACLE_OWNER=oracle
    2009-12-23 19:33:41: ORA_ASM_GROUP=oinstall
    2009-12-23 19:33:41: ORA_DBA_GROUP=oinstall
    2009-12-23 19:33:41: PRIVATE_NAME_LIST=
    2009-12-23 19:33:41: RCALLDIR=/etc/rc.d/rc0.d /etc/rc.d/rc1.d /etc/rc.d/rc2.d/etc/rc.d/rc3.d /etc/rc.d/rc4.d /etc/rc.d/rc5.d /etc/rc.d/rc6.d
    2009-12-23 19:33:41: RCKDIR=/etc/rc.d/rc0.d /etc/rc.d/rc1.d /etc/rc.d/rc2.d/etc/rc.d/rc4.d /etc/rc.d/rc6.d
    2009-12-23 19:33:41: RCSDIR=/etc/rc.d/rc3.d /etc/rc.d/rc5.d
    2009-12-23 19:33:41: RC_KILL=K19
    2009-12-23 19:33:41: RC_KILL_OLD=K96
    2009-12-23 19:33:41: RC_START=S96
    2009-12-23 19:33:41: SCAN_NAME=racbde-scan.us.oracle.com
    2009-12-23 19:33:41: SCAN_PORT=1521
    2009-12-23 19:33:41: SCRBASE=/etc/oracle/scls_scr
    2009-12-23 19:33:41: SHAREJAR_NAME=share.jar
    2009-12-23 19:33:41: SILENT=false
    2009-12-23 19:33:41: SO_EXT=so
    2009-12-23 19:33:41: SRVCFGLOC=srvConfig.loc
    2009-12-23 19:33:41: SRVCONFIG=/var/opt/oracle/srvConfig.loc
    2009-12-23 19:33:41: SRVCONFIGDIR=/var/opt/oracle
    2009-12-23 19:33:41: VNDR_CLUSTER=false
    2009-12-23 19:33:41: VOTING_DISKS=NO_VAL
    2009-12-23 19:33:41: ### Printing other configuration values ###
    2009-12-23 19:33:41: CLSCFG_EXTRA_PARMS=
    2009-12-23 19:33:41: CRSDelete=0
    2009-12-23 19:33:41: CRSPatch=0
    2009-12-23 19:33:41: DEBUG=
    2009-12-23 19:33:41: DOWNGRADE=
    2009-12-23 19:33:41: HAS_GROUP=oinstall
    2009-12-23 19:33:41: HAS_USER=root
    2009-12-23 19:33:41: HOST=racbde2
    2009-12-23 19:33:41: IS_SIHA=0
    2009-12-23 19:33:41: OLR_DIRECTORY=/u01/app/grid/cdata
    2009-12-23 19:33:41: OLR_LOCATION=/u01/app/grid/cdata/racbde2.olr
    2009-12-23 19:33:41: ORA_CRS_HOME=/u01/app/grid
    2009-12-23 19:33:41: SUPERUSER=root
    2009-12-23 19:33:41: UPGRADE=
    2009-12-23 19:33:41: VF_DISCOVERY_STRING=
    2009-12-23 19:33:41: addfile=/u01/app/grid/crs/install/crsconfig_addparams
    2009-12-23 19:33:41: crscfg_trace=1
    2009-12-23 19:33:41:crscfg_trace_file=/u01/app/grid/cfgtoollogs/crsconfig/rootcrs_racbde2.log
    2009-12-23 19:33:41: hosts=
    2009-12-23 19:33:41: oldcrshome=
    2009-12-23 19:33:41: oldcrsver=
    2009-12-23 19:33:41: osdfile=/u01/app/grid/crs/install/s_crsconfig_defs
    2009-12-23 19:33:41: parameters_valid=1
    2009-12-23 19:33:41: paramfile=/u01/app/grid/crs/install/crsconfig_params
    2009-12-23 19:33:41: platform_family=unix
    2009-12-23 19:33:41: srvctl_trc_suff=0
    2009-12-23 19:33:41: unlock_crshome=
    2009-12-23 19:33:41: user_is_superuser=1
    2009-12-23 19:33:41: ### Printing of configuration values complete ###
    2009-12-23 19:33:41: Oracle CRS stack is not configured yet
    2009-12-23 19:33:41: CRS is not yet configured. Hence, will proceed toconfigure CRS
    2009-12-23 19:33:41: Cluster-wide one-time actions... Done!
    2009-12-23 19:33:41: Oracle CRS home = /u01/app/grid
    2009-12-23 19:33:41: Host name = racbde2
    2009-12-23 19:33:41: CRS user = oracle
    2009-12-23 19:33:41: Oracle CRS home = /u01/app/grid
    2009-12-23 19:33:41: GPnP host = racbde2
    2009-12-23 19:33:41: Oracle GPnP home = /u01/app/grid/gpnp
    2009-12-23 19:33:41: Oracle GPnP local home = /u01/app/grid/gpnp/racbde2
    2009-12-23 19:33:41: GPnP directories verified.
    2009-12-23 19:33:41: Checking to see if Oracle CRS stack is already configured
    2009-12-23 19:33:41: Oracle CRS stack is not configured yet
    2009-12-23 19:33:41: ---Checking local gpnp setup...
    2009-12-23 19:33:41: The setup file"/u01/app/grid/gpnp/racbde2/profiles/peer/profile.xml" does not exist
    2009-12-23 19:33:41: The setup file"/u01/app/grid/gpnp/racbde2/wallets/peer/cwallet.sso" does not exist
    2009-12-23 19:33:41: The setup file "/u01/app/grid/gpnp/racbde2/wallets/prdr/cwallet.sso"does not exist
    2009-12-23 19:33:41: chk gpnphome /u01/app/grid/gpnp/racbde2: profile_ok 0wallet_ok 0 r/o_wallet_ok 0
    2009-12-23 19:33:41: chk gpnphome /u01/app/grid/gpnp/racbde2: INVALID (badprofile/wallet)

    
    
    Secondary Note Get GPnP Profile:

    2009-12-2319:33:41: ---Checking cluster-wide gpnp setup...
    2009-12-23 19:33:41: chk gpnphome /u01/app/grid/gpnp: profile_ok 1 wallet_ok 1r/o_wallet_ok 1
    2009-12-23 19:33:41: gpnptool: run /u01/app/grid/bin/gpnptool verify-p="/u01/app/grid/gpnp/profiles/peer/profile.xml"-w="file:/u01/app/grid/gpnp/wallets/peer" -wu=peer
    2009-12-23 19:33:41: Running as user oracle: /u01/app/grid/bin/gpnptool verify-p="/u01/app/grid/gpnp/profiles/peer/profile.xml"-w="file:/u01/app/grid/gpnp/wallets/peer" -wu=peer
    2009-12-23 19:33:41: s_run_as_user2: Running /bin/su oracle -c '/u01/app/grid/bin/gpnptool verify-p="/u01/app/grid/gpnp/profiles/peer/profile.xml"-w="file:/u01/app/grid/gpnp/wallets/peer" -wu=peer '
    2009-12-23 19:33:43: Removing file /tmp/file1cIHO0
    2009-12-23 19:33:43: Successfully removed file: /tmp/file1cIHO0
    2009-12-23 19:33:43: /bin/su successfully executed
    
    2009-12-23 19:33:43: gpnptool: rc=0
    2009-12-23 19:33:43: gpnptool output:
    Profile signature is valid.
    
    2009-12-23 19:33:43: Profile"/u01/app/grid/gpnp/profiles/peer/profile.xml" signature is VALID forwallet "file:/u01/app/grid/gpnp/wallets/peer"
    2009-12-23 19:33:43: gpnptool: run /u01/app/grid/bin/gpnptool verify-p="/u01/app/grid/gpnp/profiles/peer/profile.xml" -w="file:/u01/app/grid/gpnp/wallets/prdr"-wu=peer
    2009-12-23 19:33:43: Running as user oracle: /u01/app/grid/bin/gpnptool verify-p="/u01/app/grid/gpnp/profiles/peer/profile.xml"-w="file:/u01/app/grid/gpnp/wallets/prdr" -wu=peer
    2009-12-23 19:33:43: s_run_as_user2: Running /bin/su oracle -c '/u01/app/grid/bin/gpnptool verify-p="/u01/app/grid/gpnp/profiles/peer/profile.xml"-w="file:/u01/app/grid/gpnp/wallets/prdr" -wu=peer '
    2009-12-23 19:33:43: Removing file /tmp/filev2P2aX
    2009-12-23 19:33:43: Successfully removed file: /tmp/filev2P2aX
    2009-12-23 19:33:43: /bin/su successfully executed
    
    2009-12-23 19:33:43: gpnptool: rc=0
    2009-12-23 19:33:43: gpnptool output:
    Profile signature is valid.
    
    2009-12-23 19:33:43: Profile "/u01/app/grid/gpnp/profiles/peer/profile.xml"signature is VALID for wallet "file:/u01/app/grid/gpnp/wallets/prdr"
    2009-12-23 19:33:43: chk gpnphome /u01/app/grid/gpnp: OK
    2009-12-23 19:33:43: GPnP Wallets ownership/permissions successfully set.
    2009-12-23 19:33:43: gpnp setup checked: local valid? 0 cluster-wide valid? 1
    2009-12-23 19:33:43: Taking cluster-wide setup as local
    2009-12-23 19:33:43: copy"/u01/app/grid/gpnp/profiles/peer/profile.xml" =>"/u01/app/grid/gpnp/racbde2/profiles/peer/profile.xml"
    2009-12-23 19:33:43: set ownership on"/u01/app/grid/gpnp/racbde2/profiles/peer/profile.xml" =>(oracle,oinstall)
    2009-12-23 19:33:43: copy"/u01/app/grid/gpnp/wallets/peer/cwallet.sso" =>"/u01/app/grid/gpnp/racbde2/wallets/peer/cwallet.sso"
    2009-12-23 19:33:43: set ownership on "/u01/app/grid/gpnp/racbde2/wallets/peer/cwallet.sso"=> (oracle,oinstall)
    2009-12-23 19:33:43: copy"/u01/app/grid/gpnp/wallets/prdr/cwallet.sso" =>"/u01/app/grid/gpnp/racbde2/wallets/prdr/cwallet.sso"
    2009-12-23 19:33:43: set ownership on "/u01/app/grid/gpnp/racbde2/wallets/prdr/cwallet.sso"=> (oracle,oinstall)
    2009-12-23 19:33:43: copy"/u01/app/grid/gpnp/profiles/peer/profile_orig.xml" =>"/u01/app/grid/gpnp/racbde2/profiles/peer/profile_orig.xml"
    2009-12-23 19:33:43: set ownership on "/u01/app/grid/gpnp/racbde2/profiles/peer/profile_orig.xml"=> (oracle,oinstall)
    2009-12-23 19:33:43: copy"/u01/app/grid/gpnp/wallets/root/ewallet.p12" =>"/u01/app/grid/gpnp/racbde2/wallets/root/ewallet.p12"
    2009-12-23 19:33:43: set ownership on "/u01/app/grid/gpnp/racbde2/wallets/root/ewallet.p12"=> (oracle,oinstall)
    2009-12-23 19:33:43: copy"/u01/app/grid/gpnp/wallets/pa/cwallet.sso" =>"/u01/app/grid/gpnp/racbde2/wallets/pa/cwallet.sso"
    2009-12-23 19:33:43: set ownership on"/u01/app/grid/gpnp/racbde2/wallets/pa/cwallet.sso" =>(oracle,oinstall)
    2009-12-23 19:33:43: copy"/u01/app/grid/gpnp/wallets/root/b64certificate.txt" =>"/u01/app/grid/gpnp/racbde2/wallets/root/b64certificate.txt"
    2009-12-23 19:33:43: set ownership on"/u01/app/grid/gpnp/racbde2/wallets/root/b64certificate.txt" =>(oracle,oinstall)
    2009-12-23 19:33:43: copy"/u01/app/grid/gpnp/wallets/peer/cert.txt" =>"/u01/app/grid/gpnp/racbde2/wallets/peer/cert.txt"
    2009-12-23 19:33:43: set ownership on"/u01/app/grid/gpnp/racbde2/wallets/peer/cert.txt" =>(oracle,oinstall)
    2009-12-23 19:33:43: copy"/u01/app/grid/gpnp/wallets/pa/cert.txt" =>"/u01/app/grid/gpnp/racbde2/wallets/pa/cert.txt"
    2009-12-23 19:33:43: set ownership on"/u01/app/grid/gpnp/racbde2/wallets/pa/cert.txt" => (oracle,oinstall)
    2009-12-23 19:33:43: GPnP Wallets ownership/permissions successfully set.
    2009-12-23 19:33:43: gpnp setup: GOTCLUSTERWIDE
    2009-12-23 19:33:43: Validating for SI-CSS configuration

    
    
    Secondary Node Setup OLR for storing Oracle local registry data:

    2009-12-2319:33:43: Retrieving OCR main disk location
    2009-12-23 19:33:43: Opening file OCRCONFIG
    2009-12-23 19:33:43: Value () is set for key=ocrconfig_loc
    2009-12-23 19:33:43: Unable to retrieve ocr disk info
    2009-12-23 19:33:43: Checking to see if any 9i GSD is up
    2009-12-23 19:33:43: libskgxnBase_lib = /etc/ORCLcluster/oracm/lib/libskgxn2.so
    2009-12-23 19:33:43: libskgxn_lib = /opt/ORCLcluster/lib/libskgxn2.so
    2009-12-23 19:33:43: SKGXN library file does not exists
    2009-12-23 19:33:43: OLR location = /u01/app/grid/cdata/racbde2.olr
    2009-12-23 19:33:43: Oracle CRS Home = /u01/app/grid
    2009-12-23 19:33:43: Validating /etc/oracle/olr.loc file for OLR location/u01/app/grid/cdata/racbde2.olr
    2009-12-23 19:33:43: /etc/oracle/olr.loc already exists. Backing up /etc/oracle/olr.locto /etc/oracle/olr.loc.orig
    2009-12-23 19:33:43: Oracle CRS home = /u01/app/grid
    2009-12-23 19:33:43: Oracle cluster name = racbde-scan
    2009-12-23 19:33:43: OCR locations = +SYSTEMDG
    2009-12-23 19:33:43: Validating OCR
    2009-12-23 19:33:43: Retrieving OCR location used by previous installations
    2009-12-23 19:33:43: Opening file OCRCONFIG
    2009-12-23 19:33:43: Value () is set for key=ocrconfig_loc
    2009-12-23 19:33:43: Opening file OCRCONFIG
    2009-12-23 19:33:43: Value () is set for key=ocrmirrorconfig_loc
    2009-12-23 19:33:43: Opening file OCRCONFIG
    2009-12-23 19:33:43: Value () is set for key=ocrconfig_loc3
    2009-12-23 19:33:43: Opening file OCRCONFIG
    2009-12-23 19:33:43: Value () is set for key=ocrconfig_loc4
    2009-12-23 19:33:43: Opening file OCRCONFIG
    2009-12-23 19:33:43: Value () is set for key=ocrconfig_loc5
    2009-12-23 19:33:43: Checking if OCR sync file exists
    2009-12-23 19:33:43: No need to sync OCR file
    2009-12-23 19:33:43: OCR_LOCATION=+SYSTEMDG
    2009-12-23 19:33:43: OCR_MIRROR_LOCATION=
    2009-12-23 19:33:43: OCR_MIRROR_LOC3=
    2009-12-23 19:33:43: OCR_MIRROR_LOC4=
    2009-12-23 19:33:43: OCR_MIRROR_LOC5=
    2009-12-23 19:33:43: Current OCR location=
    2009-12-23 19:33:43: Current OCR mirror location=
    2009-12-23 19:33:43: Current OCR mirror loc3=
    2009-12-23 19:33:43: Current OCR mirror loc4=
    2009-12-23 19:33:43: Current OCR mirror loc5=
    2009-12-23 19:33:43: Verifying current OCR settings with user entered values
    2009-12-23 19:33:43: Setting OCR locations in /etc/oracle/ocr.loc
    2009-12-23 19:33:43: Validating OCR locations in /etc/oracle/ocr.loc
    2009-12-23 19:33:43: Checking for existence of /etc/oracle/ocr.loc
    2009-12-23 19:33:43: Backing up /etc/oracle/ocr.loc to /etc/oracle/ocr.loc.orig
    2009-12-23 19:33:43: Setting ocr location +SYSTEMDG
    2009-12-23 19:33:43: Creating or upgrading Oracle Local Registry (OLR)
    2009-12-23 19:33:43: OLR successfully created or upgraded
    2009-12-23 19:33:43: /u01/app/grid/bin/clscfg -localadd
    2009-12-23 19:33:43: Keys created in the OLR successfully
    2009-12-23 19:33:44: GPnP setup state: new-cluster-wide
    2009-12-23 19:33:44: GPnP cluster configuration already performed

    
    
    Secondary Node Setup and copy files for OHASD daemon:

    2009-12-2319:33:44: Registering ohasd
    2009-12-23 19:33:44: init file = /u01/app/grid/crs/init/init.ohasd
    2009-12-23 19:33:44: Copying file /u01/app/grid/crs/init/init.ohasd to/etc/init.d directory
    2009-12-23 19:33:44: Setting init.ohasd permission in /etc/init.d directory
    2009-12-23 19:33:44: init file = /u01/app/grid/crs/init/ohasd
    2009-12-23 19:33:44: Copying file /u01/app/grid/crs/init/ohasd to /etc/init.ddirectory
    2009-12-23 19:33:44: Setting ohasd permission in /etc/init.d directory
    2009-12-23 19:33:44: Removing "/etc/rc.d/rc3.d/S96ohasd"
    2009-12-23 19:33:44: Removing file /etc/rc.d/rc3.d/S96ohasd
    2009-12-23 19:33:44: Failure with return code 1 from command rm/etc/rc.d/rc3.d/S96ohasd
    2009-12-23 19:33:44: Failed to remove file:
    2009-12-23 19:33:44: Creating a link "/etc/rc.d/rc3.d/S96ohasd"pointing to /etc/init.d/ohasd
    2009-12-23 19:33:44: Removing "/etc/rc.d/rc5.d/S96ohasd"
    2009-12-23 19:33:44: Removing file /etc/rc.d/rc5.d/S96ohasd
    2009-12-23 19:33:44: Failure with return code 1 from command rm/etc/rc.d/rc5.d/S96ohasd
    2009-12-23 19:33:44: Failed to remove file:
    2009-12-23 19:33:44: Creating a link "/etc/rc.d/rc5.d/S96ohasd"pointing to /etc/init.d/ohasd
    2009-12-23 19:33:44: Removing "/etc/rc.d/rc0.d/K19ohasd"
    2009-12-23 19:33:44: Removing file /etc/rc.d/rc0.d/K19ohasd
    2009-12-23 19:33:44: Failure with return code 1 from command rm /etc/rc.d/rc0.d/K19ohasd
    2009-12-23 19:33:44: Failed to remove file:
    2009-12-23 19:33:44: Creating a link "/etc/rc.d/rc0.d/K19ohasd"pointing to /etc/init.d/ohasd
    2009-12-23 19:33:44: Removing "/etc/rc.d/rc1.d/K19ohasd"
    2009-12-23 19:33:44: Removing file /etc/rc.d/rc1.d/K19ohasd
    2009-12-23 19:33:44: Failure with return code 1 from command rm/etc/rc.d/rc1.d/K19ohasd
    2009-12-23 19:33:44: Failed to remove file:
    2009-12-23 19:33:44: Creating a link "/etc/rc.d/rc1.d/K19ohasd"pointing to /etc/init.d/ohasd
    2009-12-23 19:33:44: Removing "/etc/rc.d/rc2.d/K19ohasd"
    2009-12-23 19:33:44: Removing file /etc/rc.d/rc2.d/K19ohasd
    2009-12-23 19:33:44: Failure with return code 1 from command rm/etc/rc.d/rc2.d/K19ohasd
    2009-12-23 19:33:44: Failed to remove file:
    2009-12-23 19:33:44: Creating a link "/etc/rc.d/rc2.d/K19ohasd"pointing to /etc/init.d/ohasd
    2009-12-23 19:33:44: Removing "/etc/rc.d/rc4.d/K19ohasd"
    2009-12-23 19:33:44: Removing file /etc/rc.d/rc4.d/K19ohasd
    2009-12-23 19:33:44: Failure with return code 1 from command rm /etc/rc.d/rc4.d/K19ohasd
    2009-12-23 19:33:44: Failed to remove file:
    2009-12-23 19:33:44: Creating a link "/etc/rc.d/rc4.d/K19ohasd"pointing to /etc/init.d/ohasd
    2009-12-23 19:33:44: Removing "/etc/rc.d/rc6.d/K19ohasd"
    2009-12-23 19:33:44: Removing file /etc/rc.d/rc6.d/K19ohasd
    2009-12-23 19:33:44: Failure with return code 1 from command rm/etc/rc.d/rc6.d/K19ohasd
    2009-12-23 19:33:44: Failed to remove file:
    2009-12-23 19:33:44: Creating a link "/etc/rc.d/rc6.d/K19ohasd"pointing to /etc/init.d/ohasd
    2009-12-23 19:33:44: The file ohasd has been successfully linked to the RCdirectories
    2009-12-23 19:33:44: Starting ohasd
    2009-12-23 19:33:44: itab entries=
    2009-12-23 19:33:49: Created backup /etc/inittab.no_crs
    2009-12-23 19:33:49: Appending to /etc/inittab.tmp:
    2009-12-23 19:33:49: h1:35:respawn:/etc/init.d/init.ohasd run >/dev/null2>&1 </dev/null
    
    2009-12-23 19:33:49: Done updating /etc/inittab.tmp
    2009-12-23 19:33:49: Saved /etc/inittab.crs
    2009-12-23 19:33:49: Installed new /etc/inittab

    
    
    Secondary Node Start OHASD Daemon:

    2009-12-2319:33:55: ohasd is starting
    2009-12-23 19:33:55: Checking ohasd
    2009-12-23 19:33:55: ohasd started successfully

    
    Secondary Node Copy required CRS resources for OHASD to start:

    2009-12-2319:33:55: Creating CRS resources and dependencies
    2009-12-23 19:33:55: Configuring HASD
    2009-12-23 19:33:55: Registering type ora.daemon.type
    2009-12-23 19:33:55: Registering type ora.mdns.type
    2009-12-23 19:33:55: Registering type ora.gpnp.type
    2009-12-23 19:33:55: Registering type ora.gipc.type
    2009-12-23 19:33:56: Registering type ora.cssd.type
    2009-12-23 19:33:56: Registering type ora.cssdmonitor.type
    2009-12-23 19:33:56: Registering type ora.crs.type
    2009-12-23 19:33:56: Registering type ora.evm.type
    2009-12-23 19:33:56: Registering type ora.ctss.type
    2009-12-23 19:33:57: Registering type ora.asm.type
    2009-12-23 19:33:57: Registering type ora.drivers.acfs.type
    2009-12-23 19:33:57: Registering type ora.diskmon.type
    2009-12-23 19:34:12: ADVM/ACFS is configured
    
    2009-12-23 19:34:12: Successfully created CRS resources for cluster daemon andASM
    2009-12-23 19:34:12: Checking if initial configuration has been performed
    2009-12-23 19:34:12: Starting CSS in exclusive mode
    2009-12-23 19:35:54: CRS-4402: The CSS daemon was started in exclusive mode butfound an active CSS daemon on node racbde1, number 1, and is terminating
    2009-12-23 19:35:54: An active cluster was found during exclusive startup,restarting to join the cluster

    
    
    Secondary Node Start Full Clusterware Stack:

    2009-12-2319:35:54: Starting
    2009-12-23 19:35:56: Start of resource "ora.mdnsd -init" Succeeded
    2009-12-23 19:35:57: Start of resource "ora.gipcd -init" Succeeded
    2009-12-23 19:35:58: Start of resource "ora.gpnpd -init" Succeeded
    2009-12-23 19:35:58: Successfully started requested Oracle stack daemons
    2009-12-23 19:35:58: Starting CSS in clustered mode
    2009-12-23 19:36:32: CRS-2672: Attempting to start 'ora.cssdmonitor' on'racbde2'
    2009-12-23 19:36:32: CRS-2676: Start of 'ora.cssdmonitor' on 'racbde2'succeeded
    2009-12-23 19:36:32: CRS-2672: Attempting to start 'ora.cssd' on 'racbde2'
    2009-12-23 19:36:32: CRS-2672: Attempting to start 'ora.diskmon' on 'racbde2'
    2009-12-23 19:36:32: CRS-2676: Start of 'ora.diskmon' on 'racbde2' succeeded
    2009-12-23 19:36:32: CRS-2676: Start of 'ora.cssd' on 'racbde2' succeeded
    2009-12-23 19:36:33: Start of resource "ora.ctssd -init -envUSR_ORA_ENV=CTSS_REBOOT=TRUE" Succeeded
    2009-12-23 19:39:25: Start of resource "ora.asm -init" Succeeded
    2009-12-23 19:39:26: Start of resource "ora.crsd -init" Succeeded
    2009-12-23 19:39:27: Start of resource "ora.evmd -init" Succeeded
    2009-12-23 19:39:27: Successfully started Oracle clusterware stack
    2009-12-23 19:39:27: Waiting for Oracle CRSD and EVMD to start
    2009-12-23 19:39:33: Oracle CRS stack installed and running

    
    
    Secondary Node Adding Clusterware Resources:

    2009-12-2319:39:33: Configuring node
    2009-12-23 19:39:34: adding nodeapps...
    2009-12-23 19:39:34: upgrade_opt=
    2009-12-23 19:39:34: nodevip=racbde2-vip/255.255.254.0/eth1
    2009-12-23 19:39:34: DHCP_flag=0
    2009-12-23 19:39:34: nodes_to_add=racbde2
    2009-12-23 19:39:34: add nodeapps for static IP
    2009-12-23 19:39:34: Running srvctl config nodeapps to detect if VIP exists
    2009-12-23 19:39:35: vip exists
    2009-12-23 19:39:35: Invoking "/u01/app/grid/bin/srvctl add vip -n racbde2-k 1 -A "racbde2-vip/255.255.254.0/eth1" "
    2009-12-23 19:39:35: tracefile=/u01/app/grid/cfgtoollogs/crsconfig/srvmcfg0.log
    2009-12-23 19:39:38: add vip -n racbde2 -k 1 -A racbde2-vip/255.255.254.0/eth1on node=racbde2 ... passed
    2009-12-23 19:39:38: nodes_to_start=racbde2
    2009-12-23 19:39:38: starting nodeapps...
    2009-12-23 19:39:38: DHCP_flag=0
    2009-12-23 19:39:38: nodes_to_start=racbde2
    2009-12-23 19:39:43: exit value of start nodeapps/vip is 2
    2009-12-23 19:39:43: output for start nodeapps is PRKO-2421 : Networkresource is already started on node(s): racbde2 PRKO-2422 : ONS is alreadystarted on node(s): racbde2 PRKO-2423 : eONS is already started on node(s):racbde2
    2009-12-23 19:39:43: output of startnodeapp after removing already startedmesgs is
    2009-12-23 19:39:43: /u01/app/grid/bin/srvctl start nodeapps -n racbde2 ...passed
    2009-12-23 19:39:43: /u01/app/grid/bin/ocrconfig -local -manualbackup ...passed
    2009-12-23 19:39:43: Install cvuqdisk rpm on Linux...
    2009-12-23 19:39:43: New package to install is/u01/app/grid/cv/rpm/cvuqdisk-1.0.7-1.rpm
    2009-12-23 19:39:43: Invoking "/bin/rpm -q cvuqdisk" command
    2009-12-23 19:39:44: no existing cvuqdisk found
    2009-12-23 19:39:44: removing old rpm
    2009-12-23 19:39:44: installing/upgrading new rpm
    2009-12-23 19:39:45: Configure Oracle Grid Infrastructure for a Cluster ...succeeded

    
    
    If the root.sh is successful but there are subsequent startup problems, see Note: 1050908.1 for more troubleshootinginformation.

    Community Discussions

    
    Still have questions? Use the communities window below to search for similardiscussions or start a new discussion on this subject.
    
    Note: Window is the LIVE community not a screenshot.
    
    Click hereto open in main browser window.

    References

    NOTE:1050908.1 - Troubleshoot Grid InfrastructureStartup Issues
    NOTE:1053147.1 - 11gR2 Clusterware and Grid Home- What You Need to Know