Real Application Clusters :: How To Completely Shutdown The Entire Crs Stack In All Nodes
Nov 11, 2013
Grid version: 11.2.0.4Platform : OEL 6.4
To shutdown the entire crs stack, I ran crsctl stop cluster -all from one node. After the command execution, the below mentioned processes were still running on all nodes.
[root@intsmdp01 ~]# ps -ef | grep d.binroot 38562 33228 0 19:12 pts/2 00:00:00 grep d.binroot 80820 1 0 Nov09 ? 00:20:56 /crs/product/11.2.0/bin/ohasd.bin rebootgrid 81448 1 0 Nov09 ? 00:01:22 /crs/product/11.2.0/bin/mdnsd.bingrid 81459 1 0 Nov09 ? 00:01:55 /crs/product/11.2.0/bin/gpnpd.bingrid 81473 1 0 Nov09 ? 00:17:26 /crs/product/11.2.0/bin/gipcd.binroot 81484 1 20 Nov09 ? 09:10:27 /crs/product/11.2.0/bin/osysmond.bin
So , I had to manually run crsctl stop crs on all nodes.
[root@intsmdp01 ~]# /crs/product/11.2.0/bin/crsctl stop crsCRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'intsmdp01'CRS-2673: Attempting to stop 'ora.crf' on 'intsmdp01'CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'intsmdp01'CRS-2673: Attempting to stop 'ora.mdnsd' on 'intsmdp01'CRS-2677: Stop of 'ora.crf' on 'intsmdp01' succeededCRS-2673: Attempting to stop 'ora.gipcd' on 'intsmdp01'CRS-2677: Stop of 'ora.mdnsd' on 'intsmdp01' succeededCRS-2677: Stop of 'ora.drivers.acfs' on 'intsmdp01' succeededCRS-2677: Stop of 'ora.gipcd' on 'intsmdp01' succeededCRS-2673: Attempting to stop 'ora.gpnpd' on 'intsmdp01'CRS-2677: Stop of 'ora.gpnpd' on 'intsmdp01' succeededCRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'intsmdp01' has completedCRS-4133: Oracle High Availability Services has been stopped.[root@intsmdp01 ~]#
Is there a way to bring down the entire crs stack in all the nodes in the cluster from one node ?
View 3 Replies
ADVERTISEMENT
Nov 6, 2012
[URL] I arrived at step 2 (Step 2: Delete Nodes from the Cluster) point 4 and 5.
I executed this correctly (on 2 nodes):
For a nonshared home:
To delete a node from a cluster:
./runInstaller -updateNodeList ORACLE_HOME=Oracle_home CLUSTER_NODES="" –local
Output:
[oracle@server03 bin]$ ./runInstaller -updateNodeList ORACLE_HOME=$ORACLE_HOME CLUSTER_NODES="" -local
Starting Oracle Universal Installer...
Checking swap space: must be greater than 500 MB. Actual 20127 MB Passed
The inventory pointer is located at /etc/oraInst.loc
The inventory is located at /u01/app/oraInventory
'UpdateNodeList' was successful.then I executed:
To deinstall the Oracle home from the node you are deleting, run the following command from the Oracle_home/oui/bin directory:
./runInstaller -deinstall -silent "REMOVE_HOMES={Oracle_home}" -local
Output:
[oracle@server03 bin]$ ./runInstaller -deinstall -silent "REMOVE_HOMES=$ORACLE_HOME" -local
Starting Oracle Universal Installer...
Checking swap space: must be greater than 500 MB. Actual 20127 MB Passed
Preparing to launch Oracle Universal Installer from /tmp/OraInstall2012-11-06_12-05-36PM. Please wait ...[oracle@server03 bin]$ Oracle Universal Installer, Version 11.1.0.7.0 Production
Copyright (C) 1999, 2008, Oracle. All rights reserved.
[code]....
When I arrive to the point 5 I see one resource ora.DPCTTest.db ONLINE on one server (server02 or server03 that are the nodes I want to remove).
If I execute:
crs_relocate ora.db_name.db
I obtain:
[oracle@server03 bin]$ ./crs_relocate ora.DPCTTest.db
Attempting to stop `ora.DPCTTest.db` on member `server02`
Stop of `ora.DPCTTest.db` on member `server02` succeeded.
Attempting to start `ora.DPCTTest.db` on member `server03`
[code]....
View 5 Replies
View Related
Jan 2, 2013
I have recently setup a 2 node Rac on oracle linux 5.4 with oracel 11gR2, the installation went smoothly and all the cluster resources are up and running however the data is not syncing across the nodes, when I create a table it shows up on the other node but when I insert rows into the tables they don't show up on the other node and when I restart the cluster the inserted rows are completely gone even from the node where I inserted them.
View 4 Replies
View Related
Sep 15, 2013
i am on RAC 11G R2 RHEL 5 , when i install rac can i run root.sh on all nodes in parallel ? or do i have to wait for first node to finish root.sh completely and then i shud run root.sh on second node and so on on third node
View 5 Replies
View Related
Sep 6, 2012
I want to apply patch for the 3 node rac database. I am going to use rolling upgrade, one node at a time. For this i need to stop all the instances or any processes running out of $ORACLE_HOME. I will use srvctl stop home command. My concern is:
1) with the srvctl stop home command how the instances shutdowns, either shutdown immediate or shutdown abort.
2) if applications are connected to the shutdown node, will the sessions fail over to surviving nodes?
3) If it is shutdown abort, how session failover?how about long running queries ? will they also fail-over?
Oracle version 11.2.0.2 on RHEL 5.6 , planning to apply Db PSU 11.2.0.2.7
View 3 Replies
View Related
Dec 27, 2012
I m trying to make ORACLE RAC 10gr2 on two nodes with openfiler , with ocfs and asm.but i didn't have clusterware 10.2 software to install because oracle has removed software to download, that's why i install clusterware 11.2 . after installation clusterware 11.2 i check status and output is below on both nodes.
[oracle@linux2 bin]$ ./crsctl check crs
CRS-4638: Oracle High Availability Services is online
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
but when i try to install oracle 10gr2 software and when i reach to configure asm disks it says "in order to use AUTOMATIC STORAGE MANAGEMENT the oracle cluster synchronization service (CSS) must be up and running. and says to run "/u01/app/oracle/product/10.2.0/db_1/bin/ localconfig reset* as root user.. I run it and it give no error.
View 3 Replies
View Related
Jun 18, 2012
is there any alarm in moving alert logs generated in the grid infrastructure. The alert log in the grid log directory has grown around 2gb .Our CRS version 11.2.02. on linux. Also pls, Sample script for automating the same.
View 4 Replies
View Related
May 5, 2013
oracle 11g ASM RAC under OEL 5.6 . i just want to do a cloning so first i create cloning of my oracle home and then i create pfile and i get this error
SQL> startup nomount;
ORA-29702: error occurred in Cluster Group Service operation
SQL> exiti google it , i found this issue is with relink RAC binaries due to the souce database is RAC and destination is not
[oracle@backuptest ~]$ cd $ORACLE_HOME/rdbms/lib
[oracle@backuptest lib]$ make -f ins_rdbms.mk rac_off
bash: make: command not found
View 5 Replies
View Related
Jan 21, 2013
Trying to find a best practices document from Oracle regarding the use of ASM to store the archivelogs in RAC. Most of the DBA's I know create a non-ASM location to store the archivelogs. Are there any considerations if you are also using dataguard?
View 5 Replies
View Related
Nov 13, 2012
oracle 11g.2 rac with asm RHEL 5
ora.gsd
OFFLINE OFFLINE ccbs01
OFFLINE OFFLINE ccbs02
why it's offline , what this means , what the useuage of this? did have any affect on database availability? the below it's from OEM
[Critical] ABSNL Cluster Resource State State Change
ora.gsd has instances in OFFLINE State Nov 12, 2012 12:15:03 PM
[Warning] ABSNL Cluster Resource State State Change
ora.abs.db has instances in OFFLINE State Nov 12, 2012 12:15:03 PM
View 5 Replies
View Related
Oct 4, 2012
We have java application which uses the ons configuration. Currently app's ons nodes parameter is pointing to vip i.e Node1-vip:6200,Node2-vip:6200. Will Ons nodes parameter support the RAC scan? Can i change to Nodes:RAC-scan:6200?
View 1 Replies
View Related
Sep 30, 2013
Grid Version:11.2.0.3OS : RHEL 5.8 I have succesfully installed cluster (GI) and installed RDBMS software on my 2-Node RAC . But, I don't want to use dbca to create the database due to some custom requirements. Instead , I want to run CREATE DATABASE command manually to create the RAC DB. Once the DB is created in one node, what are the steps I need to do to make this DB a RAC DB?
View 5 Replies
View Related
Dec 11, 2012
1. RACcheck - RAC Configuration Audit Tool - RACcheck 2.1.6
2. In the service add command syntax using the srvctl command, there is a new option that can be used with the srvctl add service command which is [-l <primary, physical-standby, logical_standby>], this option allows the service to be able to start up only when the service role matches the database role that is saved in the OCR.
We can now add a service to a database in the OCR using the following command:
srvctl add service -d <db_unique_name>
-s <service_name>
[-l <primary, physical_standby, logical_standby>]
3. NFS options for 11.2.0.2 RMAN disk backups on Linux 64-bit
4. In RAC environment from 11.2 onwards Backup Or Snapshot controlfile needs to be in shared location
1. Check the snapshot controlfile location:
RMAN> show snapshot controlfile name;
2. Configure the snapshot controlfile to a shared disk:
RMAN> CONFIGURE SNAPSHOT CONTROLFILE NAME TO '<shared_disk>/snapcf_<DBNAME>.f';
Or in case of ASM use
RMAN> CONFIGURE SNAPSHOT CONTROLFILE NAME TO '+<DiskGroup>/snapcf_<DBNAME>.f';
View 1 Replies
View Related
Jan 7, 2013
I have an java application deployed on websphere that is using Oracle. Datasource are created in websphere using URL like this:
jdbc:oracle:thin:@DBSERVER_NAME:1521:DB_NAME
Now, that we plan to move move to oracle rac, I learnt that we need to make change to datasource like this:
jdbc:oracle:thin:@(DESCRIPTION=(ADDRESS_LIST=(ADDRESS=(PROTOCOL=TCP)
(HOST=DBSERVER1_NAME)(PORT=1521))(ADDRESS=(PROTOCOL=TCP)
(HOST=DBSERVER2_NAME)(PORT=1521)))(CONNECT_DATA=(SERVICE_NAME
=DATABASE_SERVICENAME)))
would that be enough, or I need to make other changes as well from application perspective.
Another thing is that application deployment is done through ant scripts, which at the moment copies some data on /tmp/.. folder on db server and then run db scripts. These scripts make some ddl changes and some record updates. Now with rac implementation, these scripts will be run on one of the rac node(instances), so do I need to run these ddl scripts/record updates scripts on other node in oracle rac or oracle rac would take care of this automatically.
View 1 Replies
View Related
Sep 19, 2013
RHEL 5.811gr2.
I have two node RAC on a test server. I have installed database software but it failed with an error that OEM could not be installed. Now I need installing Enterprise manager.
View 9 Replies
View Related
Jan 20, 2013
We are in preparation for the purchase of equipment for two- node Oracle10g RAC (on Windows Server 2008) and I need to configure the disks on servers. We have an existing EMC VNX5500 storage and SAN 8Gb switches.
My question is with how many disks to configure servers?Originally we planned four SSD discs (two in RAID 1 for OS and two in RAID 1 for locally Oracle home) for each node/server, and everything else on storage disks (Shared Disks Storage).
Whether it is necessary to have more local disks and for what? Where should be redologs files, archivelogs files, backup files…
Whether it is better server to be configured with six SSD disks:
- two in RAID 1 for OS,
- four in RAID 10 (or RAID 1) for locally Oracle home, archivelogs files, or something else…?
View 6 Replies
View Related
Oct 12, 2012
Version: 11.2.0.2/RHEL 5.4
I was under the impression that you need only one UNDO Tablespace for each instance. But , for our 2-node RAC, I can see three Undo tablespaces.
SQL> select tablespace_name,status from dba_tablespaces where CONTENTS = 'UNDO';
TABLESPACE_NAME STATUS
------------------------------ ---------
UNDOTBS1 ONLINE
UNDOTBS2 ONLINE
UNDOTBS3 ONLINE
SQL> select distinct inst_id from gv$session;
INST_ID
----------
1
2
$ olsnodes -n
thclst214 1
thclst215 2
View 2 Replies
View Related
Oct 2, 2013
Grid Version: 11.2.0.3 OS: Red Hat Enterprise Linux 5.6 Node2 of our two node RAC got rebooted. Upon reboot, CRS and ASM instance came up. But the DB didn't come up. How can I check if DB is linked to CRS startup ?How can I enable DB startup upon CRS startup ?
View 3 Replies
View Related
May 29, 2013
My client asked me to "apply the newest patch" on his RAC 10.2.0.5 environment on Windows.
I've downloaded 10.2.0.5 Patch 20 (the newest version).
My question is: Should i apply it using OPatch to both: ORACLE_HOME and CRS_HOME? or only in ORACLE_HOME? What with 10.2.0.5.2 CRS Patch? Should i apply earlier CPU patches?
View 1 Replies
View Related
May 7, 2013
I have a 2 node 11.2.0.3 RAC database, OS version is RHEL 6.1
Our existing grid control server setup is 10gR2.Can i install 10.2.0.5 agent on my RAC servers and use the 10g grid to monitor my 11.2.0.3 database(RHEL 6.1) ?
View 6 Replies
View Related
Dec 17, 2012
What are the RAC DBA daily(routine) tasks?
View 6 Replies
View Related
Apr 6, 2013
I have installed Oracle RAC 10g on Redhat Linux 4.0. Till yesterday failover was happening that is when i stopped one instance on node01 the vip of node01 was transferred to node02.This was shown using ifconfig -a but now that is now happening.
Below information is given:
[oracle@node01 ~]$ crs_stat -t
Name Type Target State Host
------------------------------------------------------------
ora.hitesh.db application ONLINE ONLINE node02
ora....h1.inst application ONLINE ONLINE node01
[Code]....
[root@node01 oracle]# ps -ef | grep lmon
oracle 5741 1 0 12:07 ? 00:00:03 ora_lmon_hitesh1
root 22582 20805 0 13:01 pts/2 00:00:00 grep lmon
oracle 23643 1 0 11:58 ? 00:00:01 asm_lmon_+ASM1
View 5 Replies
View Related
Aug 30, 2013
Unable to start the crs in one node, totally it's four node rac and Database version - 10gR2?
View 2 Replies
View Related
Jan 24, 2013
I am wokring on oracle 10.2.0.4 rac 2 node instances on AIX. We have one table having multiple rows defilning jobs will be done by users ...the functionality is that ..when even one user will pick on row (job) , one update statement will issue and it will update status column to 1 which menas job is allocated , this means now this should not allocate to any other user ..
but we are facing issue that once any user will pick that job , in application log files we can see that row gets lock and updates the status to 1 . but then also users connecting to other or some time same instance will get that job...means multiple users can pick same job .. even after already picked by another user ..
Is this can be issue with rac configuration ... like whenever one user updates a row ..it will be in cache of one instance and when another user trys to again update 2nd instance does not have that information and allows user connected to that instance to pick that job..like delay in block transfer or cache fusion..
is this can be issue with rac or it is purely application issue..
View 3 Replies
View Related
Jul 25, 2012
I am Oracle RACSIG (URL....) member, but from last week, I am not able to play any of the recorded web seminars. I am getting error "The webpage cannot be found HTTP 404". I am able to look at the PDF but not the recording.
View 0 Replies
View Related
Aug 17, 2012
How to set the password for SCAN listener in 11gr2 ?
View 9 Replies
View Related
Oct 1, 2013
find VIP in RAC from command line.
View 2 Replies
View Related
Aug 1, 2013
, I got the following error while trying to restart a 3 node RAC database. OEM reported two out of three nodes to be down. We also noticed that the cluster_database parameter was set to "False" and the cluster_database_instances integer was set to 1.We changed the parameters to 'True' and '3' respectively and while trying to restart the database we get the error message as shown below.
srvctl start database -d abc123PRCR-1079 : Failed to start resource ora.abc123.dbCRS-5017:
The resource action "ora.abc123.db start" encountered the following error:
ORA-01102: cannot mount database in EXCLUSIVE mode. For details refer to "(:CLSN00107:)" in
"/oradba/app/grid/11.2.0.3_a/log/abcde104/agent/crsd/oraagent_oradba/oraagent_oradba.log".
CRS-2674: Start of 'ora.abc123.db' on 'abcde104' failedCRS-2632:
There are no more servers to try to place resource 'ora.abc123.db' on that would satisfy its placement policy
CRS-5017: The resource action "ora.abc123.db start" encountered the following error:
ORA-01102: cannot mount database in EXCLUSIVE mode.
For details refer to "(:CLSN00107:)" in "/oradba/app/grid/11.2.0.3_a/log/abcde103/agent/crsd/oraagent_oradba/oraagent_oradba.log". CRS-2674: Start of 'ora.abc123.db' on 'abcde103' failed
View 4 Replies
View Related
Nov 19, 2012
I recently installed 2 node Oracle 11g RAC on RHEL5. While creating Clustered Database, database creation on second node (racnode2) failed. So, I connected */ as sysdba* on the node and executed startup only to get this error message:
SQL> startup
ORA-01078: failure in processing system parameters
ORA-01565: error in identifying file '+RACDB_DATA/RACDB/spfileRACDB.ora'
ORA-17503: ksfdopn:2 Failed to open file +RACDB_DATA/RACDB/spfileRACDB.ora
ORA-01034: ORACLE not available
ORA-27123: unable to attach to shared memory segment
Linux Error: 13: Permission denied
Additional information: 196612
Additional information: 10
SQL>But, *'+RACDB_DATA/RACDB/spfileRACDB.ora'* is present.
I strongly believe it is a permission issue that ORACLE owned processes are not able to access disks owned by GRID user. I checked the permission of disks:
[oracle@racnode2 ~]$ cd /dev/oracleasm/disks
[oracle@racnode2 disks]$ ls -l
total 0
brw-rw---- 1 grid asmadmin 8, 65 Nov 19 19:15 CRSVOL1
brw-rw---- 1 grid asmadmin 8, 49 Nov 19 19:15 DATAVOL1
brw-rw---- 1 grid asmadmin 8, 81 Nov 19 19:15 FRAVOL1
[oracle@racnode2 disks]$And also, ORACLE user has asmdba among other privileges.
[oracle@racnode2 disks]$ id
uid=1101(oracle) gid=1000(oinstall) groups=1000(oinstall),1201(asmdba),1300(dba),1301(oper) context=user_u:system_r:unconfined_t
I am willing to furnish further data.
View 10 Replies
View Related
Oct 17, 2012
I am doing a upgrade from 10g2 standalone (with out ASM) to 11g2 2 node cluster (on ASM) and the database is some what 1TB of the size. My problem is if I do a export and import the live system need to be down for over an a day. is there a better way of doing this and how ?
View 6 Replies
View Related
