Clusterware :: CRS-4535 - Cannot Communicate With Cluster Ready Services
May 23, 2013
We have 3 node RAC. In one of the node clusterware is down and also CSSD process is down. I got to know that we have to clear socket files in that node.what needs to be done instead ofclearing socket files.
database
Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64bit Production
PL/SQL Release 11.2.0.2.0 - Production
CORE 11.2.0.2.0 Production
TNS for Linux: Version 11.2.0.2.0 - Production
NLSRTL Version 11.2.0.2.0 - Production
[code]...
View 3 Replies
ADVERTISEMENT
Dec 7, 2012
im having problems with CRS in a Rac installation. Because of this i cant start the database.I installed Oracle Rac 11.2.0.1 with ASM in a Red Hat 5.8 linux server. Everything was ok until a server reboot. I have 2 nodes, nodo1 and nodo2. Both got rebooted and after that im not able to start the cluster.
All the other resources seem to be just fine .
At nodo1:
[root@nodo1 oracle]# crsctl start cluster -all
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'nodo1'
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'nodo2'
CRS-2676: Start of 'ora.cssdmonitor' on 'nodo1' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'nodo1'
CRS-2672: Attempting to start 'ora.diskmon' on 'nodo1'
CRS-2676: Start of 'ora.cssdmonitor' on 'nodo2' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'nodo2'
[code]....
View 5 Replies
View Related
Nov 21, 2012
RAC star crs failed
[root@tyan147 crsd]# /orahome/grid/bin/crsctl check crs
CRS-4638: Oracle High Availability Services is online
CRS-4535: Cannot communicate with Cluster Ready Services
CRS-4530: Communications failure contacting Cluster Synchronization Services daemon
CRS-4534: Cannot communicate with Event Manager
cssd.log
2012-11-21 11:12:29.312: [ GPnP][3613030480]clsgpnpm_connect: [at clsgpnpm.c:1100] GIPC gipcretConnectionRefused (29) gipcConnect(ipc-ipc://GPNPD_tyan147)
2012-11-21 11:12:29.312: [ GPnP][3613030480]clsgpnpm_connect: [at clsgpnpm.c:1101] Result: (48) CLSGPNP_COMM_ERR. Failed to connect to call url "ipc://GPNPD_tyan147"
2012-11-21 11:12:29.312: [ GPnP][3613030480]clsgpnp_getProfileEx: [at clsgpnp.c:546] Result: (13) CLSGPNP_NO_DAEMON. Can't get GPnP service profile from local GPnP daemon
2012-11-21 11:12:29.313: [ default][3613030480]Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
2012-11-21 11:12:29.313: [ CSSD][3613030480]clsgpnp_getProfile failed, rc(13)
[code]....
View 2 Replies
View Related
Sep 13, 2010
i have a problem with DATABASE i have 2 nodes where all application on Node2 are tunning properly
[oracle@node2 ~]$ crs_stat -t
Name Type Target State Host
------------------------------------------------------------
ora....SM1.asm application ONLINE ONLINE node1
ora....E1.lsnr application ONLINE ONLINE node1
ora....de1.gsd application ONLINE ONLINE node1
ora....de1.ons application ONLINE ONLINE node1
ora....de1.vip application ONLINE ONLINE node1
ora....SM2.asm application ONLINE ONLINE node2
ora....E2.lsnr application ONLINE ONLINE node2
[code]....
View 3 Replies
View Related
Jul 4, 2013
I have installed 11gr2 on aix 7.1 and we have HACMP active passive cluster . And now i m getting below error:
output : #crs_stat -tcrs-0184 : cannot communicate with crs daemon
View 1 Replies
View Related
Nov 9, 2010
on 6th of August at 02:36 our following cluster services were down,i see the logs and found that ASM is down and disk group are not accessible and ASMb process is terminated and both instances was restarted, i checked the cluster services so five services were down and these are
Quote: ora_ OCR_DG.DG, ora_fedb96.asm2.asm, ora_fedb96.gsd, ora_fedb96.ons and ora_fedb96.oc4j...
I restarted the services and they were successfully up and application become available . What can be the reason of the service failure?
alert.log
ORA-03113: end-of-file on communication channel
Process ID:
Session ID: 157 Serial number: 6655
ASMB (ospid: 23903): terminating the instance due to error 15064
Mon Aug 06 02:36:38 2012
NOTE: Deferred communication with ASM instance
Errors in file /u01/app/oracle/diag/rdbms/grid12/grid91/trace/grid91_ora_25856.trc:
ORA-15055: unable to connect to ASM instance
ORA-01092: ORACLE instance terminated. Disconnection forced
[code]...
View 1 Replies
View Related
Jan 22, 2013
I am doing the following steps for stopping the Oracle RAC Services on a 2 node.(OS is Windows 2008 Release 2).
srvctl stop database -d <database_name>
Node 1:
crsctl stop has
Node 2:
crsctl stop has
But i am getting error like Oracle HAS Service not stopped successfully. Finally what i did was stopped the OHAS Service from Windows Services.
which is the right procedure to have a clean stopping of RAC Services in 11g R2.
View 4 Replies
View Related
Oct 3, 2012
we are running oracle database 11.2.0.3 and tomcat on the same machine(SLES 11).
I need to contol tomcat(start/stop) depending to database status. For example, if database stops or become standby then to stop tomcat service.
View 2 Replies
View Related
Aug 23, 2012
We are having 10g 2Node RAC on Windows 2003. I cannot stop services by using command ""crsctl stop crs/ srvctl stop database "" without administrator permission through my OS user. Is it possible to stop the services without Administrator permission on OS level.? What kind of OS level permission need to access the ""crsctl/srvctl etc"".
View 6 Replies
View Related
Aug 26, 2012
I have a RAC working with SAN raw devices presented to ASM and working fine. My situation has changed since the installation of the RAC. Now I need a shared storage (with a filesystem) to upload some files (so DB can read these as external tables) for this I have used OCFS2.
As you can see I have Oracle RAC on raw ASM + shared storage on OCFS2 and for the time been all seems to be well and working perfectly. Can these coexist with out effecting the other?
View 2 Replies
View Related
Aug 15, 2012
I'm a long time Oracle DBA but have only recently started with RAC and have never done any patching or upgrades in a RAC environment.
My environment consists of a 2 node RAC cluster, and 2 physical standbys at separate remote locations.
The database, GI, ASM, and clusterware are all at version 11.2.0.1.
I want to upgrade all components to the latest patchset which is 11.2.0.3. Eventually I also want to apply the latest PSU.
Can I do this without down time? It is a mission critical database where downtime could conceivably endanger lives. If it can't be done with zero downtime, then downtime must be kept to an absolute minimum (minutes, not hours).
I suspect the clusterware needs to be patched first and I do not know whether I can do it on one node at a time.
View 2 Replies
View Related
Jun 21, 2013
I would like to build a 2-node cluster without RAC. I desire to operate 2 Oracle database instances for use by 2 separate applications. I plan to run Linux. I would like node1 to act as the primary server for the databases in application1 and node2 to act as the failover server for the databases in application1. Conversely, I want node2 to act as the primary server for databases in application2 and node1 to act as the failover server for databases in application2. Can Oracle SE and Oracle Clusterware be configured in this this way?
View 2 Replies
View Related
Sep 8, 2012
I created Virtual Private Network for VIP and subnet is 255.255.255.255. I need VPN subnet as 255.255.255.0. How to i create
INS-40911: Ensure that nodes in the list are up and reachable, and ensure that the node addresses are all in the same subnet.
View 2 Replies
View Related
Feb 3, 2013
I have to manage an active passive cluster on SLES10 SP4. Oracle 10.2.0.4. All oracle binaries are on a DRBD Device on mountpoint /oradata. This mountpoint includes the binaries and all datafiles.
I havent installed these systems. At one stage on node died and got reinstalled by a system administrator. After a switch from the running node to the standby node, the cluster is not starting.
Jan 3 14:36:01 a logger: Cluster Ready Services waiting on dependencies. Diagnostics in /tmp/crsctl.6114.
Jan 3 14:36:14 a logger: Waiting for Oracle CSS service to be available before starting
Jan 3 14:36:14 a logger: ASM instance +ASM. Wait 2.
After issuing $ORACLE_HOME/bin/localconfig add the cluster is starting, the asm instance is coming up, and also the database instance is starting.
Shortly after that the db instance dies. Alert log is showing something like recursive sql error. Looks like writing to the datafiles is not working. In asmcmd the diskgroups are showing DISMOUNTED (show MOUNTED before)
so what to do ?
a) Why is it necessary to issue "localconfig add" to make the cluster starting ?
b) What could be a reason for not being able to write to the database ?
c) How to install an active/passive cluster ?
c1) Install OS on both nodes
c2) Install oracle binaries
c2.1) on both nodes in the local files system and do the mapping to the drbd afterwards?
c2.2) only on one node and just switch the mountpoint ?
View 2 Replies
View Related
Aug 22, 2012
After installing a 4 node cluster 11.2.0.3 with 16 CPU's (4 on each node) on IBM 795 with aix 6.1 each server is using 0.5 CPU with no user load on the system. Running SIHA on one server typically uses 0.05 CPU with no user load on the system.
View 5 Replies
View Related
Jul 25, 2012
I have been asked to look at making an existing Oracle server resilant. The technology I need to use are:
- Windows 2008 R2 Enterprise SP2
- Microsoft Cluster Services
- Oracle Enterprise 11g release 2
- Oracle Fail-Safe (latest version available)
Unfortunately ApEX 4.1 and Mod_plsql are install on the existing stand-alone server. I'm afraid i know very little about Oracle and ApEX but i need to make a design decision and check fiesablilty.
I believe the HTTP service and Mod_plsql can be moved to a independant server which should work but ApEX itself must remian on the database server (i'm told).Will ApEX work in a MSCS setup? I can only find references to RAC support, RAC is out of scope.
View 0 Replies
View Related
Oct 24, 2012
My application consists of Oracle RAC and Oracle Enterprise Manage (OEM) on same two nodes. I am exploring the idea of utilizing Oracle Clusterware (which is already installed with Oracle RAC) to support OEM in active passive mode.
Here is the scenario.
Node A running Solaris 10.9 on SPARC and Node B running Solaris 10.9 on SPARC.
Node A and Node B are both Oracle RAC Nodes ( Active Active ) which use Shared Storage for Oracle using ASM.
Node A and Node B will run Oracle Enterprise Manager (OEM) Application in active passive scenario which will be using Oracle RAC for its database. So, both Oracle RAC and OEM are sharing same server A and B for its clusters.
Now, OEM application need a third party clusterware to fail it over. It needs clusterware to provide floating VIP and shared folder of the size of 20GB which will keep software libraries. If node A goes down, node B have access to same libraries and will come up as active.
Do you know if oracle clusterware which comes with Oracle RAC can support OEM for failing over i.e. it can provide floating VIP and shared file system?
View 3 Replies
View Related
Oct 17, 2013
We have 2 servers running Oracle 11gR2 Window server 2008 64 bit RAC. Today I add new shared disk visible from both servers. All our data placed on ASM partitions, but we need Windows volume for exchanging some data between servers & users;Actions:then i have prepare disk on shared storage from 1st node, run diskmfmt.msc & rescan disks when windows recognizes new hdd, initialize it.create an Extended partition & Logical drive & Assign drive letter. from another nodes, make sure no drive letter is assigned.
Sometimes Windows automatically assign drive letter. If drive letter is assigned, right click & Change drive letter & Remove. from 1st node, format this logical drive using ocfsFormat.exe after execute below scripts i have face some issues
E:app11.2.0gridcfs>ocfsformat /m P: /c 1024 /v DATA /f /d /aReg Get Cluster Name(): Reg Query ValueEx for CFS_CLUSTER_NAME failed with error 203
This indicates that the Cluster Name has not been configured on this node for OCFSThe volume formatted in this condition will be seen by all nodes running OCFS.
View 3 Replies
View Related
Jul 4, 2012
I have installed Oracle Grid on a standalone server and setup Oracle db 11.2.0.2 on Oracle Linux 6.2 64 bit server.When I reoot the server and run crs_stat -t,several daemons havent started thus the ASM and db instances are also down as below
Name Type Target State Host
------------------------------------------------------------
ora.DATA.dg ora....up.type OFFLINE OFFLINE
ora.FRADG.dg ora....up.type OFFLINE OFFLINE
ora....ER.lsnr ora....er.type ONLINE ONLINE amldb01dc
ora.amldb.db ora....se.type OFFLINE OFFLINE
ora.asm ora.asm.type OFFLINE OFFLINE
ora.cssd ora.cssd.type ONLINE OFFLINE
ora.diskmon ora....on.type ONLINE OFFLINE
ora.evmd ora.evm.type ONLINE ONLINE amldb01dc
ora.ons ora.ons.type OFFLINE OFFLINE
I am forced to manually start the daemons via command crsctl start resource -all then I manually start the ASM and db instances. Yet when I run the commands
crsctl config has
CRS-4622: Oracle High Availability Services autostart is enabled.
crsctl check has
CRS-4638: Oracle High Availability Services is online.
Thus I would assume the daemons would start automatically during boot.
View 5 Replies
View Related
Jun 15, 2012
current environment
Oracle VM 2 Node RAC cluster
Oracle 11G 11.2.0.3.0
Oracle 11g rel 2 GI
on current 2 node cluster we have GI and RAC db configured Nodes: vmorarac1,vmorarac2
we shutdown vmorarac1 to clone it to vmorarac5
on new node I have changed the hostname to vmorarac5 In /etc/sysconfig/network-scripts/ifcfg-eth0 change ip to new ip and same for /etc/sysconfig/network-scripts/ifcfg-eth1 152.144.199.210,152.144.199.211
mad echanges to /etc/hosts on vmorarac1/2 for 2 new IP address assigned to vmorarac5
152.144.199.171 vmorarac1.pbi.global.pvt vmorarac1
192.168.2.30 vmorarac1-priv.pbi.global.pvt vmorarac1-priv
152.144.199.184 vmorarac1-vip.pbi.global.pvt vmorarac1-vip
[Code]....
Query is is that all ok to reboot the new node to reflect changes as below and change the hostname to vmorarac2
152.144.199.210 vmorarac2.pbi.global.pvt vmorarac2
192.168.2.32 vmorarac2-priv.pbi.global.pvt vmorarac2-priv
152.144.199.211 vmorarac2-vip.pbi.global.pvt vmorarac2-vip
hostname change in /etc/sysconfig/network
On new node vmorarac5, there is alreay software for RAC DB and GUI cloned from vmorarac1
addnode.sh is used to add existing node, but as part of pre-requisite configuratoin is there any config step missing
View 3 Replies
View Related
Dec 6, 2012
I am using newstart cluster software. currently I have two blade servers in my system and I have configured cluster as well. right now I have one issue. I am using the ip address of 10.34.14.0/28 network for cluster but this can not be accessed from all network so I want to use different range of IP of 10.68.1.0/28 network in the same blade servers. Can I configure two different floating (cluster) IP? the first IP range is for signalling and second IP range 10.68.1.0/28 network is for OMM. I need to use both IP in two blade servers.
View 1 Replies
View Related
May 17, 2013
Restarting oracle services through services.msc is faster then manual (In command prompt).
Even If we have heavy transaction on the oracle database But we can restart the database within minutes by using services.msc But It will take more time in command prompt(sql>shu immediate). So shall we assume here that services.msc is using shut abort command while restarting the database?
View 3 Replies
View Related
Apr 18, 2013
Should the page load D.A. fire not until the dom is ready? Or is this not necessarily the case.I'm running a page over a slow connection, so the event (true action: execute JS) is being executed before the page is ready to handle the code. I would think this event should not run until the DOM is ready.
I have confirmed this by wrapping the code in document.ready, and it behaves as expected.
View 0 Replies
View Related
Mar 1, 2011
yesterday we started one of our rac node cluster, but the database didn't start.I'll give the results of ps
ps -ef|grep -i crsd
root 6151 1 0 08:32 ? 00:00:00 /bin/sh /etc/init.d/init.crsd run
oracle 15921 14763 0 09:46 pts/0 00:00:00 grep -i crsd
root 6149 1 0 08:32 ? 00:00:00 /bin/sh /etc/init.d/init.evmd run
oracle 16413 14763 0 09:50 pts/0 00:00:00 grep -i evmd
when I try to start the db-instance "crs_start ora.eVTDB.eVTD1.inst" I get the message...CRS-0184: Cannot communicate with the CRS daemon
View 3 Replies
View Related
May 3, 2011
I am installing 4 Node Oracle RAC 11.2.0.2 on RHEL 5.5 (x86_64) {for the first time} I am having some issues with ASM monitoring from em console. the +ASM instance appears to be "down" on the em console. However i can connect to separate ASM instances on respective nodes and thus know that they are not down. I am trying to find out the reason why em console is not able to communicate with my ASM instance.
DATAPOINT1
---------------
Under Metric Collection Error link, I can see the following error message for all the nodes.
Target: xxxxx
Type: Host
Metric: Storage Data
Collection Timestamp: MON D,YYYY H:MM:SS PM
Error Type: Collection Problem
Messsage: executable nmhs should have root suid enabled
[code]....
Now the problem is that I cannot find any binary named "nmhs" anywhere in the grid installation, but this file exists in oracle database bin directory:
-rws--x--- 1 root oracle 67778 May 2 18:04 nmhs
I am also not sure whether this is the error which tells me about the problem why em console is not able to communicate with ASM.
DATAPOINT2
---------------
I tried to run emctl to check if the agent for the ASM instance is running:
I set the following for running from grid home:
ORACLE_HOME=/apps/RAC/grid
ORACLE_SID=+ASM1
[code]....
I have seen in all the forums, that there is a directory named "agent11g". I cant find this anywhere in my installation. Its not there in the grid infrastructure directory or the oracle database directory. what are its contents?, do i need this for my RAC setup?, how to I create this now?
View 1 Replies
View Related
Jan 9, 2013
Recently when we rebooted our RAC system we observed that the cluster crs was not able to start. when we try to issue crs_stat -t we got the above error.
# crs_stat -t
CRS-0184: Cannot communicate with the CRS daemon.
CRS-1006:The OCR location /dev/raw/raw2 is inaccessible.
DB Version: 10.2.0.3.0 (Linux)
View 2 Replies
View Related
Mar 4, 2011
Daily am getting this mails from grid... for the time of 3 to 4 seconds, am getting upto 15 mails saying the message which i mentioned below... In that time period the OEM is not working properly... After 4 seconds then OEM console is working fine..
Agent is unable to communicate with the OMS. (REASON = Agent is Unreachable (REASON : Agent to OMS Communication is brokenError in request response, code = 400 , text = ).
View 1 Replies
View Related
Dec 15, 2011
I have problem after the OAS migration from 10.1.2.0 to 10.1.2.3 , i couldnt use or run report from forms using the run_report_object function.I have the error : FRM-92101: There was a failure in the Forms Server during startup.
And here more details/logs :
application.log
11/12/15 17:26:16 formsweb: Forms session <1,192> aborted: unable to communicate with runtime process.
11/12/15 17:26:16 formsweb: Forms session <1192> exception stack trace:
java.io.IOException: FRM-93000: Unexpected internal error.
Details : No HTTP headers received from runform
[code]...
View 2 Replies
View Related
Feb 7, 2011
I have 10g 2 node cluster running on Linux OS (redhat 4). Oracle version is 10.2.0.5.0. The problem is when the CRS get start all the services are online but when i try to connect DB, its connecting to idle instance. When I check the details the backgroundprocesses all get started but instance not started. Later i stopped the background processes and start the instance manually using sqlplus, the DB instance started and I can connect. But when i check the crs service status (crs_stat -t), the instance and service status are offline, nodeapps services are online. When i try to restart (crs_start) it throws up error.
View 3 Replies
View Related
Mar 24, 2011
I have a 2 node RAC database. I have a service defined as a preferred service for one node and Available for the other node. the service was relocated to the available node. I want to know when it failed over and why. Where would I get this information?
some time After the service failed over to the other node I got connection issues for this service. I relocated the service and the issues went away. Why did it not relocate the service back to the preferred node when these issues were encountered?
View 1 Replies
View Related
