RAC & Failsafe :: Listener Went Offline During Network?
Aug 29, 2013
Recently we had faced network issue due to which node3 server was inaccessible.After the network issue got resolved , node3 was accessbile.So once the issue got fixed , i did a post validation in database and cluster and found listener , network1.org on node3 went offline.
When i try to start listener on node3,i got following error.
grid@RAC3 ~]$ srvctl start listener
PRCR-1079 : Failed to start resource ora.LISTENER.lsnr
CRS-2674: Start of 'ora.net1.network' on 'RAC3' failed
[grid@RAC3 ~]$ srvctl status vip -n RAC3
VIP RAC3-vip is enabled
VIP RAC3-vip is not running
[grid@RAC3 ~]$ srvctl status vip -n RAC2
VIP RAC2-vip is enabled
VIP RAC2-vip is running on node: RAC2
[grid@RAC3 ~]$ srvctl start vip -n RAC3
PRKO-2420 : VIP is already started on node(s): RAC2
[grid@RAC3 ~]$ srvctl status vip -n RAC3
VIP RAC3-vip is enabled
VIP RAC3-vip is not running
[grid@RAC3 ~]$ srvctl status nodeapps
VIP RAC1-vip is enabled
VIP RAC1-vip is running on node: RAC1
VIP RAC2-vip is enabled
VIP RAC2-vip is running on node: RAC2
VIP RAC3-vip is enabled
VIP RAC3-vip is running on node: RAC2
Network is enabled
Network is running on node: RAC1
Network is running on node: RAC2
Network is not running on node: RAC3
GSD is disabled
GSD is not running on node: RAC1
GSD is not running on node: RAC2
GSD is not running on node: RAC3
ONS is enabled
ONS daemon is running on node: RAC1
ONS daemon is running on node: RAC2
ONS daemon is not running on node: RAC3
I have implemented Rac One node with two machine(dbtest01,dbtest02) in 11.2.0.3 Redhat 5.3 one for online another one for offline. i have created TAF also.
dbtest01 is online and create one query DECLARE i number(36):=1; begin while(i<10000000) loop dbms_output.put_line(i); i:=i+1; end loop; end;
i executed above query for test and i made relocate database using srvctl utility to dbtest02 machine.
session is relocated successfully with new session id...above query getting stop in 25000 itself. i want to make it continue that process..also i tried to find Omotion utility in all the path.. couldn't find it... where will it be.. i want to relocate all the session without losing work.
from application i am getting disconnect after relocation.. application server need to restart to get work again...
information on this listener.ora parameter and the endpoints file? There is no reference in the docs (except for a sample listener.ora file in the RAC Installation Guide, no explanation).
Following a clusterware with gPNP installation, the listener.ora file has only IPC addresses, plus this parameter:
LISTENER=(DESCRIPTION=(ADDRESS_LIST=(ADDRESS=(PROTOCOL=IPC)(KEY=LISTENER))))# line added by Agent LISTENER_SCAN3=(DESCRIPTION=(ADDRESS_LIST=(ADDRESS=(PROTOCOL=IPC)(KEY=LISTENER_SCAN3))))# line added by Agent LISTENER_SCAN2=(DESCRIPTION=(ADDRESS_LIST=(ADDRESS=(PROTOCOL=IPC)(KEY=LISTENER_SCAN2))))# line added by Agent LISTENER_SCAN1=(DESCRIPTION=(ADDRESS_LIST=(ADDRESS=(PROTOCOL=IPC)(KEY=LISTENER_SCAN1))))# line added by Agent ENABLE_GLOBAL_DYNAMIC_ENDPOINT_LISTENER_SCAN1=ON# line added by Agent ENABLE_GLOBAL_DYNAMIC_ENDPOINT_LISTENER_SCAN2=ON# line added by Agent ENABLE_GLOBAL_DYNAMIC_ENDPOINT_LISTENER_SCAN3=ON# line added by Agent ENABLE_GLOBAL_DYNAMIC_ENDPOINT_LISTENER=ON# line added by Agent
The endpoints_listener.ora file specifies the fixed and VIP addresses of the public NIC:
LISTENER_GR7244=(DESCRIPTION=(ADDRESS_LIST=(ADDRESS=(PROTOCOL=TCP)(HOST=10.196.182.201)(PORT=1521))(ADDRESS=(PROTOCOL=TCP)(HOST=10.196.180.44)(PORT=1521)(IP=FIRST))))# line added by Agent
The listener named LISTENER is in fact listening on both its IPC address, and the addresses in the endpoints_listener.ora file:
[grid@gr7244 admin]$ lsnrctl status listener LSNRCTL for Linux: Version 11.2.0.1.0 - Production on 02-APR-2010 04:52:02 Copyright (c) 1991, 2009, Oracle. All rights reserved. Connecting to (DESCRIPTION=(ADDRESS=(PROTOCOL=IPC)(KEY=LISTENER))) STATUS of the LISTENER
[code]...
The scan listener on this node is listening on its IPC address, and its VIP:
[grid@gr7244 admin]$ lsnrctl status listener_scan3 LSNRCTL for Linux: Version 11.2.0.1.0 - Production on 02-APR-2010 04:46:15 Copyright (c) 1991, 2009, Oracle. All rights reserved. Connecting to (DESCRIPTION=(ADDRESS=(PROTOCOL=IPC)(KEY=LISTENER_SCAN3))) STATUS of the LISTENER ------------------------ Alias LISTENER_SCAN3
[code]...
I did wonder if this parameter and file could be part of the mechanism whereby a listener discovers the DHCP assigned VIPs on which it has to listen?
I have the following problem on a 10.2.0.4 Oracle on AIX 1.6...
I have 2 RAC nodes as the node # 2 goes down, the VIP migrated correctly to the node # 1, but the listener # 1 do not see the change, and just resolve to the local ip.
The same does not apply in the reverse case, when it drops the node N 1, the listener attends to the fallen VIP node and migrated.The configuration is correct and identical in both nodes, according to the documentation, but I can not find a reasonable answer.
IP node # 1. scm1or01 192.68.60.11 scm1or01-VIP 192.68.60.13
IP node # 2 scm1or02 192.168.60.12 scm1or01-VIP 192.168.60.14
Below I write as I detect the problem: when scm1or02 is down:
I'd like to call an existing function/procedure from a resource template. For example, I have a procedure called 'rest' with an out parameter of 'p_out' - how do I use this within a resource template?
At the moment I have defined the template as type 'PL/SQL Block' and with the 'GET' defined as:
begin myschema.rest(:p_out); end;
APEX_PUBLIC_USER has been granted 'all' on the procedure. The p_out is populated with a piece of text.
When I call this resource, I get a '500 Internal Error' returned. I've tried adding p_out as an X-APEX-FORWARD parameter, but nothing seems to work.
I am using oracle 11.2.0 in linux platform.i have created a listener for the asm database. and i am using non default port of 1525 whenever i go for lsnrctl>status always shows for the port 1521. i don't want the default port 1521 and i have changed the local listener as listener1 with port 1525 protool tcp in spfile and registered with the asm database.Is there any option to change the default listener as listener1.
also,everytime when i give lsnrctl>show current_listener it is showing "listener"
i have set the current-listener to listener1 and save_config listener1 and reloaded.After exit and enter lsnrctl>status it will show for port 1521 When i attempt to start listener1 every time. it will prompt listener1 is already running.
I have applied offline patch *10417948* on my database. How can see that patch applied on database/OH or not? I have applied one online patch few months ago....in that i have applied that patch on each database after installing it...using command :
when i execute a command opatch lsinventory -details i got the following output :
+Interim patches (2) :
Patch 10417948 : applied on Sat Feb 23 13:42:49 IST 2013 Unique Patch ID: 14586154 Created on 18 Oct 2012, 06:52:32 hrs PST8PDT Bugs fixed: 10417948 [code].......
For offline patch is it required to enable patch on every database?
I want to create offline database. there is one custom application i designed but for that need to use internet.
some time there is internet fluctuation. so i want offline db concept to implement . In a day once inter net connect data will get upload and centralize. is it possible by using OAF or ADF..?
In one of our RAC envrionment, we have more than 15 databases in a server running in AIX Operating system.the Listener file I am able to find only one entry (SID). But while trying to execute lsnrctl status it displays all the 15 SIDs in the list hosted in the ser ver. Not sure how it works?
As we created another one new database in the database, where i need to add this SID in the listener.ora file to reload the listener.
I started database in mount state;startup mount; alter tablespace users offline;
I tried to make tablespace offline In another case online but showing error database not open same for command alter tablespace begin backup; do think we can make tablespace offline in mount...
If I am not using data of many partitions in any way, will it affect my performance if I am firing select query that uses other/active partitions data.
How can I check when that partitioned was last accessed, also can I brought those inactive partitions offlie? If we can, what will be the advantages or disadvantages of that?
In an attempt to take older data off line and allow database refreshes to be faster, tablespaces associated with partitioned table data for a given time period was taken off line, leaving only tablespaces that relate to the current time period online. In effect, tablespaces related to 2010 and earlier were taken offline from a table.
1. Without giving a filter on the partition key (the business date) to scan for data greater than the dates in the off lined tablespace partition, we get a ORA-376/ORA-1110 error (data file cannot be read at this time).
2. Materialized views using fast refresh or refresh on commit, will also not work because of the partitions being off line.
Queries directly querying the tables are manageable from an application point of view.But the materialized views failing to aggregate is a bigger problem.
how we can manage this situation? I know that I can move the partitions to a different table in a tablespace to be taken off line. But if possible, we wanted to solve this without doing a move partition.
We got a request to take offline for few unused partitions and move it to a another drive (lease used).Please set the following partitions offline in PreProd:
I have created an user named "Raja" with a default tablespace as "Raja_TBS" along with a datafile "rajadata.dbf". I have taken the tablespace offline
SQL> alter tablespace raja_tbs offline;
Tablespace Altered. when I take a tablespace offline, which means I cannot read or write and the tablespace is currently unavailable for users. I am still able to create a table on the "Raja_TBS" while it is offline.
I am exploring the options for file based databases for offline applications where there are no overheads of database installations. We have a system which has Oracle database with more than 500 tables. We need to write a lightweight application (offline) in .net which will run from USB drive and write data to USB drive only.
Existing system has a data layer which writes data to Oracle 10g Enterprise Edition database. The offline application will have more or less similar data entry forms and storage structure. In order to reuse data layer of existing system (stored procedures) can the Oracle Lite be used as a database which can run from USB drive?
I understand Oracle Lite has a suport for synchronization with the server (our main database in this case) by which data can be synchronized with minimum overheads. How the Oracle Lite is licenced if I have 300 odd users of this offline applications. I need to use only database part of Oracle Lite and not mobile server.
i'm facing a problem while i'm inserting millions of record from table to table that undo tablespace reach 100% full and execution aborted. , how can free the undo tablespace ??? many of extendes are offline. will it flush automatically ??? or what i should do
We have many many APEX applications in APEX 3.0 running on a 10.2.0.4 database that needs desperately to be upgraded. As a test, I've set up a clean 11gR2 database and copied the production APEX database into it via datapump. I set up APEX Listener, as I don't have any OAS sitting around and the EPG doesn't seem to be supported for APEX 3.0... the Listener doesn't say one way or the other.
When trying to log in, I get the login page, but it tries to reference files such as apex_get_3_1.js while I only have files such as htmldb_get.js in my images directory in production. I noticed it is looking for what appears to be 3.1 files instead of 3.0 files... which concerns me.
The APEX listener appears to be more than just a Java PL/SQL gateway.
Is there a minimum version of APEX the APEX Listener supports?
I have a doubt in RMAN. The scenario is: We take online backup on all days and offline backup on Sunday only. My question is do i need to copy the archives also in offline backup?
What happens when i shutdown the database (the database is in archivelog mode) and alter the database to be in noarchivelog and open the database to do offline backup.
I have a rather hard to trace problem which is keeping me up several days now. We want to implement a package for querying devices via SNMP in our database. There are no packages shipped with Oracle that come handy. UTL_TCP does not work because SNMP works via UDP. After all we came up with the idea to use URL.... Locally on my development machine and on the command line of the Oracle database our first prototype of the SNMP query function works very well, but inserted into the database all I'm getting is a "Request timed out". Firewall mechanisms can not be the problem because the java code runs smoothly on the command line and also a snmpwalk on the command line suceeds, so the database is not blocked by any firewall. First I thought some permission via Java are missing, but I took a look in the USER_JAVA_POLICY view and worked this with SYSDBA out. A java application in Oracle connection via TCP to port 80 and fetching a website works allright, the thing not working seems to be UDP.
I'm using Oracle10.0 as database for my project and I have installed Toad as front end tool for the Oracle. Now I want to access the database in the network using the Toad.
My question is, is it compulsory that oracle should be installed in every system to access Toad or any thing can I change in the server system to access the database from other systems in the Network.
I have created a batch for silent DB Creation through DBCA. I want to add a script to also create the Network Service after. I was told it can be done only with Response File.
Is a response file a script also that can be executed after the DBCA scripts? Where can I find a manual with the available commands so I can produce what I need? On the internet I find only examples for Silent DB installation.
edit-solution Complete Solution posted as New article
We want to replicate the data between the databases.We have 4 databases in a network.If there will be any change in database 1,e.g. updation in any table,it should automatically replicate on other 3 databases.or user will change something in database 2 ,it should replicate on other 3 databases and vice versa. All 4 databases have same schema and same configuration.
I have created a batch for silent DB Creation through DBCA. I want to add a script to also create the Network Service after. I was told it can be done only with Response File. Is a response file a script also that can be executed after the DBCA scripts?Where can I find a manual with the available commands so I can produce what I need? On the internet I find only examples for Silent DB instalation. EDITOS is Windows 7 Oracle 11.2.0.1 I want to create the Network Service that will add these lines to the tsnames.ora.
on both the client and the server.How can i do it automatically through a batch script, so to add it to DBCA scripts after creation? I was told once in atopic that it could be done through a response file.
As per my understanding connections should start to fail from client side after addition of these parameter on server side sqlnet.ora (no changes to client side sqlnet.ora).I am still able to connect to this server without connections getting failed.
I already checked aso is installed on this database.Just to add it is a RAC database with 2 nodes.
