Server Administration :: ORA-29702 / Error Occurred In Cluster Group Service Operation
Aug 12, 2010
I have deinstalled Oracle database, ASM and oracle software. I installed the oracle software, ASM and database. I have seen the error in the ASM trace called
Errors in file /opt/oracle/admin/+ASM/bdump/+asm_gmon_10518.trc:
ORA-29702: error occurred in Cluster Group Service operation
ORA-29702: error occurred in Cluster Group Service operation
I'm calling a web service with HTTPS protocol from a pl/sql program and i'm using the UTL_HTTP package for do this.
I have a Oracle DB installation 11g Enterprise Edition Release 11.2.0.1.0 on my personal computer with a Windows XP OS, and when i run the code it works fine and returns the result I expect. But, when i run the same code on the Oracle DB of my work (Oracle 10g Enterprise Edition Release 10.2.0.4.0 and OS HP-UX) it fails and give me an error, i think that the error has to do with the configuration of the wallet and the certificates in it, because i consume the WS from Os prompt using the command WGET and works fine and i test consuming a WS with HTTP no secure and works fine too.
This is the code and the result in the Oracle DB 11g on my computer:
Connected to Oracle Database 11g Enterprise Edition Release 11.2.0.1.0 Connected as oe@oRCL
ORA-00607: Internal error occurred while making a change to a data block ORA-00600: internal error code, arguments: [4194], [89], [83], [], [], [], [], []
Microsoft Windows Server 2003 Standard Edition Service Pack 2
We have upgraded our database from 9.2.0.8.0 to 11.2.0.1.0 From past 5 months database working fine but on day before yesterday we got error in alert log as
Errors in file f:appdiag dbms rac rac race rac_ora_3732.trc (incident=41729): ORA-04030: out of process memory when trying to allocate 524812 bytes (kxs-heap-w,kllcqgf:kllsltba)
Process startup failed, error stack: Errors in file f:appdiag dbms rac rac race rac_psp0_5120.trc: ORA-27300: OS system dependent operation:CreateThread failed with status: 8 ORA-27301: OS failure message: Not enough storage is available to process this command. ORA-27302: failure occurred at: ssthrddcr
[code].....
we have increases/decrease the process and sessions and parameter,but it doesn't work.Right now i have to submit the RCA(Root Cause Analysis) report for the same.
i have setup the OEM-Dataguard in order to duplicate the DB instance from the primary to the standby DB in the standby server.At first I installed oracle server in Server A (Primary) created DB instance of SCT, in archivelog mode and then I install the oracle binary in Server B (standby) and made 2 servers ORACLE_HOME the same and also I installed OEM agents on the 2 servers and registered successfully to the OEM server.
I then used the dataguard to do the initial backup of the DB in server A and but when I specify the standby DB location, it prompt me the following error.
Error
Examine and correct the following error(s), then retry the operation. Remote Operation Error - Internal error occured
Add Standby Database: Database Location
Primary Database SCT Primary Host Ent Step 3 of 6
Standby Database
* Instance Name The instance name (also referred to as the SID) must be unique on the standby host. Database Storage File SystemRaw Devices Choose whether the database files will be put on a conventional file system or on raw devices.
Standby Host Credentials
Enter the credentials of the user who owns the Oracle installation in the Oracle Home selected below. * Username * Password
Standby Database Location
The standby database can be created in any Oracle Home that has been discovered by Enterprise Manager. Only Oracle Homes on hosts that match the operating system of the primary host are shown. Select the Oracle Home in which to create the standby database.
Search For Host Select Host Oracle Home Oracle Server Version Operating System Operating System Version Ent /u01/app/oracle/product/10.2.0/db_1 10.2.0.1.0 SunOS 5.10 Ent_standby /u01/app/oracle/product/10.2.0/db_1 10.2.0.1.0 SunOS 5.10
I have importing a dump file which is of size upto 6GB, its working fine. At the last step after the import of all the tables when it enables constraints , indexed and everything a pop-up window with the above mentioned error in the subject pops-up.
I am not able to mention the error exactly so find the screen shot as attachment.
When i try to compile a package, im getting below error.
ERROR at line 1:ORA-04021: timeout occurred while waiting to lock object
i gave below query and found the sid of object.
select * from v$access where object='THINKING_PKG'
From v$session view,i found sid and serial# and at same time i queried dba_jobs and saw one jobs is running at this time.Now how to compile this object.
In our development database, we have created 5 dimensions and a cube with 2 measures in OLAP. All these are mapped to relational tables. When we try to load this cube (MAINTAIN CUBE option from AWM) we are getting this below error:
An error has occurred on the server Error class: Express Failure Server error descriptions: INI: error creating a definition manager, Generic at TxsOqConnection::generic<BuildProcess> INI: XOQ-01600: OLAP DML error "ORA-35571: The maximum number of load errors has occured." while executing DML
[code].....
What are the database parameter i should look for as a DBA ?
I had added a new disk into disk group DATA1 with rebalance power of 5, it ran as estimated for about 2 days long, I can see the estimated time down to zero but the process never end.
The command used:
SQL> alter diskgroup DATA1 add disk '<path>' rebalance power 5;
Below is the disk status:
SQL> select group_number, disk_number, total_mb, free_mb, mount_status, header_status, state from v$asm_disk where group_number=1 order by disk_number;
GROUP_NUMBER DISK_NUMBER TOTAL_MB FREE_MB MOUNT_S HEADER_STATU STATE ------------ ----------- ---------- ---------- ------- ------------ -------- 1 0 1191626 314236 CACHED MEMBER NORMAL 1 1 1191626 314230 CACHED MEMBER NORMAL 1 2 1191626 314232 CACHED MEMBER NORMAL 1 3 1191602 314229 CACHED MEMBER NORMAL 1 4 1191626 314210 CACHED MEMBER NORMAL 1 5 1191626 314218 CACHED MEMBER NORMAL 1 6 1191626 314218 CACHED MEMBER NORMAL 1 7 1191602 314223 CACHED MEMBER NORMAL 1 8 1191626 314216 CACHED MEMBER NORMAL 1 9 1191626 314202 CACHED MEMBER NORMAL 1 10 1191626 314230 CACHED MEMBER NORMAL [code]....
I've checked and follow the status for a few days more, it still running with EST_MINUTES=0. I think it was hang and never end.During the next few weeks, I've manually restarted the rebalance process by modifying its power to 6, 8, 10
SQL> alter diskgroup DATA1 rebalance power 10;
After every restart, the diskgroup rebalance again but has the same issue, never end.Here is the content in the alert log
NOTE: starting rebalance of group 1/0x9d2529a0 (DATA1) at power 5 Starting background process ARB0 Fri Sep 16 12:01:11 2011 ARB0 started with pid=15, OS id=21066 Starting background process ARB1 Starting background process ARB2 Fri Sep 16 12:01:11 2011 [code]....
As you can see, the rebalance process started 3 days ago, hanging till now
SQL> select group_number, operation, state, power, est_minutes from v$asm_operation;
GROUP_NUMBER OPERA STAT POWER EST_MINUTES ------------ ----- ---- ---------- ----------- 1 REBAL RUN 5 0
on 6th of August at 02:36 our following cluster services were down,i see the logs and found that ASM is down and disk group are not accessible and ASMb process is terminated and both instances was restarted, i checked the cluster services so five services were down and these are
Quote: ora_ OCR_DG.DG, ora_fedb96.asm2.asm, ora_fedb96.gsd, ora_fedb96.ons and ora_fedb96.oc4j...
I restarted the services and they were successfully up and application become available . What can be the reason of the service failure?
alert.log
ORA-03113: end-of-file on communication channel Process ID: Session ID: 157 Serial number: 6655 ASMB (ospid: 23903): terminating the instance due to error 15064 Mon Aug 06 02:36:38 2012 NOTE: Deferred communication with ASM instance Errors in file /u01/app/oracle/diag/rdbms/grid12/grid91/trace/grid91_ora_25856.trc: ORA-15055: unable to connect to ASM instance ORA-01092: ORACLE instance terminated. Disconnection forced [code]...
I have been asked to look at making an existing Oracle server resilant. The technology I need to use are:
- Windows 2008 R2 Enterprise SP2 - Microsoft Cluster Services - Oracle Enterprise 11g release 2 - Oracle Fail-Safe (latest version available)
Unfortunately ApEX 4.1 and Mod_plsql are install on the existing stand-alone server. I'm afraid i know very little about Oracle and ApEX but i need to make a design decision and check fiesablilty.
I believe the HTTP service and Mod_plsql can be moved to a independant server which should work but ApEX itself must remian on the database server (i'm told).Will ApEX work in a MSCS setup? I can only find references to RAC support, RAC is out of scope.
While doing scanning of character set, error occurred in between.
Oracle Database 11g Enterprise Edition Release 11.2.0.1.0 - Production With the Partitioning, OLAP, Data Mining and Real Application Testing options
Current database character set is AL32UTF8. Enter new database character set name: > WE8MSWIN1252 Enter array fetch buffer size: 1024000 > Enter number of scan processes to utilize(1..64): 1 > Enumerating tables to scan...
. process 1 scanning REINS.RI_TD_EXECUTION_LOG[AAASwXAAAAABwkAAAA] . process 1 scanning INS.SERVICE_TRANSACTION_LOG[AAAS5hAAAAADWiAAAA] . process 1 scanning REINS.RI_TD_VOUCHER_DETAILS[AAASx+AAAAAC6KAAAA] . process 1 scanning REINS.RI_TT_VOUCHER_DETAILS[AAAS0OAAAAAAMiAAAA] . process 1 scanning CONFSYS.DML_AUDIT_LOG_FOR_DESIGNER[AAASnwAAAAAAsIAAAA] . process 1 scanning REINS.RI_TD_TRANSACTION_LOG[AAASx0AAAAACsoAAAA] [code]...
create a new DB service and apply the load , then I need to verify the service load from Enterprise Manager or table V$SERVICEMETRIC .
Below are what I did
Quote:I tried to add service in tnsnames.ora like below
SERVICE = (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(PORT=25057)(HOST=dadvmc))(CONNECT_DATA=(SID=tgc4)))
/************ Also I tried the serviceName like below, but not working when I conneted SALES1 from sqlplus SALES1 = (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(PORT=25057)(HOST=dadvmc))(CONNECT_DATA=(SERVICE_NAME=host.us.xxx.com))) **********/
and login as
sqlplus scott/tiger@SERVICE[/email][/email]
then lock table EMP in exclusive mode in two session.
I can see the load is added to service SYS$USERS , but I can't see the new service from V$SERVICEMETRIC or Enterprise Manager.
I have oracle8i database on windows 2008 but not a domin server now i have domin server and i want to join this server on domin network i try to join domin it fine but my oracle8i service did not start what to do ?
old hostname=bagmati afterchange hostname=bagmati.alkatel.org.np
I created a script to make my admin server a windows service. I successfully made it a service but when it starts it then shuts itself down. i ran a debug and found a error. I dont get what to do. I have tried changing the variables in the script and try it over and over again .....here is my script code and here is the error i got from debug output:
script
SETLOCAL set DOMAIN_NAME=FRClassicDomain set USERDOMAIN_HOME=C:/Oracle/Middleware/user_projects/domains/FRClassicDomain set SERVER_NAME=FRweblogic
On last Saturday we encountered error 'TNS-12519: TNS:no appropriate service handler found" in our listener log for some moment of time let say around 5mins and later it got all right itself.
It appears that the Oracle RAC cluster does not recognize the 'dba' group membership assignment to a user, unless it is assigned as the user's primary group.This also only affects newly created users, older users do not have this issue.
This affects us in the following way:
We are unable to create new cluster resources with the SAPCTL tool with the <sid>adm user.
When we try to create a resource using sapctl as the <sid>adm user we receive the following error:
CRS-0259: Owner of the resource does not belong to the group. SAP ABAP VIP creation failed.
The description of this error is that the resource owner (<sid>adm) is not a member of the group defined by 'osdbagrp' (what the cluster expects group membership for os users to control cluster resources), in our case this group is 'dba'.This is despite the user definitely being a member of the group.
Resource creation workaround:We are able to get around the resource creation by creating the resources either as root user, or by assigning 'dba' as <sid>adm's primary group.However, although we are able to control the VIP cluster resource, we are unable to control the other SAP enqueue resources as we assume that they need to be created by a user with 'sapsys' as a primary group (i.e. the resources do not start or it appears that there is not even an attempt to start the resources as there are no SAP startup logs created).
We have attempted multiple variations of creating and controlling cluster resources: changing <sid>adm primary group, changing cluster resource permissions, with nothing working for us.
The bottom line is that we need to be able to create these sapctl resources with a <sid>adm user that has 'sapsys' as a primary group while also being a member of the 'dba' group.
I have a problem some user modified the objects and now objects became invalid .How to trace the ip address and operating system username and service ip who modified the objects?
UDI-22303: operation generated ORACLE error 22303 ORA-22303: type "SYS"."DBMSOUTPUT_LINESARRAY" not found ORA-00600: internal error code, arguments: [kokaocr], [], [], [], [], [], [], [], [], [], [], [] ORA-06508: PL/SQL: could not find program unit being called: "SYS.DBMS_OUTPUT" ORA-06512: at line
The last week or so, the job has not ran. I finally got some time today to take a look and when I try to manually export the schemas, i get the following message after the first screen (where you choose Schemas and your credentials are entered)
Validation Error - Examine and correct the following errors, then retry the operation: Error - IO error occured.
A few weeks ago i changed the password for sysman and dbsnmp because the backups were not running and after i did that, they ran for a few nights. The only other thing is our system admin for the server changed some user access for the C:Oracle folder, but I still have full control.
I am in the ORA_DBA group and i have "Logon as batch job" selected for my account.
I read at one place to go to Preferences - Preferred Credentials and test the host username and password. When i do this i get the message : "Connection to server as user XXXXXXX failed" so I am thinking it has something to do with my user account, but not sure what i need to change.
I've a procedure and a trigger. The problem is when I call the proc from inside the trigger I get an error message saying that
Error: ORA-00604: error occurred at recursive SQL level 1 ORA-20001: Unhandled error occured! ORA-06512: at "ITEX.REFRESH_XSD", line 23 ORA-06512: at line 21
Here're these two problematic parts:
PROCEDURE: create or replace PROCEDURE Refresh_XSD(TableName IN varchar2) IS -- Variable declarations. XML_Schema xmltype; BEGIN
[code]....
So we have an xsd for a table only once. However that XSD needs to be refreshed when the table is altered, or created when the table is created. That's the reason I'm trying to use that trigger. If I comment out the procedure call from the trigger, everything works correctly except it does not do what needs to be done.
As far as I know only can't execute DDL statements from system triggers. But there's not a single DDL statement in there.