SQL Loader - Null Columns When Using Terminated And Optionally Enclosed Delimiters
Sep 25, 2012
I regularly upload various tab-delimited text data files with SQL Loader. The control files always specify TERMINATED BY X'09'. Certain columns in those data files may be null for some rows, i.e. there is no character between two subsequent tabs. It always works like a clock.
Now, I have run into a specific case where I have to strip a data column of double quotes that may or may not enclose the actual data (side effect of a text export from Excel).
I tried simply adding OPTIONALLY ENCLOSED BY '"' behind the terminated delimiter and it did work for the file and column in question. Still, with this new option, files with null values are no longer decoded correctly. The loader seems to simply skip those values, which provokes column shifts and results in either a corrupt load, or a load failure.
For now, I've got a workaround dropping the new option and executing an SQL script eliminating double quotes directly in the database, but that obviously cannot last.
View 3 Replies
ADVERTISEMENT
Jul 12, 2012
I have 8 columns. Some of them might be null.I want to display all 8 columns in my result. Not null columns will be first and null at the end.Here is a sample data :
Employee table :
Employee_id Emp_fname emp_lname emp_mname dept salary emp_height emp_weight
1 aaa ddd d1 100 6 180
2 bbb ccc 120 169
3 dfe d2 5.9 223
The expected result is :
result1 result2 result3 result4 result5 result6 result7 result8
1 aaa ddd d1 100 6 180
2 bbb ccc 120 169
3 dfe d2 5.9 223
View 8 Replies
View Related
Jul 16, 2009
I am using sql loader to load data to tables from tab delimeted files.
Here the problem is that the sql loader is not handling null values. If there is any null value in the flat file it is moving the field values to left and loading to the table. I am using NVL function to handle the null values, but it is not working.
My control file is:
LOAD DATA
INFILE 'C: da_poc_filesSQL_scriptsSourcefilesTRADEGLOBNODE1.TXT'
BADFILE 'C: da_poc_filesSQL_scriptsBadfilesTRADEGLOBNODE1.bad'
DISCARDFILE 'C:C: da_poc_filesSQL_scriptsDiscardfilesTRADEGLOBNODE1.dsc'
[Code]....
Source file is attached to this link For the attached file in the first record, tradedate value is coming in to tradeprice field
View 16 Replies
View Related
Sep 19, 2006
I have a table containing hundreds of columns and I would like to be able to qualify my select statements so that only those columns containing a value are returned. Something like:
Select (non null columns) from tablename where columnX = 'whatever'
View 7 Replies
View Related
Dec 17, 2010
We are working on a migration project and we need to move 75 million rows from source system to target system.
Total number of columns in source system - 90 cols.
Out of the 90 columns 10 cols are system fields and rest 80 are properties for each record.
We are required to migrate all system cols and some required properties. In total we will migrate around 25 columns[10+15] for each record.
Before actaul migration , we need to do a data cleansing activity and hence we move the data to a staging table.
To create the staging table, we considered the below appraoches.
1. Create the staging table with around 30 coloumns so as to fit the data from source system[map the columns based on datatype]
2.Create the staging table with actual columns[90 columns] and import only the required properties. The rest all columns will remain NULL.
Do the data cleansing and move to target system.
My question here is, if we go with approach 2, We will not mix the data, as there will be a one-to-one mapping. But many columns will not have data and remain NULL. Will it affect the performance since we deal with 75 million rows.
View 3 Replies
View Related
Sep 3, 2010
i am getting following error while trying to insert value into columns of table.
ORA-01400: cannot insert NULL into ("demo"."col1"."col2")
View 2 Replies
View Related
Apr 13, 2013
I have a repeating frame wich displays each item and its quantity and pricethe second frame is a fixed frame which will display the total and price after discount.both frames are enclosed in the same frame.I made space beteewn the two frames so the second frame always prints in the same placewhen I run the report the second frame appears in the second page and the first frame (items in invoice) appear in the first page.
I've tried to change the vertical and horizental properties of the frames but the report is still the same
View 6 Replies
View Related
Nov 10, 2010
I am experiencing somewhat same issue...but have been unable to resolve it(new to Oracle) I am getting the infile from flat file(data dump from SQL) using sqlldr to upload data to the Oracle table...since the data is already in the flat file...I cannot do anything in the SQL to pre-format the data...
Sample of ERROR I am getting - Column CREATE_DATE which has date and time - happens to other date time columns also if remove the CREATE_DATE from Control file(happens to every single line of record):
==========================================
Record 2: Rejected - Error on table LGCY_CHS.METS_CHS_USER_PRIV, column CREATE_DATE.
ORA-01841: (full) year must be between -4713 and +9999, and not be 0
[code]...
Flat file: (3 lines of data)
5|Annie|1|AR|84601D0A-6D9D-4D0F-86EB-2FDD9D7E680B|0|0|1|1|1|0|1|0|kgarbin|XPLTMCE01|2005-04-07 13:54:42.087|Annie|VAXP60|2008-10-03 16:54:59.583|2008-10-03 16:54:59.583
11|Beverly|1|BA|9A2D6304-E997-4B40-96E5-2221E521B077|1|0|0|1|0|0|0|0|kgarbin|XPLTMCE01|2005-04-07 13:54:42.087|BEVERLY|VAXP60|2008-10-03 09:39:33.973|2008-10-03 09:39:33.973
29|KGarbin|1|KG|B229FCF9-BED0-4E50-9804-83324B677C67|0|0|1|1|1|1|0|1|kgarbin|XPLTMCE01|2005-04-07 13:54:42.087|Gfoote|VAXP60|2008-09-08 10:05:01.690|2008-09-08 10:05:01.690
View 1 Replies
View Related
Jul 12, 2012
I have 8 columns. Some of them might be null.I want to display all 8 columns in my result. Not null columns will be first and null at the end.
Here is a sample data :
Employee table :
Employee_id Emp_fname emp_lname emp_mname dept salary emp_height emp_weight
1 aaa ddd d1 100 6 180
2 bbb ccc 120 169
3 dfe d2 5.9 223
The expected result is :
result1 result2 result3 result4 result5 result6 result7 result8
1 aaa ddd d1 100 6 180
2 bbb ccc 120 169
3 dfe d2 5.9 223
View 13 Replies
View Related
Dec 3, 2010
Next week I will be getting an input file which will contain over 1000 data columns to be loaded into ORACLE. It's about 6,400 characters in length.
My question is...has ever created a huge ctl file like this to be used for SQLLoader, using so many columns? I will be sending certain columns(data) to certain tables, so it's not just going into 1. It will be about 6 tables.
View 39 Replies
View Related
Nov 23, 2012
From the previous forums i came to know about the "FILLER" option to skip any columns from loading into table.
In my case,i have columns say: col1,col2,col3,col4.....coln
Here i want to load only col3 and col4 and skip rest of the columns.I don't want to use FILLER option for each "n" number of columns to be skipped.Instead is there any options to load only the required 2 columns.
View 1 Replies
View Related
Aug 29, 2012
I have the following query:
select col_1,col_9 from
book_temp b
where b.col_1 is not null
order by to_number(b.col_16)
;
What I want to add is the following:
COL_9
=====
NULL
A
B
NULL
C
D
E
F
NULL
G
I need to connect the NON-NULL rows to the preceding NULL row.
View 15 Replies
View Related
Jun 21, 2010
I am running a GROUP BY query on a few columns of enumerated data like:
select count(*), Condition, Size
group by Condition, Size;
COUNT(*) CONDITION SIZE
-------- ---------- --------
3 MINT L
2 FAIR L
4 FAIR M
1 MINT S
Well, let's say I also have a timestamp field in the database. I cannot run a group by with that involved because the time is recorded to the milisec and is unique for every record. Instead, I want to include this in my group by function based on whether or not it is NULL.
For example:
COUNT(*) CONDITION SIZE SOLDDATE
-------- ---------- -------- ----------
3 MINT L ISNULL
2 FAIR L NOTNULL
2 FAIR M NOTNULL
2 FAIR M ISNULL
1 MINT S ISNULL
View 9 Replies
View Related
Mar 16, 2011
I have a table which has a not null column. the column is date field. I am trying to change it to Null. But it is giving a error.
I am using below query.
ALTER TABLE T_test
modify (paid_to_date null)
View 9 Replies
View Related
Jul 27, 2012
I've got the following table:
ID.................Date...........................number...period.....termination
434473......2012-04-18 00:00:00.000...............6.......month(s)...end of month
443080......2012-02-26 00:00:00.000...............36......month(s).....end of quarter
Now it's getting complicated. Date is the start date of a contract.
I need to calculate a date when the contract can be terminated and must compare it with the current date. Lets take the first row. In column "termination" is the termination date. A contract can be terminated at "end of month" (I need to check the last day of a month. In order to get the real termination date we need to subtract the column "number".
example 30.01.2012 - 7 month = 30.06. 2011
The thing I can do it, but my logic works only if the date is in the same year. I've been thinking a lot...sql is not important first....Have you got a theoretical solution?
View 11 Replies
View Related
Oct 24, 2013
create table test
(
id int ,
dat date
)
/
I want to implement a business rule such as we have for each id at most 1 dat null. So, I've created this unique index on test.
create unique index x_only_one_dat_cess_null on test(id, case when dat_cess is null then 'NULL' else to_char(dat_cess, 'dd/mm/yyyy') end);
insert into test values (1, sysdate);
insert into test values (1, sysdate - 1);
insert into test values (1, null);
insert into test values (1, null);
-- -----
insert into test values (2, sysdate);
insert into test values (2, sysdate - 1);
insert into test values (2, null);
The 4th insert will cause an error and this is what I wanted to implement. OK. Now the problem is that for non-null values of dat, we can't have data like this
iddat
------------
124/10/2013
123/10/2013
123/10/2013
1
because of the unique index (the 2nd and the 3rd row are equal). So just for learning purposes, how could we allow at most one null value of dat and allow duplicates for non-null values of dat.
View 2 Replies
View Related
Jan 9, 2012
when i follow this steps mention on this website
[URL].........
to modify column from null to not null i got this error and on this website its show successful
my steps are
first i create a table
SQL> create table Stu_Table(Stu_Id varchar(2), Stu_Name varchar(10),
2 Stu_Class varchar(10));
Table created.
Then insert some rows into Stu_Table
SQL> insert into Stu_Table (Stu_Id, Stu_Name) values(1,'Komal');
1 row created.
SQL> insert into Stu_Table (Stu_Id, Stu_Name) values(2,'Ajay');
1 row created.
SQL> insert into Stu_Table (Stu_Id, Stu_Name) values(3,'Rakesh');
1 row created.
SQL> insert into Stu_Table (Stu_Id, Stu_Name) values(4,'Bhanu');
1 row created.
SQL> insert into Stu_Table (Stu_Id, Stu_Name) values(5,'Santosh');
1 row created.
SQL> select * from Stu_Table;
ST STU_NAME STU_CLASS
-- ---------- ----------
1 Komal
2 Ajay
3 Rakesh
4 Bhanu
5 Santosh
Table Structure is like this
SQL> Describe Stu_Table
Name Null? Type
----------------------------------------- -------- ----------------------------
STU_ID VARCHAR2(2)
STU_NAME VARCHAR2(10)
STU_CLASS VARCHAR2(10)
now when i try to modify this Stu_id column to not null its give me error.
SQL>ALTER TABLE Stu_Table MODIFY Stu_Id int(3)not null;
ALTER TABLE Stu_Table MODIFY Stu_Id int(3)not null
*
ERROR at line 1:
ORA-01735: invalid ALTER TABLE option
and when i try to add new column with not null its also gives me error
SQL> ALTER TABLE Stu_Table add C1_TEMP integer NOT NULL;
ALTER TABLE Stu_Table add C1_TEMP integer NOT NULL
*
ERROR at line 1:
ORA-01758: table must be empty to add mandatory (NOT NULL) column
View 6 Replies
View Related
Jul 18, 2012
I am trying user managed recovery using archived and redo log files. I had restored old cold backup, then copy latest control file, redo log files, and archived log files at actual locations. Now I tried to recover database using following steps.
Quote:
connect sys as sysdba
startup mount;
recover database;
auto
After applied some archived files, one of the archived file corrupted and recovery cancel due to error, then i shut down the database. Now i want to copy corrupted archived file from backup and run the recovery further. so my question that should i have to run recovery from the beginning or can i run the recover from the last status of the database.
View 3 Replies
View Related
Apr 28, 2011
The following error has occurred:
ORA-06550: line 26, column 30:
PL/SQL: ORA-06552: PL/SQL: Compilation unit analysis terminated
ORA-06553: PLS-320: the declaration of the type of this expression is incomplete or malformed
ORA-06550: line 7, column 6:
PL/SQL: SQL Statement ignored
I am getting the error when i run the below anonymous block. Historic_report_data has got plenty of columns and using only the columns that are in tb_Statement in the query. It is working fine if i use a table with same number of columns as tb_statement instead of historic_report_data.
DECLARE
v_cnt NUMBER:=0;
v_data_load_error EXCEPTION;
BEGIN
dbms_output.put_line('Reconciliation scripts');
dbms_output.put_line('Reconcile tb_bank_Account_month and report_hist_data');
[code]....
View 16 Replies
View Related
Jul 8, 2012
The RMAN backup is failing daily due the below issue..
RMAN-00571: ===========================================================
RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS ===============
RMAN-00571: ===========================================================
RMAN-03009: failure of backup command on t1 channel at 07/08/2012 02:10:38
RMAN-10038: database session for channel t1 terminated unexpectedly
database version : 10.2.0.4.0
RMAN Script :
run {
allocate channel t1 type 'sbt_tape'
parms 'ENV=(TDPO_OPTFILE=/u001/app/TDP/p0137x/tdpo.opt)'
format '%d_inc0_%U.rbck';
backup incremental level 0 database tag OPEN_INC0_DAY;
release channel t1;
}
View 1 Replies
View Related
Oct 13, 2006
We had a good working Oracle 8i (8.1.7) database on Windows 2000 (SP 2) Inter Xeon server. A large delete operation was
initiated (deletion of 931,000 records; around 400 MB) which failed in the middle with some error messages, i don't remember.
I should have specified a special rollback segment created for this transection, but i forgot to do it. After that oracle
gives the following error in SQL Plus after I try to log in (same msg even after several reboots)
ORA-01092: ORACLE instance terminated. Disconnection forced
Here is the log file,
Dump file C:oracleadminillingdumpillingALRT.LOG
Fri Oct 13 14:19:40 2006
ORACLE V8.1.7.0.0 - Production vsnsta=0
vsnsql=e vsnxtr=3
[Code]....
Notice that that the database mounts successfully on "startup mount dbname" but it terminates with the above error messages
immediately when I give the "alter database open" command from server manager. Directly giving the "startup open dbname"
command also gives the same error message and log file.
Some one recommended adding the following line to Init.ora file for the db (if some corruption in rollback tablespace has occured)
fast_start_parallel_rollback= false
You may have seen this line in the log file above. However, it has no effect on the database functioning.
View 2 Replies
View Related
Apr 7, 2011
while statrp database am gettion error message like
" ORA-01092:ORACLE Instance terminated. Disconnected forced"
alter log file:
Errors in file g:\oracle\product\10.1.0\admin\hrdev\udump\hrdev_ora_196.trc:
ORA-01578: ORACLE data block corrupted (file # 1, block # 57371)
ORA-01110: data file 1: 'G:\ORACLE\PRODUCT\10.1.0\ORADATA\HRDEV\SYSTEM01.DBF'
Error 1578 happened during db open, shutting down database
USER: terminating instance due to error 1578
Thu Apr 07 10:06:54 2011
Errors in file g:\oracle\product\10.1.0\admin\hrdev\bdump\hrdev_pmon_86\0.trc:
ORA-01578: ORACLE data block corrupted (file # , block # )
[code]....
View 3 Replies
View Related
Dec 9, 2012
I was install oracle forms 11g r2 on windows 7 64 bit and it's work fine , but when i install oracle forms 11g r2 on windows 7 32 bit when i run my form this error appear
FRM-93652: The runtime process has terminated abnormally.
i trace my code , when i use global variable it's cause the problem , but when i don't use it the form run perfectly .
View 3 Replies
View Related
Aug 31, 2011
We are migrating Forms from 9i to 11g and we have problems with Session Timeout.
1) We have this products instal: Oracle Database 11g Enterprise Edition Release 11.1.0.7.0 Forms 11 (Form Compiler) Version 11.1.1.4.0 (Production)
2) We compiled the forms using the parameter: compile_all=yes (Refer note: FRM-93652 When Migrating Forms from 9i/10g to 11g [ID 1053135.1])
3) We set the Timeout Parameters:
(Refer note: Description List For Parameters Affect Timeout In Webforms [ID 549735.1])
FORMS_TIMEOUT=30
HeartBeat=60
Session-Timeout=20
4) After 30 minutes we receive this error:
FRM-93652: The runtime process has terminated abnormally
And we should receive one of them:
FRM-92101 There was a failure in the Forms Server during startup.
FRM-92102 A network error has occurred.
View 2 Replies
View Related
Nov 4, 2013
I've modified a report and I am able to run the SQL from toad and executed with no errors and output the results as expected. The SQL from the report is calling a function from DB. I granted execute permisiion to public. when I run the report, it has o errors, the result were fine. However, when another user run the report, it get the the following error.
Terminated with error:
REP-300: "GET_NSCL_TOT": invalid identifier
to_char ==> (get_NSCL_Tot('NFL',to_date(:period_end_date,'DD-MON-RRRR'),'1'),'999999.99')||','col2
View 3 Replies
View Related
Jan 31, 2012
i got an error while creating database manually
View 26 Replies
View Related
Mar 29, 2012
I create a manual database "jaimaa" on windows 7 as
Microsoft Windows [Version 6.1.7600]
Copyright © 2009 Microsoft Corporation. All rights reserved.
C:\Users\SARASWATIMAA>SET ORACLE_SID=JAIMAA
C:\Users\SARASWATIMAA>SQLPLUS
SQL*Plus: Release 10.2.0.1.0 - Production on Thu Mar 29 23:19:31 2012
Copyright © 1982, 2005, Oracle. All rights reserved.
Enter user-name: SYS AS SYSDBA
Enter password:
Connected to an idle instance.
SQL>
SQL> STARTUP NOMOUNT
ORACLE instance started.
Total System Global Area 117440512 bytes
Fixed Size 1247588 bytes
Variable Size 58721948 bytes
Database Buffers 50331648 bytes
[Code].....
View 1 Replies
View Related
Dec 6, 2012
When i do run export command through command prompt, its shows below error.
Microsoft Windows XP [Version 5.1.2600] (C) Copyright 1985-2001 Microsoft Corp.
C:Documents and SettingsAdministrator>Exp disdeva/disa123@distesta file=D:DAI LY_BACKUPdistesta.dmp log=D:DAILY_BACKUPdistesta.log statistics=none buffer=5 000000 owner=distesta
Export: Release 10.2.0.3.0 - Production on Thu Dec 6 15:06:21 2012
Copyright (c) 1982, 2005, Oracle. All rights reserved.
Connected to: Oracle Database 10g Release 10.2.0.3.0 - Production Export done in WE8MSWIN1252 character set and AL16UTF16 NCHAR character set
server uses AL32UTF8 character set (possible charset conversion)
About to export specified users ...
EXP-00010: DISTESTA is not a valid username Export terminated successfully with warnings.
C:Documents and SettingsAdministrator>
When i connect from sqlplus, it doesn't give any erro. What could be the reason?
SQL> conn disdeva/disa123@distesta
Connected.
SQL>
View 8 Replies
View Related
Mar 18, 2013
I have a flat file (student.dat delimiter %~| ) using control file (student.ctl) through sql loader. Here are the details.
student.dat
student_id, student_firstname, gender, student_lastName, student_newId
101%~|abc%~|F %~|xyz%~|110%~|
Corresponding table
Student (
Student_ID,
Student_FN,
Gender,
Student_LN
)
How do i map student_newId field to student_id field in STUDENT DB table so that new id should be inserted in student_id column. How do i specify the mapping in control file. I dont want to create a new column in student table. In control file i will specify the below, Is this a best approach?. Do we have any othe way?
STUDENT_ID *(:STUDENT_NEWID)*,
STUDENT_FN,
GENDER,
STUDENT_LNAME,
STUDENT_NEWID BOUNDFILLER
View 1 Replies
View Related
Sep 14, 2012
SQL> startup mount
ORACLE instance started.
Total System Global Area 905969664 bytes
Fixed Size 1293720 bytes
Variable Size 520094312 bytes
Database Buffers 377487360 bytes
Redo Buffers 7094272 bytes
Database mounted.
SQL> alter database noarchivelog;
Database altered.
SQL> alter database open; alter database open
ERROR at line 1: ORA-00603: ORACLE server session terminated by fatal error
View 3 Replies
View Related
