Stored procedure for data importing from flat files. Need some tips.
I am currently working on creation of SP to automate the process of importing flat data into SQL Server. I want you to give me some useful advice on the best way how to realise, taking into account...
View ArticleBulk insert Error in SSIS 2005
Hi I am using SQL 2005 when I use BULK INSERT TASK IN SSIS I HAVE GOT ERROR AS SEE BELOW [Bulk Insert Task] Error: An error occurred with the following error message: "Cannot fetch a row from OLE DB...
View ArticleIs it possible to right trim a flat file when bulk inserting using an SSIS...
I've been tasked with modifying an SSIS package so that the flat files that are inserted into the database via a bulk insert are right trimmed. This is something new to me. The issue at hand is that...
View Articledirectly or indirect insertion in table
i have a powwershell script which saves output in csv format. now i have two options- either to import from csv file to sqlserver table or without creating a csv file, insert into table by sql command...
View ArticleLOADING file with special charectors and japaneese charectors
HI Group, I am trying to load a file japaneese and special charectors . problem is that japaneese will load when i convert my utf-8 file to utf-16 and bcp it (special charectors are not loading inthis...
View ArticleBulk Insert and non-local file via ODBC
Is it possible to use bulk insert operations where the local file is not on the server machine? ie: Program (perl script using ODBC) running on client machine creates temp text file and via ODBC...
View Articledatatype change
Im having table like 'TestTable' with 1.5Crores of records with some 18 indexes. TestTable has CHAR columns. So i need to change it to VARCHAR columns. So i am creating a new table TestTable_Stage...
View ArticleHow to handle SQL Server BCP bulk insert if extra fields come in data file...
I am using non-xml format file to perform bulk import from a data file. Format File: 12.0 4 1 SQLCHAR 0 7 "\t" 1 DepartmentID "" 2 SQLCHAR 0 100 "\t" 2 Name "" 3 SQLCHAR 0 100 "\t" 3 GroupName "" 4...
View ArticleHow to Quickly Bulk Insert JSON Data?
Hi there, I am trying to bulk insert a large batch of table stored JSON data into a separate table where each element has its own row. I am using a cursor for this bulk insert, illustrated below,...
View Articlemassive load
Hi , I have to load one text file of 6 million records once per month into a fact table has 200 Million records and a few indexes to make it usable. With a wizard loader , the load delays 24 hours...so...
View ArticleHow to create a Format File for a Bulk Insert
I have a series of fixed width text files. A sample of the data is given below. The files are originally given names such as xyzjob123456.678x. 320100000120170203 320100000320170203 320100000520170203...
View ArticleHow to build an XML format file for Bulk Insert
This is a coninuation of a previous question. I have since given up on finding a way to accomplish this task in a non-XML fashion. The non-XML is so much easier to comprehend for a novice but...
View ArticleBulk load Data Conversion error
First and foremost, I just want an understanding of this error so that when I encounter it in the future, I have a plan of action and can document something to someone who may not know SQL as well as I...
View ArticleUsing SQLDecimal in Format File for Bulk Insert
I am trying to execute a bulk insert in SQL using a non-XML format file. As long as decimals are not involved there is no problem. As soon as I input SQLNUMERIC or SQLDECIMAL, the errors begin. Below...
View ArticleHow can I BULK INSERT data from TEXT file without losing data after a NUL...
Hi SSC community, so from the title description I am trying to use the BULK INSERT command as well as BCP to get data in from a text file.The file is pipe delimited - here is a snippet.You can see the...
View Article