FreeTDS Development Group

["Li, Maggie (IT)" <Maggie.Li AT morganstanley.com>]

> Then I split the file into 0.8 million rows each piece, and everything
gets bcped and nothing is missing.

I take that back, I just finsihed running it again, still one row is
missing.

The message is 

Msg 20049, Level 4
Data conversion resulted in overflow.

What could potentially cause this msg? bad data?

Thanks,
Maggie

-----Original Message-----
From: freetds-bounces AT lists.ibiblio.org
[mailto:freetds-bounces AT lists.ibiblio.org] On Behalf Of Li, Maggie (IT)
Sent: Tuesday, December 06, 2005 3:39 PM
To: FreeTDS Development Group
Subject: Re: [freetds] freebcp file limit

I don't think it's the data files problem since all data files are
process the same way and the ones that's smaller than 11 million rows
works just fine.

For the same file, I have splitted into 3 files, first 2 with 4 million
rows and the 3rd one with wahtever is left.  The first 2 files gets
bcped just fine to the database, but the last file misses 1 row (out of
2.8 million rows).  

Then I split the file into 2 million rows each piece, the last piece
still misses 1 row.

Then I split the file into 0.8 million rows each piece, and everything
gets bcped and nothing is missing.

Since usually these processes take a long time to finish, I don't stare
at the screen constantly, but it did occure one time when I was
freebcping the 3 4 million rows files, during the last file, in the mist
of all the bulk-copied successfully message, there is a "arithmic
overflow" message somewhere.  

Thanks,
Maggie

-----Original Message-----
From: freetds-bounces AT lists.ibiblio.org
[mailto:freetds-bounces AT lists.ibiblio.org] On Behalf Of Lowden, James K
Sent: Tuesday, December 06, 2005 3:08 PM
To: FreeTDS Development Group
Subject: Re: [freetds] freebcp file limit

> From: Li, Maggie (IT)
> Sent: Tuesday, December 06, 2005 1:49 PM
> 
> I believe I used the 0.63 this time:
...
>   $Id: freebcp.c,v 1.34.2.1 2005/02/03 09:39:14 freddy77 Exp $

Yes, you do.  

> Out of 11 million something rows, freebcp finished with no
segmentation
> fault, but only close to 6 million rows copied.  Anyone can think of 
> any reason why?

Very peculiar.  I actually had that very same thing happen to me with
Microsoft's library.  Turned out the target table had a computed column
defined for it.  I don't know why, but the server accepted every other
row.  

See if you can load 100 rows.  Check your DDL, and check your datafile
with a hex editor to make sure it's delimited exactly as you want (not,
say, with an extra CR before the linefeed).  There's no reason that 100
rows should load successfully and 100 million rows not.  

If the first 100 rows work, try the last 100, and a middle chunk.  It's
something in either the data or the server; it would be a miracle if
FreeTDS could somehow succeed in skipping some rows.  It's hard enough
to parse and load them, let alone dropping some bytes and not upsetting
the protocol.  

If you can narrow down the problem and isolate it to freebcp, I'd be
happy to look at it.  

HTH.

--jkl

-----------------------------------------
The information contained in this transmission may be privileged and
confidential and is intended only for the use of the person(s) named
above. If you are not the intended recipient, or an employee or agent
responsible for delivering this message to the intended recipient, any
review, dissemination, distribution or duplication of this communication
is strictly prohibited. If you are not the intended recipient, please
contact the sender immediately by reply e-mail and destroy all copies of
the original message. Please note that we do not accept account orders
and/or instructions by e-mail, and therefore will not be responsible for
carrying out such orders and/or instructions.  If you, as the intended
recipient of this message, the purpose of which is to inform and update
our clients, prospects and consultants of developments relating to our
services and products, would not like to receive further e-mail
correspondence from the sender, please "reply" to the sender indicating
your wishes.  In the U.S.: 1345 Avenue of the Americas, New York, NY
10105.
_______________________________________________
FreeTDS mailing list
FreeTDS AT lists.ibiblio.org
http://lists.ibiblio.org/mailman/listinfo/freetds
--------------------------------------------------------

NOTICE: If received in error, please destroy and notify sender.  Sender
does not waive confidentiality or privilege, and use is prohibited.
_______________________________________________
FreeTDS mailing list
FreeTDS AT lists.ibiblio.org
http://lists.ibiblio.org/mailman/listinfo/freetds
--------------------------------------------------------

NOTICE: If received in error, please destroy and notify sender.  Sender does 
not waive confidentiality or privilege, and use is prohibited.