FreeTDS Development Group

[Eli Finkelshteyn <vengeanceofalf AT gmail.com>]

David: Thanks! That's exactly what I was looking for!

Frediano: An unpatched version of FreeTDS? I downloaded the latest stable
build from the site a few days ago, so I'd be surprised if that's the case.
Also, we're talking about a column that has all sorts of crap data in it.
People evidently copy and pasted into the program that populated that
column, and the program evidently had no error checking, so now that column
has overlapping code points from cp1252, cp1254, and a bunch of other random
foreign encodings. I'd be very surprised if FreeTDS correctly checked the
encoding and ran separate conversions on each individual value in the
column. I'd also imagine that would be terribly time consuming and wasteful
of resources, so I kind of hope that's not happening.

On Tue, Nov 16, 2010 at 8:46 AM, Frediano Ziglio <freddy77 AT gmail.com> wrote:

> 2010/11/15 Eli Finkelshteyn <vengeanceofalf AT gmail.com>:
> >  Hi David,
> > Unless I'm missing something, this seems like the same advice I've seen
> in
> > other places. It's not helpful to me because I'm already using "Client
> > Charset = UTF-8." This does not, and should not solve my problem as this
> can
> > only convert characters into UTF-8 that are correctly encoded in the
> > database. In my case-- and this is my main problem-- I have a char field
> > (note: chars are supposed to hold ASCII characters and nothing else) that
> > has cp1252 inserted into it. Because of this, when FreeTDS grabs data
> from
> > that field, assumes it's ASCII, and tries to convert it to UTF-8, it
> blows
> > up since some of those cp1252 code points don't exist in UTF-8 (i.e. code
> > point 253-- a y with an accent sign-- among others).
> >
>
> No, FreeTDS does not assume the server encoding (at least not on
> mssql), it KNOWS the server encoding. Perhaps you are using a non
> patched version which doesn't detect correctly cp1252 (using iso8859-1
> instead).
>
> freddy77
> _______________________________________________
> FreeTDS mailing list
> FreeTDS AT lists.ibiblio.org
> http://lists.ibiblio.org/mailman/listinfo/freetds
>