Skip to Content.
Sympa Menu

freetds - Re: [freetds] Conversion emoji symbols to UTF-8

freetds AT lists.ibiblio.org

Subject: FreeTDS Development Group

List archive

Chronological Thread  
  • From: Frediano Ziglio <freddy77 AT gmail.com>
  • To: FreeTDS Development Group <freetds AT lists.ibiblio.org>
  • Subject: Re: [freetds] Conversion emoji symbols to UTF-8
  • Date: Mon, 18 Apr 2016 11:16:36 +0100

2016-04-18 11:09 GMT+01:00 Velichko Yuriy <velichko.yuriy AT gmail.com>:
> With version 0.95.91 all works fine. looks like this issue was fixed
> earlier.
>
> Btw, when approximate date of release 1.0?
>

As usual... when ready :-)

I don't expect much RCs for 1.0. Usually for safety I wait at least
some weeks from last RC-released fix.

Frediano

> Regards.
>
> On 18 April 2016 at 10:05, Velichko Yuriy <velichko.yuriy AT gmail.com> wrote:
>
>> Ok, I will update freetds and tell you result.
>>
>> On 18 April 2016 at 00:19, Frediano Ziglio <freddy77 AT gmail.com> wrote:
>>
>>> Looks like an encoding bug. Time ago I fixed a similar issue.
>>> Could be you don't have this fix.
>>>
>>> Frediano
>>> On 17 Apr 2016 20:20, "Velichko Yuriy" <velichko.yuriy AT gmail.com> wrote:
>>>
>>> > Here some examples of query result:
>>> >
>>> > SELECT N'👍'
>>> > dbdatlen() == 4
>>> > "\x00\xFF\x91\x8D"
>>> >
>>> > SELECT N'тест 👍 test'
>>> > dbdatlen() == 18
>>> > "\xD1\x82\xD0\xB5\xD1\x81\xD1\x82 \x00\xFF\x91\x8D test"
>>> >
>>> > To store data and show it in UI I use Qt:
>>> > QString::fromUtf8();
>>> >
>>> >
>>> > On 17 April 2016 at 20:24, Frediano Ziglio <freddy77 AT gmail.com> wrote:
>>> >
>>> > > Can you post a small dump?
>>> > >
>>> > > You could try a simple query like
>>> > >
>>> > > SELECT N'hello some emoticons'
>>> > >
>>> > > Frediano
>>> > >
>>> > > 2016-04-17 13:19 GMT+01:00 Velichko Yuriy <velichko.yuriy AT gmail.com>:
>>> > > > 1 Data stored correctly because, for example SMSS shows emoji as
>>> > expected
>>> > > > 2 I use static db-lib
>>> > > > 3 Other unicode text is shown correctly
>>> > > >
>>> > > > On 17 April 2016 at 15:05, Frediano Ziglio <freddy77 AT gmail.com>
>>> wrote:
>>> > > >
>>> > > >> On 17 Apr 2016 12:59, "Velichko Yuriy" <velichko.yuriy AT gmail.com>
>>> > > wrote:
>>> > > >> >
>>> > > >> > I use UTF-8 charset according to docs:
>>> > > >> >
>>> > > >> > http://www.freetds.org/userguide/unicodefreetds.htm
>>> > > >> >
>>> > > >> > My .conf includes next rows:
>>> > > >> >
>>> > > >> > tds version = 7.0
>>> > > >> > client charset = UTF-8
>>> > > >> >
>>> > > >> > All worked as expected until the emoji symbol appeared in the
>>> data
>>> > > >> string.
>>> > > >> >
>>> > > >> > In result I got ??? symbols.
>>> > > >> >
>>> > > >>
>>> > > >> Data in the database are stored correctly?
>>> > > >>
>>> > > >> > If to try example from answer in this post (all string is emoji)
>>> > the
>>> > > >> > returned data from method dbdata() will be an empty string with
>>> non
>>> > > zero
>>> > > >> > lenght (about 60 for example).
>>> > > >> >
>>> > > >> > Here I have read
>>> > > >> > http://www.freetds.org/userguide/localization.htm
>>> > > >> > that not all symbols can be converted properly. Looks like this
>>> is
>>> > my
>>> > > >> case.
>>> > > >> >
>>> > > >> > But maybe some one faced with this problem and solved it with
>>> > FreeTDS?
>>> > > >> > Because using emoji is not rare case in our time.
>>> > > >> >
>>> > > >> > Maybe need to use another encoding, or something else?
>>> > > >> >
>>> > > >> > Thanks!
>>> > > >> >
>>> > > >>
>>> > > >> Are you using iconv correctly? Don't expect to work without it.
>>> > > >> Which library are you using?
>>> > > >> Does the output work correctly with utf8?
>>> > > >>
>>> > > >> Frediano
>>> > > >> _______________________________________________
>>> > > >> FreeTDS mailing list
>>> > > >> FreeTDS AT lists.ibiblio.org
>>> > > >> http://lists.ibiblio.org/mailman/listinfo/freetds
>>> > > >>
>>> > > >
>>> > > >
>>> > > >
>>> > > > --
>>> > > > С уважением, Величко Юрий.
>>> > > > _______________________________________________
>>> > > > FreeTDS mailing list
>>> > > > FreeTDS AT lists.ibiblio.org
>>> > > > http://lists.ibiblio.org/mailman/listinfo/freetds
>>> > > _______________________________________________
>>> > > FreeTDS mailing list
>>> > > FreeTDS AT lists.ibiblio.org
>>> > > http://lists.ibiblio.org/mailman/listinfo/freetds
>>> > >
>>> >
>>> >
>>> >
>>> > --
>>> > С уважением, Величко Юрий.
>>> > _______________________________________________
>>> > FreeTDS mailing list
>>> > FreeTDS AT lists.ibiblio.org
>>> > http://lists.ibiblio.org/mailman/listinfo/freetds
>>> >
>>> _______________________________________________
>>> FreeTDS mailing list
>>> FreeTDS AT lists.ibiblio.org
>>> http://lists.ibiblio.org/mailman/listinfo/freetds
>>>
>>
>>
>>
>> --
>> С уважением, Величко Юрий.
>>
>
>
>
> --
> С уважением, Величко Юрий.
> _______________________________________________
> FreeTDS mailing list
> FreeTDS AT lists.ibiblio.org
> http://lists.ibiblio.org/mailman/listinfo/freetds




Archive powered by MHonArc 2.6.24.

Top of Page