Wt

Hi Wim,

Developing on Opensuse 12.3, and running the http server from there too.

The database backend is mysql and is installed on CentOS 6.3

I've just quickly tried putting some of the problem characters directly into a WText

root()->addWidget(new WText(WString::fromUTF8("(aka "symmetric mode")\")));

The problem characters being the special quotation marks ""

That shows fine in the page oddly enough...

We are saving the string in the database as a Wt::WString.

I'm now wondering whether the issue could be due to some slightly convoluted string conversion, where we basically do -

Some manipulation within QString and QByteArrays.

Save into a Wt::WString via WString::fromUTF8(QString().toUtf8().data()) or WString::fromUTF8(QByteArray().data())

Where if it is in a QByteArray, it's definitely utf8 encoded characters.

We then save that WString into the database - where this all looks fine when we use an mysql tool to view the database.

We then retrieve the WString from the database, and convert back into QString, using QString::fromUtf8(WString().toUTF8()), do some manipulation, and then finally convert it back into a WString using the method above, and set the WText->setText() with it.

As I say, a little complex, but having debugged at all stages of conversion - it looks like the utf8 encoding is being maintained, though maybe you can spot something there that we're doing wrong.

Regards,

Edwin

That looks good. What do you see, what kind of 'incorrect' display do you have?

Can you check if your mysql database is configured to store UTF8?

SHOW VARIABLES LIKE 'collation%';

SHOW VARIABLES LIKE 'character_set%';

To convert an existing database I use this method:

http://stackoverflow.com/questions/6115612/how-to-convert-an-entire-mysql-database-characterset-and-collation-to-utf-8

ALTER DATABASE databasename CHARACTER SET utf8 COLLATE utf8_general_ci;

ALTER TABLE tablename CONVERT TO CHARACTER SET utf8 COLLATE utf8_general_ci;

BR,

Wim.

Yeah, the database is using utf8 encoding for both.

where the text should be (aka "symmetric mode")

it's being displayed as (aka “symmetric mode”)

Regards,

Edwin

Hi Wim,

Just found the cause of the issue, it was a problem with our conversion, there was one place where we were reading from a QByteArray and placing into a QString, but not calling QString::fromUtf8().

Sorry for the false alarm, and thanks for the help!

Regards,

Edwin