[SOLVED] SQLite + ListView [chars encoding problem]

Index > Windows > [SOLVED] SQLite + ListView [chars encoding problem]

Author

Thread

ctl3d32

Joined: 30 Dec 2009
Posts: 206
Location: Brazil

ctl3d32 21 Jun 2017, 18:16

Hey there!

Need some help fixing this code snippet, for it is displaying wrong chars in listview.

Thanks,
ctl3d32

Description:	source code + database files	Download
Filename:	listview.zip
Filesize:	2.67 KB
Downloaded:	564 Time(s)

Last edited by ctl3d32 on 22 Jun 2017, 00:28; edited 1 time in total

21 Jun 2017, 18:16

revolution
When all else fails, read the source

Joined: 24 Aug 2004
Posts: 20761
Location: In your JS exploiting you and your system

revolution 21 Jun 2017, 19:17

From what I can tell your basic problem is to convert from the UTF8 encoding stored in the DB into a 'wide' UCS2 encoding for Windows.

So you'll need three changes.

0. Instantiate a 'wide' version of the LVI structure.
1. Make a UTF8-to-wide converter function. Windows doesn't provide one by default but the code for it should be quite simple. Read each UTF8 character and do a bit of bit shifting to create the 2-byte 'wide' characters.
2. Call the wide version of SendMessage to insert the converted text.

Code:

invoke SendMessageW,[hListView],LVM_INSERTITEM,0,lviW

21 Jun 2017, 19:17

ctl3d32

Joined: 30 Dec 2009
Posts: 206
Location: Brazil

ctl3d32 21 Jun 2017, 21:36

Thanks revolution. Gonna try that.

21 Jun 2017, 21:36

ctl3d32

Joined: 30 Dec 2009
Posts: 206
Location: Brazil

ctl3d32 22 Jun 2017, 00:20

revolution wrote:

From what I can tell your basic problem is to convert from the UTF8 encoding stored in the DB into a 'wide' UCS2 encoding for Windows.

So you'll need three changes.

0. Instantiate a 'wide' version of the LVI structure.
1. Make a UTF8-to-wide converter function. Windows doesn't provide one by default but the code for it should be quite simple. Read each UTF8 character and do a bit of bit shifting to create the 2-byte 'wide' characters.
2. Call the wide version of SendMessage to insert the converted text.
Code:
invoke SendMessageW,[hListView],LVM_INSERTITEM,0,lviW    

Actually, windows has a UTF8-to-wide and a wide-to-Multibyte converter. I used them and i got it working. No need to use SendMessageW.

Changes in the code are shown below:

Code:

        ;+++++++++++++++++++++++++++++++++++++++++++++++++

        invoke  RtlZeroMemory,szBuffer,MAX_PATH
        invoke  RtlZeroMemory,szBuffer2,MAX_PATH

        mov     dword[lvi + LV_ITEM.iItem],9999d
        cinvoke sqlite3_column_bytes,[hStmt],0
        mov     [ibytes],eax
        cinvoke sqlite3_column_text,[hStmt],0

        invoke  MultiByteToWideChar,CP_UTF8,0,eax,[ibytes],szBuffer,MAX_PATH
        invoke  WideCharToMultiByte,CP_ACP,0,szBuffer,[ibytes],szBuffer2,MAX_PATH,NULL,NULL

        lea     eax,[szBuffer2]
        mov     [lvi + LV_ITEM.pszText],eax
        invoke  SendMessage,[hListView],LVM_INSERTITEM,0,lvi
        jmp     @b

        ;+++++++++++++++++++++++++++++++++++++++++++++++++

Thanks

Description:	Updated Source Code	Download
Filename:	ListView_Example.ASM
Filesize:	6.82 KB
Downloaded:	581 Time(s)

22 Jun 2017, 00:20

revolution
When all else fails, read the source

Joined: 24 Aug 2004
Posts: 20761
Location: In your JS exploiting you and your system

revolution 22 Jun 2017, 07:57

ctl3d32 wrote:

Actually, windows has a UTF8-to-wide and a wide-to-Multibyte converter. I used them and i got it working.

Okay, good to know.

ctl3d32 wrote:

No need to use SendMessageW.

Okay, if the current code page supports all the characters you are using. But you limit your total characters to 256. If a user wants to use Chinese or Korean or something then there might not be an equivalent character available within the 256 set in the current code page.

22 Jun 2017, 07:57

< Last Thread | Next Thread >

Forum Rules:

You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
You cannot attach files in this forum
You can download files in this forum