Page 1 of 2
[Solved] Server Daemon needs UTF-8 Support
Posted: Thu Oct 11, 2012 10:10 pm
by houkouonchi
Does not record things correctly in the db for songs with foreign characters. Needs utf-8 support.
Re: Server Daemon needs UTF-8 Support
Posted: Sat Oct 13, 2012 11:49 am
by KandaRainbowsoul
It doesn't record Vocaloid Collaboration songs at all
Although...It should've recorded FLOWER TAIL (VCP 8) if it was just this yet it didn't...
Re: Server Daemon needs UTF-8 Support
Posted: Tue Oct 16, 2012 3:23 pm
by Angelo
Can anyone please confirm that my commit a733fb05534a24dc5073ce886725a7c5ce92919f is working?
I don't have any songs with special UTF8 characters in them.
Re: Server Daemon needs UTF-8 Support
Posted: Tue Oct 16, 2012 6:26 pm
by houkouonchi
Doesn't appear to have fixed anything. I suspect that the non UTF8 support is causing the weird color issue as well:
http://box.houkouonchi.jp/screen00240.jpghttp://box.houkouonchi.jp/smo_utf8.pngAlso an old bug with 3.95 has but its head into things again. Maybe the code just reverted somewhere? Gonna try re-adding the 3.95 support patch.
Re: Server Daemon needs UTF-8 Support
Posted: Tue Oct 16, 2012 6:41 pm
by houkouonchi
Ok so fixed the 3.95 bug using the same code as before IE:
if (User_Protocol == 2)
gsuCtr += 2;
Also played the song again on the live DB and the percentage is right
http://stepmaniaonline.net/index.php?pa ... &mid=14101The good news is I don't think this song was recording in the DB at all before because I know I have played it before.
Also I know UTF8 works on the site if its in the db as I have manually made my name in utf8 as a test and it displayed correctly on the site as 方向音痴
Re: Server Daemon needs UTF-8 Support
Posted: Tue Oct 16, 2012 7:02 pm
by foxfire667
Hasn't been fixed yet unfortunately.
I used a different pack, and was on SM 5 if it makes any difference. Figured two sources is better than one I guess:
Re: Server Daemon needs UTF-8 Support
Posted: Tue Oct 16, 2012 7:11 pm
by houkouonchi
I think this is more than just the connection to sqlite (although that might have been needed as well). I think the strings themselves need to be encoded as utf-8 for example:
http://stackoverflow.com/questions/8707 ... ng-to-utf8
Re: Server Daemon needs UTF-8 Support
Posted: Tue Oct 16, 2012 11:14 pm
by Angelo
Can anyone give me a download to a song with UTF-8 characters in them?
Also, Hou, can you please make a pull request on Github for that if it's not in the Git repo yet?
Thanks!
Re: Server Daemon needs UTF-8 Support
Posted: Wed Oct 17, 2012 12:13 am
by houkouonchi
Re: Server Daemon needs UTF-8 Support
Posted: Tue Nov 13, 2012 5:09 am
by Izzy
If the database is now using MySQL does that mean it has UTF-8 support? Or at least it is possible now?
Re: Server Daemon needs UTF-8 Support
Posted: Tue Nov 13, 2012 9:25 am
by houkouonchi
Re: Server Daemon needs UTF-8 Support
Posted: Thu Nov 15, 2012 1:38 am
by houkouonchi
Re: Server Daemon needs UTF-8 Support
Posted: Thu Nov 15, 2012 3:21 pm
by houkouonchi
Having a problem of the client disconnecting when its sent stuff with utf8 (not sure why). Until that gets worked out the not recording of some songs is still borked. However I am currently using a lame PHP workaround to reformat the data from the db and search strings so that it displays correctly on the site.
For example you can do a search like:
http://www.stepmaniaonline.net/index.ph ... =%E3%82%89which is song=ら
Re: Server Daemon needs UTF-8 Support
Posted: Thu Nov 15, 2012 5:24 pm
by Cube
Instead of changing the server code, we just changed the site code to decode the strings and print them correctly.
Houkouonchi finished making the changes to the site, and I finished the javascript to so the rooms pages print out correctly now as well.
Re: [Solved] Server Daemon needs UTF-8 Support
Posted: Sat Nov 17, 2012 4:24 am
by houkouonchi
Server now has utf8 support (daemon) and database is in utf8 native (atleast for songs, not for users). This should also fix the songs not being recorded in the db.
Re: [Solved] Server Daemon needs UTF-8 Support
Posted: Fri Nov 30, 2012 7:44 am
by Thumbsy
Playing again today... songs with foreign characters still fail to record, I checked my profile and none of the songs I played that have UTF8 characters in the artist and/or title field are displayed.

Re: [Solved] Server Daemon needs UTF-8 Support
Posted: Mon Dec 10, 2012 1:15 pm
by houkouonchi
Re: [Solved] Server Daemon needs UTF-8 Support
Posted: Mon Dec 10, 2012 1:25 pm
by Thumbsy
Re: [Solved] Server Daemon needs UTF-8 Support
Posted: Mon Dec 10, 2012 1:35 pm
by Cube
Re: [Solved] Server Daemon needs UTF-8 Support
Posted: Mon Dec 10, 2012 3:51 pm
by houkouonchi