Understanding the HOTDOG files on DVD of California electronics

View: Old framed views
125 Messages — Rating Filter:   Alert me  
Understanding the HOTDOG files on DVD of California electronics - This topic is initiated by the "FAQ": How to Create Midi Disc To Play On Karaoke Player? The discussion came to... Loading...
I'm thinking of returning the analysis back to HOTDOG00. woid, Based on your latest finding there is a difference of... Loading...
I have found out something about the HOTDOG00.DAT file: Starting from address 0x0200 in the file there seems to be a... Loading...
Well done! I think this is the break through. The first 4 bytes of each data block is indicating a value (~15-50k)... Loading...
I dont think the the second 4 bytes is the song ID, because some song entries have the same second 4 bytes (byte... Loading...
I agree with you (after having a closer look). I'll take over the MIDI part because I've internsively worked with MIDI... Loading...
dvd2midi.zip Here is my script for generating MIDI file. I know that what you hear is still not a song, but something... Loading...
DVD2MIDI (script updated) - dvd2midi.zip It sounds better now, but still far from perfect. Btw, I simply put a tempo in the MIDI file because... Loading...
I have tried to merge your converter with my song entry reader. I removed the main() functions and put in a separate... Loading...
Re: DVD2MIDI (fixed !!!) - Still not all MIDI events are handled correctly. dvd2midi.zip Loading...
I have updated dvd2Midi to also apply the XOR mask (output to a *.dat file) and map the characters to ascii (output to a... Loading...
Here is a new version of dvd2Midi. I realised that the 0/0a byte affects the mapping so this version use different... Loading...
Here is the new version of dvd2Midi that will convert the lyrics to readable ASCII!!! Dvd2Midi.zip Loading...
I have done some updates to Dvd2Midi. The main changes is the format of the outputfiles. Dvd2Midi.zip The program... Loading...
Re: DVD2MIDI (see Facts & Summary) - I put a cross reference under Facts & Summary to make it easier to be found. Any update of the tool will go to the new... Loading...
Sorry for not reading all the thread yet. Anyway, I was just playing around with my old project and realize that I can... Loading...
Sorry, there's no Spec, that's an "invention" from me @CODE=UNICODE is simply added to tell the player that it's an... Loading...
After a long break. I finally release decide to release my program and now trying to experiment with this. Since my... Loading...
Re: DVD2MIDI (missing lyric?) - The routine only extracts ~90% of songs successfully. But I've never had the situation of missing lyric. I'll try the... Loading...
So far I understood, we already got the TOC structure, i.e. we can get any song according to HD20 and read the data from... Loading...
Lyrics (A LA LA LA LA LONG) - alala.zip This is the lyric information I extracted from the song SWEAT (A LA LA LA LA LONG) 0x39 0x1F It starts at... Loading...
Re: Lyrics (Experiment 5 - lyrics timecodes) - I have noticed that in many songs the lyrics and the music is out of sync. So I made a small tool "adjustTiming" to... Loading...
Re: Lyrics (BLUE SUEDE SHOES) - I've also found (with soft-player) BLUE SUEDE SHOES is out of sync. This song starts straight with lyrics as well. Will... Loading...
This is not the best solution, but the easiest one. Instead of patching the (absolute) time code in lyrics, I patched... Loading...
Now I have tried to reproduce you patch on "blue suede shoes". My attempt failed however. When I play the patched dvd,... Loading...
I just checked my .mpd offset 0x12 seems to be correct. Before it crashed did the music start with delay and in sync... Loading...
The music started and seemed to be in sync with the lyrics. On the second screen of lyrics everything froze (one the... Loading...
I just double checked. Based on the MIDI-log, the 0x7f are in the first time code byte. 00 01 *10* 41 00 Unknown 00... Loading...
I managed to find the fault. There was a bug in the updateDvd.cpp file (the implementation of fseek() in cygwin for XP... Loading...
Re: Lyrics (BLUE SUEDE SHOES) Fixed! - Nice to see it working. Can you branch this to a new thread as fixing lyric asynchrony and give a summery of the two... Loading...
Have you got a virtual CD software which can mount the ISO-image? At the moment, I don't have access to all the... Loading...
Good! Very good that you found a workaround. It seems to be many songs with the same problem with delay. Can you explain... Loading...
I had a look in your problem again. But I still have no proper explaination 1) As you said, it could be the... Loading...
Yes, the new line and space always have the time code 0 which caused some troubles in dvd2midi. I also noticed there's... Loading...
Have you had time to look at this closer? Have you found any sync events in the midi part? I tired to look at your... Loading...
Not yet, I'm still working on the unicode issue, see another post (later). Yes, I'm using your lpd-file because it's... Loading...
I have no experiencs with kar-files and soft-player so I didnt fully understand what you mean by synced with... Loading...
Re: Lyrics (timecodes) - When you create a KAR-file with a MIDI and a text file you have to select the melody track (channel). Then the tool... Loading...
Thank you for the expaination. But I am still dont understand the outcome of my previous experiment. How can the tempo... Loading...
In the TXT-file all words are printed in one single line. But when I checked the MIDI file with a player the lyric is... Loading...
Ok, maybe there is some other problem with FindLyrStart(). Your version of FindLyrStart() does not work for me on "Moon... Loading...
Re: Lyrics (Experiment 4) - A new candidate: More Than I Can Say In this experiment, the visual changes only occured in YE. 1) There's one thing... Loading...
Just double checked exp3, it was: C9<D6>7E 8A 96 0B 00<DD>F7 6C 5C 38<BC>E9 EE 6F D6 was changed instead of C9. So,... Loading...
Based on C9 causing S->P and the assumption BC causing E->F, These are the results according to the values of Exp3 and... Loading...
Success!!! I have broken the code! I can now decipher the lyrics of all songs to ASCII. I will soon publish the updated... Loading...
Well done! Based on exp2(2), the 2 letters (clear text) must have something to do with the coding (mask). This might... Loading...
Re: Lyrics (Mask Length) - Since they are the first two letters of the song title they will re-appear at the spot where the song title is stored... Loading...
I have already figured out a work around to find out the length. What I am looking for is the real way to determine the... Loading...
What I want to say is... Maybe there's no length. The mask is terminated by the start of the first 2 characters, i.e.... Loading...
I doubt this is the case but it is easy to verify with a new experiment... I would rather think that the length is... Loading...
All my experiments were done on a DVD-RW. That's the "beauty" of our player Loading...
Re: Lyrics (Experiment 2) - Following patches were done: 1) HD20: "HOUSE OF THE RISING SUN" ==> "HOOXE OF..." 2) HD00: The first 2 readable... Loading...
I have looked closer to your changes to "SWEAT". This is my explaination: B5 => B6: This is the last byte of the... Loading...
I didn't mention the details about SW in exp3 because I couldn't conclude anything. I did this: E1 8B<B6>53 DD 40 7E EF... Loading...
This is my explaination: xx E1 8B<B6> 53 DD 40 7E EF 7C<26>81 <67>6D 9B 62 AF B9 58 98 28 2B 0A 00 ... Loading...
Lets look more careful at the change of "66 6D 9B 62" => "<67>6D 9B 62" "66 6D 9B 62" is the 8th-11th byte of the... Loading...
How did you make the DVD? Do you have to do something special or will any DVD burner program do it? (I have read... Loading...
It's very easy, but slow process. I use Nero (or any other) and burn a disk image. Nero image is not compressed. So,... Loading...
Re: Lyrics (Experiment 3) - I used following 4 songs: More Than A Woman (very bad, because it already contains incorrect characters originally) ... Loading...
The lower case letters seem to be in alpabetical order: 33 (0x21) => 'a' , 34 => 'b' ... 'z' But once again, the... Loading...
Re: Lyrics (Experiment: SWEAT) - I burnt a RW with following 3 byte patches (added 1): 00 53 00 57 23 DD<41>7E 88 7C 25<82>13 6D 9B 62 DE B9 58 98 4D 2B... Loading...
I have also been trying to decode the lyrics. It definetly seems to be encoded in some way. All my attempts to decode... Loading...
I've tried to google encoding algorithm. All I found are more security stuff which I don't believe is used in this... Loading...
I also tried to google on some encoding algorithms but couldnt find anything to help us. I wonder what the purpose of... Loading...
I guess that they want to keep competitors away. Else, I can't see any point not to allow users to create their own... Loading...
I think the reason to push them to hide the lyrics (california)and midi (soncamedia) data is to prevent people from... Loading...
1) I think we might have different versions of the DVD. The beginning of SWEAT looks like this on my dvd: 00000000:... Loading...
3) Ok, I think I understand what you mean by similarities. The beginning of each song entry looks like... Loading...
I think I am close to a breakthrough with the lyrics. I have discovered that aaaa...aaaa (see previous message) seems... Loading...
I have started to make a mapping table for "zz" (see previous message). There is a good news and a bad news. The good... Loading...
I would guess with mask. It will be a waste to use complex algorithm to scramble text. That's the reason I'm trying to... Loading...
I dont buy your explaination why the first 2 letters are in plain text. Why would you need to refer back to HD20? And... Loading...
It was a guess only :-) They don't need to be unique if they are a kind of hash information. Since the list is sorted... Loading...
Between: When I play "SWEET (A LA LA LA LA LONG)" (and some other songs too) on my California dvd player the lyrics and... Loading...
Haven't tried that song yet. But in some songs, there are some sections which are totally out of sync. Loading...
This is the layout of California Disk 0) 00.DAT : songs file Organized into 2 levels : a)Super Blocks (from... Loading...
Unicode Player - I don't use many (soft) players. But as far as I'm aware of, all the recent players support unicode. How well it's... Loading...
Re: Unicode Player (keyword in MIDI) - After working a little deeper in the player, now I can see the actual problematic in unicode. As I mentioned before, the... Loading...
Midi decoding - Here is the code (subroutine) i used to decode Midi blocks and made them available on karaoke.vietbel.org It's in... Loading...
Re: Midi decoding (different tempo) - I'll have a closer look tomorrow, it's midnight now. I found that the channels are running with different tempo. Do... Loading...
I don't understand very well the problem you have with the tempo. Normally the tempo is specified once at the beginning... Loading...
I'm not very familiar with that notation. Can you give me a MIDI file with that single track? I want to get the right... Loading...
Please find the kar file with lyrics. DANH_MAT.kar The previous one contains only the tick for lyrics, when I get the... Loading...
Re: Lyrics - I'm a bit confused. Have you been able to "read" the lyrics? btw, www.sonca.midi not found. Honestly, I don't know... Loading...
This is the website for encrypted midi karaoke: http://www.soncamedia.com/ In Vietnam, there are several brands for... Loading...
This is the website for encrypted midi karaoke: http://www.soncamedia.com/ In Vietnam, there are several brands for... Loading...
Unicode Karaoke Editor? - Do you know any free unicode karaoke editor? I use karakan which doesn't support unicode Loading...
with parameter now. dvd2Midi.zip Loading...
Speculation: I would guess that the song ID from HOTDOG20.DAT and HOTDOG30.DAT is used to index the tables in... Loading...
I have made some scripts for analysing the HOTDOG00.DAT file. Here is a summary of my findings: I made the... Loading...
Re: 10,000 songs still missing? - Based on our latest interpretation, are those 10,000 songs still missing? Was that only a marketing trick and they... Loading...
Yes, I still think that they are "missing". I havent tired to find out which songs are missing, but it should be... Loading...
Lyrics encrypted? - Btw, we have to start updating the subject because the discussion is getting to complicated. The lyrics might be... Loading...
Here is a c-program that will analyse the HOTDOG00.DAT file and find all the song entries. It is not pretty but it does... Loading...
That's also what I thought initially. But I found that it's easier to generate the MIDI (binary) directly. My converter... Loading...
If you put 32 bytes in one line and compare the two versions these are the unmatched lines (line number starts at 3): 3... Loading...
Sorry, here is the right data (it's line 66 instead of 76): 3 00000000 ... 18 ... Loading...
When I looked at: 0E 12 31 1F DON'T STOP and followed 0x311f in HOTDOG10. I found there's a 0x00 byte at the... Loading...
Can you explain again the steps you made? I didnt follow. Did you manage find out something about the structure in... Loading...
You are absolutely right. I know what was my mistake. I'll always find an entry for any position in hotdog10 because... Loading...
They are actually song ID related. Following number are in the song list: 712815 2 BECOME 1 713609 2 TIMES... Loading...
I got karaoke DVD of California electronic, my friend got the vcd of California electronic (nhac 5 so). It has alot of... Loading...
I guess the VCD is older than your DVD, right? You can try the extraction discussed here or it's also possible that it's... Loading...
I have found out some thing new about the format of HODOG20.DAT. The first 4 bytes of the file is the number of songs... Loading...
The HOTDOG30.DAT have a simular format as HOTDOG20.DAT. HOTDOG30.DAT contains a subset (english and vietnamese) of the... Loading...
HOTDOG10.DAT, HOTDOG11.DAT and HOTDOG12.DAT are identical in both versions of the DVD. I assume they contain something... Loading...
I want to gather some of the results here. Let's call the DVD with 30534 songs DVDa and the one with 30926 songs... Loading...
Re: Facts & Summary: Tool to export HOTDOG00 data of a single Song - http://www.nabble.com/Re%3A-DVD2MIDI-(fixed-!!!)-p11691536.html Loading...
Re: Facts & Summary: HURRAY, the first version of DVD2MIDI is available !!! - dvd2midi.zip Now we got it! The first version of DVD2MIDI (with lyrics). I'm so happy that I can't wait until I've... Loading...
Did you try your changes of key2 on english songs? When I run your version on english songs the lyrics is not correct.... Loading...
Re: Facts & Summary: dvd2midi (bug fixes) - dvd2midi.zip 1) Added 0x0a in key2 mask for ASCII mode to filter out unexpected 0x0a in English songs. 2) Adjusted... Loading...
Dvd2Midi.zip Just noticed that ReadLyricDat() is called without the mode parameter which makes the key2 mask no effect... Loading...
Updates of updateDvd. The program will seach a dvd image file for the pattern of a song and replace the song in the dvd... Loading...
As I mentioned, I only tried MORE THAN I CAN SAY. It seems to be okay with that change. When I changed the 1st byte in... Loading...
I have added some more tools for modifing songs and updating image file: Dvd2Midi.zip Here is an example of how... Loading...
Re: Facts & Summary: Tools, patching disk image - Just a suggestion... When I was doing my experiments I always use a 2nd copy of the image, i.e. the start of the HD00... Loading...
dvd2Midi.zip An updated version for dual-byte lyrics. I've added mapLyric2b() and updated the 2nd mask for the 2nd... Loading...
I did a quick change in my mapLyric() for dual-byte language (Chinese): if ((i % 4) == 0 || (i % 4) == 1) { ... Loading...
Re: Facts & Summary: Layout of HOTDOG00.DAT - http://www.nabble.com/Re%3A-Understanding-the-HOTDOG-files-on-DVD-of-California-electronics-p11465049.html Loading...
The first working version of DVD2MIDI: http://www.nabble.com/forum/ViewPost.jtp?post=11520529&framed=y Loading...
There are mainly Vietnamese and 0x05 songs added in DVDb. diff.zip Loading...
Sir, please post some link on where can i download the HOTDOG20.dat file or maybe upload it so i can download and try to... Loading...
From time o time I've seen hotdog00.zip in eMule network. You might want to try your luck. Be patient and do not give... Loading...
hAnalyse1.c Here is my script for analysing the TOC in the HOTDOG20.DAT file. It is very simple and you have to... Loading...
hAnalyse2.c Revised version... Loading...