How to search for video and audio files in the game

[garfildxm]

By studying the file you posted, I can now add subtitles for the opening animation, but there are still some videos and audio files of passersby and news in the game file, and I don't know how to find them. Do you have a way to find them?

[KillerBeer01]

Speaking of those you posted on screenshots - I don't think that audio files for these lines exist. If you search by text, you'll notice that these conversations are duplicates of others, with proper indexing, and these are probably just debris they forgot to clean up.

[garfildxm]

If the corresponding video or audio files mentioned above do not exist.

The boxed parts in these two pictures must have the same meaning. This is a pedestrian conversation that appears in SM01. Although there are no subtitles, the complete set of conversation content and variable conversations were found in the file. Therefore, I would like to ask you how to index these files

[garfildxm]

Do you have a method to unpack files or the unpacked files themselves?
I would like to explore this possibility with your help? May I ask if it's possible?

[KillerBeer01]

I outlined the one I used here #10 (comment)
(First you need to unpack the whole archive with Sean's tool #1 (comment)) Unpacked files take more than 150GB, though, and neither texts nor audio/video are concentrated in some particular part of them, so it's not really possible to only post the relevant part.

While working on it, though, I discovered that a lot of conversations do not have proper mapping between texts and audio in game files, resulting in having no subtitles in game, even though they are present in extracted files. Especially it concerns so called "barks" - random phrases uttered by NPCs as you pass them - but a lot of "structured" conversations lack displayed subtitles too. For my translation, I've mapped a lot of them manually (I like to hear the spoken voice as I pick the most fitting phrasing, it helps to set the mood), and you can see the result posted in the same thread, but sadly it all has zero impact on the actual game (unless Sean makes a miracle :) ). Injecting proper indexes into game files would be even more copious work than extracting them.

As for your new screenshots - while it's a different case from what you posted earlier (those were indeed a non-essential leftovers), it's not exactly obvious what you mean. I don't quite remember whether this particular conversation had been originally mapped or not - according to my admittedly messy collections of temp files, it might be not, but if you see its subtitles in game and can make a screenshot of it... then it must have been? What's your question about, then?

[garfildxm]

My estimation is the same as what you did, which is to display subtitles in the game.
When I was making the video, the subtitles in the video screenshot were translated by a friend, but I noticed that these two paragraphs seem to be the same in the text. No other meaning。

[KillerBeer01]

So the subtitle in the screenshot was made for the video and not produced by the game? In that case it's as I said - game files responsible for mapping text to audio do not do their work properly. I might look into a way to update them, but can't promise any results.

[KillerBeer01]

All right, I think I've managed to edit some of pc_resourcelib files that contain missing conversation subtitle mappings (not barks, though; first, they're mapped somewhat differently, and I haven't tried them yet, second, with the amount of people yelling sometimes, I'm not sure it will be for the better to have that many subtitles it may produce). Now, I haven't actually tested them in game - or more precisely, I have, but I saw no difference. I suppose for the game to recognize their presence, they should be placed into the Game.layer.1.all.archive patch file (or should it be Game.layer.1.en.archive?), but I don't have means to. Does an utility exist somewhere to pack DXMD archive files?

(EDIT: I've looked into both patch files through the hex editor, and it looks that some file names matching those files I've doctored are present in the "all" patch, and some in the "en" patch. Can't say if there's any meaning to that and is there any difference in which patch they should be placed to)

Word of warning, some of these files look suspicious to me, so even if somebody managed to reassemble the patch with them, perhaps it's not wise to play with them for the whole game until I polish the process, but I'd be very much interested to know if the process works at all.

https://drive.google.com/file/d/1svi4AslL79LuAAcLrxljEEkn9gwAMSid/view?usp=sharing

[KillerBeer01]

\4f2480431981158e32d947dcbb759050.pc_resourcelib
\E8F9135C922966C7A7A2B3BCB3927B03.pc_resourcelib
\BA076FFFCB3DE2F063548271ACB02DBE.pc_resourcelib
\65F2EC008A9D642ACFA54774511A909C.pc_resourcelib
\5315433485A058704465E8B90D05B854.pc_resourcelib
\5C3A83C24D3B8236413A2CC7724456E1.pc_resourcelib
\BE7D42A12771D5E7170057F8E2460591.pc_resourcelib
\15A3B7295279F58B89E82FDE8D7DE527.pc_resourcelib
\E1ADDD8A63E0EB9A9999C57EAFA44769.pc_resourcelib
\5D544220F549CBCB05CD11D96CD2527B.pc_resourcelib

OK, these files better be quarantined until I figure out what's wrong with them. The rest should be safe.

[KillerBeer01]

[sigh] I take it back. It won't work. After more thorough investigation, it turned out that .pc_wavebankfx resources have different byte lengths depending on whether they have actual mapped data or just null placeholders - a fact that completely went over my head while I was only concerned with reading them - so if I want to overwrite them, I'd have to rewrite the whole file and recalculate tons of lengths and addresses, and that's too much mess to not mess up for me. Sorry for the false hope.

[SeanPesce]

I don't want to make any promises because I'm very busy these days, but... @KillerBeer01, am I correct in understanding that you figured out the inner file formats and/or data structures to map some of the dialogue audio to the corresponding subtitle entries? If so, we could potentially try to apply those mappings with run-time memory modifications (rather than trying to re-pack the game files on disk).

[KillerBeer01]

Calling it "figured" would be a misleading overstatement. I was able to extract text content (the same you did in your own way), voice files, and some of resources containing mapping between them (or not containing, in so many cases), but I was doing it in so unorganized way, adding and commenting out parts as I moved from one stage to another, and never bothering to document anything, so now I have to decipher my own code to figure what I was trying to achieve. I don't even have a proper data structure for resources figured, as the Dawn Engine was too big of a mess to begin with, so I stopped even trying to bother beyond parts I was directly interested in.

[KillerBeer01]

Question is, how well you are familiar with inner file formats? If I say that every conversation has a pc_wavebank resource referring to corresponding to respective pc_fsb and pcwavebankfx resources, will that sound any familiar to you? Because that's how I was mapping those lines

This is pcwavebankfx resource's bytefield content sample:

(02 00 00 00 FF FF FF FF FF FF FF FF 00 00 00 00 38 1A 10 15 00 00 00 00 82 4B 19 8C - that's how it would look for a bark with more than one line)

[KillerBeer01]

The problem is, when doing the mapping all I needed was to browse through every pc_wavebank resource that matched conditions (conversation, English - I think it's better not to touch currently unmapped barks) and read a mapping for it - or, if the mapping wasn't found, see if the strings.json with audio tags has one for the corresponding sound file name, but I'm not sure if you would have all the relevant info where it matters during runtime.