Gildor's Forums

Read this post (/smf/index.php/topic,3055.msg41220.html#msg41220) for actual info about latest game versions.

(http://image.prntscr.com/image/e94c50b0b7f044d58ce0016751575686.png)

http://lostark.co.kr/
Download : http://www.lostark.co.kr/download

Special UModel build: see this message (https://www.gildor.org/smf/index.php/topic,3055.msg41220.html#msg41220)

Some information about packages.

Engine version
Ver: 868/16 Engine: 12097 Game: 80004C

In 90% of cases after the magics id 0xC1832A9E data blocks are encrypted by AES. Only 4096 bytes in blocks are encrypted. Key for decryption is: V1ZEG1PL34V77SQW39A9I4VUW34T6L15

Compression flag (offset 0x6D) always equals 0x44 (this is LZ4) > The game defines it so
I tried to add support in UModel and other utilities such as extract / decompress. Added next lines in code:


Here is a log when decompressing a small file after compiling:


In fact, it was unpacked without problems, but it refuses to work correctly with other files like upk. Someone else's code for me is like a dark forest. So it would be great if Gildor added support from himself. I did not manage to do this to the end. The main packages loader in EFEngine.dll (library is not encrypted), if this interests the author of course :)

Here samples and executable (just in case made a dump and the main executable): Mirror 1 (https://dropmefiles.com/g92lc) or Mirror 2 (https://www15.zippyshare.com/v/NvKpd3rO/file.html)

Thanks for description.

I'm afraid this won't happen. I'm too busy with other things - family, work, and when I'll have time for umodel I'll spend time on something else, not about the "Game A" or "Game B", but rather on something general.

It seems non-asian versions of the game didn't change since that post (/smf/index.php/topic,3055.msg31304.html#msg31304) (except the encryption key). I've managed to implement changes, explained by h4x0r (Ekey), but it seems the upk structure changed a lot since CBT1, so I can parse import table at best in the latest game version. Unless someone is willing to provide decrypted CBT1 client for comparison, I doubt something else can be done.

Also, the game is suffering from floating bug in stable lz4 versions prior to 1.9.3, when lz4_decompress_safe could fail due to non-standard literals at the end of compressed chunks (expected 5 zero bytes, but could be 6 upon compression). Updating to 1.9.3 resolved most of decompression issues.

Hello guys somebody can unpack upk from the latest version posted? it not work and trying figure out guide with LAUTool_0.2 but this is for wem files no for upk or lpk so any news of tool to unpack that awesome game?

Decrypted archives will be of no good anyway. Aside from changed properties, the game still has that issues with decompression, which I've mentioned in my post above. And because of this or modified chunks structure buffer positioning is also broken - you can build up a buffer with 1, 2 chunks and read from it, and then it may through you somewhere in the middle of actual file instead of buffer - i.e. it's not even possible to navigate within properly decrypted and decompress chunks. I was able to load static mesh from 1archive-1mesh though...

I manage to extract most of the textures of the Korean version by using what h4x0r and spiritovod pointed out, and also applying other fixes.

There seems to be no problem with lz4 decompression (but i don't use the same librairies), however compressed chunk structure in header has an extra uint 32 variable, if it equals 1 then the chunk should be decompressed using AES + LZ4 like h4x0r said, if it equals 0 it means there is no compression nor crypted data.

Also the int property of object happens to be on a 12 size, rather than 4 (certainly a 64 bit integer and a flags to know between signed / unsigned / ...), there may also be an extra 8 bytes on byte property.

For object decompression inside the file, often the flags is '0x80' which equals to LZX in ueviewer where it's in fact LZ4 in Lost Ark, and there is no aes crypted buffer there.

FYI i have extracted this in a 2019 version of lost ark so there may be update since then, but i don't think so, also if someone has key for the west or RU version i may verifiy those findings in current version.

@Brouznouf: Thanks for the info, it makes sense now why navigation inside buffer was broken like that. Last time I've checked ru version (it was easier to obtain), the key was "EAI643MZ91DG7J5K34A3RRD9FJ8QU6M2" - feel free to check it with the latest updates.

Thanks, it still works the same way with the RU version, i'm able to export the majority of textures, there is still some bugs with somes fils, like some name table with bad data inside, but maybe it's due to my decompress library.

I have also updated ueviewer to test some mesh, it still crash on a lot of files (don't know why, it instantly exit), but it works for some of them, here is a patch if somebody wants to try it out: https://pastebin.com/4n8g5hWy

With this patch UEviewer can certainly extract some sk or sm, but not all as there is still bugs and i don't have a lot of knowledge on upk format and game resources.

The "tool" (more a garbage script) that i wrote to extract some textures (map level) that i need to build an interactive map, and does not do anything else.

However with those findings i think there is all the necessary materials to write a tool that extract everything from lost ark if someone want to give a go.

hmm its weird, my kr client wont even extract any file even texture. which patch ueviewer are you using?

Thanks to Brouznouf internal navigation was fixed, so here are specific build for the game (download (https://drive.google.com/file/d/1EWBGNEJaIbBNzPcRPjvhM_sheZYwrxuq/view?usp=sharing), link updated) - you need to use game specific override option and choose respective region at startup screen. If you're a newcomer, check this post (/smf/index.php/topic,8304.msg43662.html#msg43662) before launching the build. Skeletal/static meshes and textures should work properly, animations are supported only in latest specific build.
 
Current build supports steam, ru (la[.]mail[.]ru), jp (lostark[.]pmang[.]jp), tw (lostark[.]mangot5[.]com), kr (lostark[.]game[.]onstove[.]com) and cn (lostark[.]qq[.]com) clients. It's recommended to rename ReleasePC\LOD9*.upk to textures.tfc for proper support of some textures. Quickbms script for lpk and tool for audio are available here (https://cs.rin.ru/forum/viewtopic.php?f=10&t=100672). Solution for correct packages naming is available in this post (/smf/index.php/topic,3055.msg46444.html#msg46444) and this one (/smf/index.php/topic,3055.msg47127.html#msg47127).

Note that some packages from recent game versions doesn't work properly due to different encryption, it's a known issue. Quickbms scripts and other tools are mentioned here just for reference, please don't report any issues related to them here.

Update: Specific build updated with support for crunch compression, so most textures should work even in latest game version.
Update 2: Small fix added to specific build for better memory handling.
Update 3: All crashes related to textures should be fixed in the updated build.
Update 4: Separate build for steam client added to the archive. Some animations may occasionally work, but most of them are using ACL compression as well.
Update 5: Both builds are updated to avoid crash on some embedded tfc textures.
Update 6: Separate build for jp client added to the archive.

Update 7: ACL animations are now supported in v2 builds. Though there may be some issues with non-acl animations.
Update 8: A few fixes added to improve animations support. Now empty animations without actual data are properly skipped.
Update 9: Some improvements for animations added. Now properties like rate and frame count are taken directly from tracks properties for ACL animations and artificially calculated for non-acl ones.

Update 10: Builds are now merged into single build, you can set required region at startup screen (at bottom right). Support for tw version is added as well.
Update 11: Support for kr version is added, it would also work for some early versions from 2018-2019.
Update 12: Support for cn version is added. The build is now 64-bit version and you need to use SDL2_64.dll from official umodel.
Update 13: Export for morphs is added (for gltf output only).
Update 14: Fix for some textures is added. Now fallback is used for cases when texture is flagged as crunched, while it's actually not.

I downloaded the latest RU client from the official page and most of the models and textures show up like this, not sure what's wrong.  :-\

I guess the answer lies here.

Thanks to Gildor's advices specific build updated with support for crunch compression for textures. Though due to poor memory management in the initial implementation it may crash here and there eventually - so please do not report hard crashes (like access violation errors). Also, some textures may not work as expected, I'm aware of it as well. It's just all this stuff is very time consuming to test.

About animations - they're using ACL compression now, which is not supported even for UE4 games, so...

Question, since i don't have the client and don't really remember how UE3 games handle the files but... would it even be possible to use "save package" function to get the animations like the other ACL games, since well, we could still ask akderebur if he can do something, in case.

@Ehlyon: No, umodel can't do that, it consider upk package as single asset (like uasset). I think theoretically it's possible, since there is "unreal package extractor" and other tools for particular UE3 games, but considering the custom format here, you can guess possibility of it being supported. Usually I don't work with UE3 games and as you can see, almost all changes here were provided by someone else, I've only fixed skeletal meshes loading and implemented support for crunched textures - it has nothing to do with general package format, and I still have nearly zero idea about it.

wow this is just nice, i hope the gentleman glidor will support acl games since i think theres alot of wonderful acl games waiting to be discover..

Does anyone know which upk has all the PC customization mostly hair i'm looking for.

All issues related to crashes (mostly because of textures handling) should be fixed in the updated build (fix2 version). Feel free to report any crash now, while opening or browsing a single upk.

I saw that you updated already the link brother, your just amazing.. we hope animation next time  8)

1) thanks for the work you've done.

2) when viewing one upk everything is ok. sometimes gives an error when set.

(https://a.radikal.ru/a12/2109/10/99f8f5da3fa5.jpg)

UE4 ACL Animation Tool
https://forum.xentax.com/viewtopic.php?f=16&p=175224#p175224

you cant use upk on that.

@Exc1usive: You're using outdated build, there were two fixes after that.

Excellent work！By the way，where can I download the specific ru cient?

from the official website:

https://la.mail.ru/download

 ;)

I have a Korean client
I get the following error:

@dmdlzaaa:

I got the same error when I tried it with the ru client before, but now when I try it, there is no problem.
I think it was my mistake.
Thank you.

Did you use a specific library for the crunch compression textures like https://github.com/BinomialLLC/crunch ? or is there a known documentation about how it is done in unreal engine ?

@Brouznouf: Crunch is supported natively in UE4 (around here (https://github.com/EpicGames/UnrealEngine/tree/c3caf7b6bf12ae4c8e09b606f10a09776b4d1f38/Engine/Source/Runtime/CrunchCompression)), but I've just used unity's fork (https://github.com/Unity-Technologies/crunch/tree/unity) for the library. There're various implementations of it, you can take a look at UABEA (https://github.com/nesrak1/UABEA/tree/master/TexToolWrap). In umodel I followed Gildor's advice and added per-mip decompression like for console textures untiling in UnTexture (CTextureData::DecodePS4 etc).

Separate specific build for current steam client (na/eu regions) added to the package in the base post. Some animations may occasionally work, but most of them are using ACL compression as well or just crash umodel.

@piritovod    I am using the latest ru client 

@eye: You need to use game specific override option at umodel's startup screen (Unreal 3 -> Lost Ark).

THX!MAN ;)

Hello
Thank you all for your hard work.

NA/EU version of lost ark is confirmed censored.

SO time to find and replace changed content.

Hello,
I downloaded lastest ueviewer but can't find lost ark in game specific override

This game is not supported with "official" UE Viewer. You should use a special build. Try to read more than 1 message in the thread, please.

Thanks  dear 
Gildor :o

Any chance to do build for the EU version on steam?

@stephan: There is only one version of the game in steam, and the provided specific build for steam still should work with it, as far as I know.

I've just noticed that ReleasePC\LOD9*.upk file is actually textures.tfc, which is required for proper support of effects textures. Modified base post with renaming recommendation.

@spiritovod: Is there a chance of using ACL decoding dll to have the animation working?

@Triadasoul: I have no plans for this at the moment. Also, not sure if used in the library ACL version is even compatible with the one used in Lost Ark. I know little about animations to dig into it, especially in UE3 game.

I'm not sure if it's the latest download you provided or something on my end, but when I extract the steam exe from the zip and attempt to run it, I just get a "The application was unable to start correctly (0xc000007b)" error and it doesn't open. Any idea why it would be doing that? I've tried running it as admin, running in the root directory with the game files, in the game directory... no dice.

@korribanscion: You're missing required dll, which is shipped with official umodel builds. Simply put specific build in the same folder with official build.

So I did as you mentioned, but now have a different problem: when I try to run the exe on one of the upk files, I get this (I mentioned this in the zenhax thread too):
lzo_decompress(4969,38731) returned -6
appDecompress: CompSize=4969 UncompSize=38731 Flags=0x44 Bytes=A4A5 <- DecompressBlock: block=AD+1369 <- FUE3ArchiveReader::PrepareBuffer <- FUE3ArchiveReader::Serialize <- FArchive::ByteOrderSerialize <- FString<< <- Name: 0 <- UnPackage::LoadNameTable3 <- UnPackage::UnPackage: ZHJ4TZKZ4EDB4E224EWXXSBH2V.upk, ver=868/16, game=ue3 <- UnPackage::LoadPackage(info): ZHJ4TZKZ4EDB4E224EWXXSBH2V.upk <- CUmodelApp::ShowPackageUI <- Main: umodel_build=1544 based

I'm not sure how to read this since I don't know the way the unpacker works... is this encryption related?

@korribanscion: https://www.gildor.org/smf/index.php/topic,3055.msg41847.html#msg41847

@spiritovod thank you so much! I didn't put 2 and 2 together lol

Alright so, I got the viewer working. The problem is all it opens is a bunch of black bounding boxes and a couple vertex maps. Where the hell are the character models stored? I looked through everything in the Packages folder. Also found a couple static display items.

Do I not need to decrypt the files further first? With LAPTool I've been able to unpack a few of the primary data ones, but all I get are a bunch of xml files.

These two things combined makes me think I'm not looking in the right place at all, or something changed with the steam release. Where are people finding the character models?

And I should mention: I've seen a few people's screenshots where they've managed to open model files, and they all have nice normal names: EFGame/Packages/CH/npc01.upk, for example.
 Mine don't look like that at all. Mine are all a jumbled mishmash of characters and numbers.

Most textures fail to load. Especially the ones related to character face,body and hair for some reason. Renaming LOD9*.upk to textures.tfc does not improve it.

@Gnomorez: You're talking about materials, while all textures should work properly. The problem is that materials refer to other packages with actual names instead of hashed ones. I have no idea how and where those "hashes" (they're not real hashes though) are resolved into proper names, thus particular materials doesn't work.

Fatal  Error！！！helpe..@spiritovod

HALow did you manage to fix the problem? iload in the UMODEL but no mesh found

@eye: Only a few animations may be supported, but most of them are not, it's written in the original post. If you want to do batch export, disable animations at umodel startup screen before loading game in it.

@whattheF: You can do a scan in umodel via context menu option, and then sort results by supported types (meshes/textures) - this way you can see in which packages meshes resides.

you have discord bro just one to ask someting realy need
WARNING: Unknown class "rb_bodysetup" for object "rb_bodysetup_2"
WARNING: Unknown class "rb_bodysetup" for object "rb_bodysetup_2"
Loading StaticMesh3 lv_rad_drlands_rocktest02_sm from package LOSTARK/EFGame/textures.tfc/Packages/201M8XI1QI82XGIFE7JEH61.upk

@whattheF: You can simply ignore most warnings in logs, they're for information purposes only and you can see many of them, because the game is customized a lot. It doesn't affect exporting of supported assets in most cases (meshes and textures).

@spiritovod Thanks，man~ :shocked:

:'(Fatal Error

But when i click upk no mesh only box please help

@eye: Could you provide this package separately (via PM)? I don't have steam version installed at the moment.

https://pan.baidu.com/s/177VSoC8KU3MwUUBBSf0dyQ
            code：9ob8

PLS UPLOADE GOOGLE OR MEDIAGILE 
BAIDU IT TRASH

@eye: Thanks, I've updated both builds to skip such objects for now. I'll look into this issue later when I have time, maybe it's possible to load them properly.

@godskin: It doesn't really matter for such small files, I can download even bigger ones from baidu.

@spiritovod   good  job！ thxs! :o

Would it be hard to add support for exporting .gfx (scaleform UI) files as well?

Hey, i've the entire thread but i can't find these builds you're talking about. We're can i download them? Where talking about the UE Viewer builds for Lost Ark right?

Made some clean up of this thread, mostly cut very old messages. 6 pages gone away.

The custom build is found in this message : https://www.gildor.org/smf/index.php/topic,3055.msg41220.html#msg41220

Also, now i'm here, what is missing to get proper name for packages ?
I guess missing material and textures from models in some packages are because package have hashed name so the reference to other package don't work ?
Will it be possible at some point to have this working or it's definitly lost in the game release ?

Thank you

Yes, it was already explained in one of posts above. Those names are not hashed though, it's some kind of encoding like base64, or something like one to one substitution cipher.

Thank you very much!

Hello guys I need lostark animations and models but I have problem allways I have this problem I download steam on lostark any help guys ? (http://i.epvpimg.com/Quopbab.png)

Judging from your screen, you didn't select Lost Ark, under "Override game detection", on the right of "Unreal Engine 3", you can select the specific game option.
regarding Animations, apart from very rare cases, they either do not work or make umodel crash~

Isn't there a software engineer who can make extract animations of characters and creatures?

(http://i.epvpimg.com/u1mKcab.png) why dont have mesh? @Ehlyon

I think I've got a decent idea of how the file names are obfuscated. I'm not a cryptologist or computer scientist, so I apologize in advance for butchering any terms or concepts. It looks like a mostly one-to-one substitution except for the underscores which have 2? characters. Based on the number used for the first underscore, the cipher is shifted slightly.


For example, there are a lot of packages containing head models. These packages will have the following strings in them.

APXI
BQYJ
CRZK
DS0L
ET1M

you can see that the characters are all shifted by one for each string. A to B to C to D, etc.

There is some weirdness, like the LOD9* file decoding to TEX(H)TURES(XOS9LS...). The shorter file names being extended by repeating the name with an offset. Or differences in the underscore characters (my table shows 1M, but I've also seen 1B,1Q,and 1G that all use the same cipher). But this should be a good start to help people locate the files they want.

some strings to look for are MN_,PC_,WP_,and NP_. Just use the table to find the different strings they could be and filter them in the viewer.

Once you open a package, you've to cycle with Page up/down. Press H to see all the various commands.
You can also filter and see only the meshes by, once opened the package, checking "include meshes" under "Navigate"


If someone was THAT interested we wouldn't be here bothering Both Gildor and spiritovod. We can only wait and hope for either an "epiphany" from them (which have lots and better things to do) or, who knows, an upgrade to UE 4, which may make things "easier" to ""fix"". Or also a mobile version with butchered content but UE4 and easier to open~

Hey! Is it possible to extract text data and also movies (.ipk) or is that not what umodel is for? Just wondering...

I believe that even if they'll switch to UE4, it won't change ACL library. The game is using some old version of it, when it was in some preview state with a lot of particular issues. As far as I know, non of those older versions are not supported anywhere, except for noesis (specifically for original FF7 remake PS4 version). For example, FF7 Intergrade is still using the same ACL version, despite they've noticeably upgraded engine since initial release. Also, in both Borderlands 3 and Tiny Tina's Wonderlands the same old ACL version is used as well (which may be not the same as in FF7 or Lost Ark).
I wouldn't be surprised if you'll need to compile and manually adjust (as in "fix bugs") different library versions for each of those games. Which is a trouble by itself for a few reasons.


@hijs31: umodel only works with upk files, while text is stored in customized sql databases from lpk files. You can find some solutions in this topic (https://forum.xentax.com/viewtopic.php?t=26884) though.

Has someone found Abrelshud's textures before?? I have only found her model with no textures  :'(

9G1MBTXF1BZZE74MEW64SSP has everything

is anyone still messing with the animations or any tool for lostark

I have the latest japanese client and I assume the custom ue client doesn't work?

The steam version is fine so far (I just started using this tool and I'm not familiar with it)

My goal is to browse the JP server sound files (and maybe some skins not yet available to NA/EU)

Is there anything I could provide from the japanese client for it to have a viewer that works?

@nenecchi: I've added separate umodel build for jp client. For audio use LAUTool from this topic (https://forum.xentax.com/viewtopic.php?t=26884).

Neat, thanks


Edit: anyone know sasha and nineveh's textures for science

@spiritovod
Is there new version for lost ark ?

Im using 04/03(03/04 bald eagles) ver and it is prone to crashing.

still no extract animatinos guys?

if any make extract animations I give pay 2k$ guys

Is there new version for lost ark ?

Im using 06/29 ver and it is prone to crashing.

I'm having deja vu with those copy-paste posts  ???

Just a little reminder - people may experience crashes because of animations, while they're not supported in general for the game and only some old ones may occasionally work (if devs still didn't remove or convert them to newer format). It can be checked by disabling animations completely at umodel startup screen. If your issue still persists after that, provide some of problem upk packages. For now no actual error has been reported.

In the latest package, several packages were unpacked when the collapse occurred:https://drive.google.com/file/d/1Tw_UHVPMJVjB9zY_jxR2O4xLutnILwAz/view?usp=sharing,This is one of them

@1062516683: Your link is not available for public.

@spiritovod：https://drive.google.com/file/d/1Tw_UHVPMJVjB9zY_jxR2O4xLutnILwAz/view?usp=sharing

@1062516683: Disable animations and it will work. Apparently you didn't even try to understand my post above.

@spiritovod:How does umodel disable animation I don't see this option

(https://i.ibb.co/x1CFFmr/image.png)

Yeah, how do I do it, but it still crashes

@1062516683: The package you've provided is from japanese client. I suppose you're trying to use incompatible build, there are three of them for different regions in the archive.

A few questions:
I have kr client - is it currently impossible to open its upk?;
I also have updated ru client, I can open its upk, but when I try to export it I get an error.

@scel: I have no plans for kr version. As for errors, apparently umodel can't write to the specified folder (not enough rights or it's read-only folder).

thanks for reply!

ACL animations are now supported in v2 builds, available in the same post (/smf/index.php/topic,3055.msg41220.html#msg41220) as before. Though there is particular issue with some non-acl animations, I've added temporary stub to bypass it (they look like sequences with incorrect rate). But none of them should crash umodel now.

Update: Builds are updated to mitigate the issue with non-acl animations, though they're still not fully fixed and some of them would be broken anyway.

Can the problem of the incorrect rate you're talking about finally be fixed?
Because I found that the animation with incorrect rate looks normal in UMODEL, but the animation problem after loading in other software is very bad

@zxhxy: Actually this issue is not related to rate, it's just forcing it to certain values manually make them look more or less fine in the viewer, no wonder it looks broken somewhere else. It's related to the way how they've customized non-acl animations. I doubt it will be fixed in near future, as I don't understand how it should work and also spent more time than I should trying to at least avoid crashes. Only reports for crashes would be reviewed for this game at the moment.

(https://s4.gifyu.com/images/unknown9f365d76d1e7a4fa.png)

I don't know how to find these files Is there an easy way to parse .upk files I'm trying to find characters and animals,animations

Try Tools->Scan content. Sort by Anim - if the upk has 1-2 skeletons and about 20-60 anims it's a monster. After that you may sort by package name - and you would be in the block where similar characters are stored.

As Triad Said, first scan content, after that, all NPC-enemies should be inside 9G1M files so it's better to sort them by name. A few files crashes (only found 4), the ones without animations are ALTS of the monster that comes first (you'll see by the look anyway).
Do not try to load files with 900-1k animations as umodel will crash.

Latest builds shouldn't crash at all, regardless of animations count. Could you re-download them from the base post and check again - if something still crash, please provide problem package here or via PM and tell version region.

My fault i only checked one file with around 9xx animations and it crashed, giving some animation error, noobie me thought it was related to the animation count (lucky me also got the only big file crashing among many...). I'll pm you the files.

By any chance do you know what is the naming where monster weapons are stored?

Sorry, as i was only interested in npcs and such i only checked those files~

@Ehlyon: I've updated builds based on provided samples, empty animations which were causing those crashes should be properly skipped now.

I can't find any game specific override option at startup screen when use specific build for steam version. Can some one help?

@Vincent Donald: This is UE3 game, not UE4.

This package keeps crashing, even after new build:
HV2NG2JGX2H00FGEP4FEB00X

@SearchForHype: Provide problem package here or via PM, so I could take a look.

Is it possible somehow to extract low resolutions textures for some NPC models in proper resolution?

(https://i.postimg.cc/mkXRFqz2/low-res.jpg)

example from some clown textures of (BZ5e7j)

@Triadasoul: The game is using hashing for names, which was explained somewhere around the topic. While loading a hi-res texture, it usually address bulk data from tfc file (texture cache) - and if it can't find corresponding file, only stub with lowest mip is loaded from base package. In short, you need to find corresponding upk file and rename it to tfc - required name is written in the viewer (TFCName) and also in logs. Though this part is not clear to me, because it seems like the game can address multiple different files under single name (maybe because how their hashing works?).

Thank you!
Is there an easy way or routing to find the upk which stores the hi-res NPC textures?

Here you go:
https://easyupload.io/kiawiq

@Triadasoul: I'm aware of only one tfc file, which is mentioned in the base post with builds. Can't tell anything about others (if there any).

@SearchForHype: I suppose this is ACL library bug, which came from custom decompression settings, used in latest updates. I've fixed this, but only for steam build, as I'm not sure other versions are affected by it.

Thank you! it worked ! (i read that post long-long ago :embarrassed:)

thanks for your kindly help :D

The file in the steam version crashed

@heyong: It seems like you're either out of memory or bumping into general limits of 32-bit builds. Try to limit batch export to packages / assets you actually need.

I have enough memory. It should be a 32-bit limit problem. Thank you very much for your help

@spiritovod
the animation exported looks all have same length for each AnimSet, like all male animation are 320 frame length and all female animation are 280 frames
which is kinds of unusual than other game, could there be something missing?
thanks!

Does v2_ru worked for ru version?
i tried it but there is no anim info on the left bottom as usual.
also tested on the same file as your screenshot.

@redtank: They've customized a lot of things and I didn't dig into all of them yet. But you have a point here, issues with non-acl animations are directly related to this because of incorrectly suggested frames count. I've updated all builds (should be fix4), now ACL animations are using their own build-in properties instead of sequence properties and some properties for non-acl animations are calculated artificially. They should be less confusing this way.

@LoudlyCoding: In UE3 games animation sets and packages works differently than in UE4 games. You can't do batch search for animations, only cycle animation sets from currently loaded assets set. Also, package may contain mesh, but doesn't contain compatible anims - and vice versa. You need to add both mesh and anim set to currently loaded set with append option and then do things.
  

It works perfectly now, many thanks!

@relientk: There is no point in doing that, since the game is using customized upk and you wouldn't be able to decompress or extract anything from there with common tools even after decryption. Otherwise, the whole routine is explained on the first page by h4x0r and Brouznouf.

@relientk: That's the only key used for upk (one per region) and it still works, otherwise people would already submit an issue due to non-working umodel build. Apparently things you're trying to do are not related to upk and thus to this topic (also, upk outside "Packages" folder are not real upk). For the rest of files, like audio and databases, you can use respective additional scripts and tools from this topic (https://cs.rin.ru/forum/viewtopic.php?f=10&t=100672) (look for "other scripts for UE games").

First of all, thanks @spiritovod for all the amazing work you've put into this tool. It's really helpful to extract some in-game textures that are often cut or low scale in-game.

There's a few textures that often fail to be displayed (or be extracted, for that matter), as if they were invisible. For example, in the Steam release in EFGame/ReleasePC/Packages/PWTH1B17THBVF2NME7646CM.upk most textures load perfectly except identityblade_i6, identitydevilhunter_i6.

There's no error or anything, it's just as if they didn't exist. Any idea on why?

@Sekwah: The game is loading some textures from external packages completely (when base package doesn't store any actual data, only reference to external texture) - they are not supported, because hashing algorithm for packages names is unknown. In such cases you can see related info about missing stuff in umodel logs, with some exceptions.

I downloaded the ru client, but i can't find the meshes only the materials. What did I do wrong?

@vandaa95: I suggest to watch recommended video from tutorials section (/en/projects/umodel/tutorials) about general umodel usage. Also it's worth to read the topic, because there are some issues with the game, which are not directly related to umodel.

Oh sorry, thank you :) It helped me a lot, i did it :)

Support for taiwan client is added to specific build. Also all builds are now merged into single one, you can choose required region at startup screen (at bottom right it's "region" option now instead of "platform", there are no console versions anyway). Region options should be available via command line as well, but I didn't test that part. Feel free to report issues with the updated v3 build.

Steam selection crashes while scanning for content. If to select certain model - crashes with this

appDecryptAES <- appDecompress: CompSize=5344 UncompSize=36955 Flags=0x44 Bytes=4892 <- DecompressBlock: block=161+14E0 <- FUE3ArchiveReader::PrepareBuffer <- FUE3ArchiveReader::Serialize <- FArchive::ByteOrderSerialize <- FString<< <- Name: 0 <- UnPackage::LoadNameTable3 <- UnPackage::UnPackage: EFGame/ReleasePC/Packages/9G1M23UI1BZZE7DKTH64SSP.upk, ver=868/16, game=lostark <- UnPackage::LoadPackage(info): EFGame/ReleasePC/Packages/9G1M23UI1BZZE7DKTH64SSP.upk <- CUmodelApp::ShowPackageUI <- Main: umodel_build=1544 based

@Triadasoul: It appeared that default region option (which is steam version) couldn't be autodetected properly. It should be fixed now in the updated build.

@relientk: If you want to know how Texture2D assets are parsed in umodel, you can take a look at UTexture2D::Serialize in source code. Aside from that it seems you're trying to mod the game via third-party tools, while modding is out of scope of umodel and this forum (mostly). Please return back when you have any umodel related questions.

@johnreese: I guess it's just a matter of wording, but h4x0r actually means data blocks in his post. Data blocks starts after package header, not right after package magic. Though personally I'm only interested in umodel implementation and it's already explained in h4x0r's post, except for some obvious checks (if block is smaller than suggested encrypted buffer and such).

@johnreese: You need to parse the header to get data block sizes and such (in umodel it's FPackageFileSummary::Serialize3), otherwise you'll get a lot of other issues with proper decryption implementation. It probably would be faster to modify upk decompressor, which is part of umodel code (https://github.com/gildor2/UEViewer/tree/master/Tools).

Though, like it was already said above, modding is out of scope of umodel and this forum. Considering this and that previous user with the similar questions has completely removed his posts, all questions not directly related to umodel usage will be ignored from now on.

@kuminga: It seems you have wrongly renamed package (FX_D_W_01.upk) or it's not compatible with the game version. In case if external textures are addressed from a package in some unsupported way, umodel would look for tfc cache or upk of the same name as required assets, but if you'll rename not appropriate file, it just crash.

any know lost ark how to extract sounds

@3dartsro: It was already mentioned before in the topic, but tools for some other formats are available here (https://forum.xentax.com/viewtopic.php?t=26884) (look for "other scripts for UE games").

I cant make this can you help me :( I use steam lostark

@spiritovod - is it possible to opensource your modelviewer? we can add the aes/blowfish for the korean version. i will PM

Are there any dummy mesh that are compatible with most of the humanoid animations? (the whole character, not in separate parts)

@3dartsro: It's not related to this topic, but usage is quite easy there, "lautool_xx.exe -d input.wem output.wem" (output will be decrypted file). You can write some batch script for batch processing if needed.

@downforce: I've decided to not provide support for versions which are not somehow accessible from overseas, because in case of issues it's not possible to check them and decide if it's general umodel issue, or specific issue of particular region version, or just user error.

@eexxeennuull: I wonder why combining separate parts of a model is not an option? You can do it in umodel as well with tagging required meshes (scroll through loaded meshes and press Ctrl+T on those you want to combine), the result will be around the same as on screenshot attached to base post with the build. Also, it doesn't seem like the game is using retargeting much, so most animations are tied to particular skeletons - and in case of player characters those are mostly separate parts (because of character generation thing).

@spiritovod Thank you for replying. In the screenshot, the player's parts have _skel in their names, so i assumed they have multiple skeletons in every characters. I have been trying to retargeting animation onto a character rigged with Blender's Rigify before, with another game. But i don't know how to make multiple parts go into one whole skeleton. (this game is so large and its requires VPN, so i have not downloaded it yet)

@eexxeennuull: Well, yes, most characters has their own skeletons here, even if they are renamed copies of those from similar models - that's how things works without retargeting in place. Apparently the game has a lot of copy-pasted stuff with small changes just because of this. If you're planning to apply most animations to some single model, it's not possible to automate with umodel and it would require some manual scripting in third party apps like blender (with pre-processing like renaming used skeleton/armature on import, checking if bone names are the same, etc).

@spiritovod Thank you very much. Ten years ago, i cannot imagine something like this was possible at all. It's all thanks to multi-talented peoples with outstanding skills like you and @Gildor. m(_ _)m

Support for korean client is added to specific build. Apparently it's using the same key as older versions from 2018-2019 (CBT/OBT ones). I've only tested it with some old OBT version, but downforce confirmed that it also should work with latest korean version as well.

Support for chinese client is added to specific build. The build is now 64-bit version and you need to use SDL2_64.dll from official umodel. Not sure about some things though, so if you have crashes with particular packages using latest specific build, please report them.

I confirm it's working well for KR client. I can extract boss models and various other pngs

Proof: https://imgur.com/a/QEuKy6E

Thanks @Spiritovod

Hi. Im using the newest version of the steam client, and trying to open or extract any .upk files gets me this error:

appDecompress: CompSize=32858 UncompSize=131072 Flags=0x44 Bytes=1E6B <- DecompressBlock: block=322D+805A <- FUE3ArchiveReader::PrepareBuffer <- FUE3ArchiveReader::Serialize <- FArchive::ByteOrderSerialize <- FString<< <- Name: 0 <- UnPackage::LoadNameTable3 <- UnPackage::UnPackage: EFGame/ReleasePC/Packages/EAOFO0FAD6VMYVWH4Z8KZ6.upk, ver=868/16, game=ue3 <- UnPackage::LoadPackage(info): EFGame/ReleasePC/Packages/EAOFO0FAD6VMYVWH4Z8KZ6.upk <- CUmodelApp::ShowPackageUI <- Main: umodel_build=1544 based

any idea why?

@andrewdesi09: https://www.gildor.org/smf/index.php/topic,3055.msg41847.html#msg41847

Hey,

Any way to export morph please ? I need morph for player face

Also anyone found "Piela" NPC in files ?

edit : If someone need I made a sort of cheatsheet for naming convention used in game files
https://docs.google.com/spreadsheets/u/1/d/e/2PACX-1vQNSWlI6c1Que9EQb9UlBQSW5CbzpA-ftKqzlIkIyEuxdN2LnMzsLv6OJk43vgILLwIT-iwpebtYLLf/pubhtml#
I exported all files, so I search directly in all folder, it made it work so much better and I can even make player character now

@Fia: Does the game even use build-in morphs for meshes? If a mesh has any, it's written at the left bottom corner in the viewer. Because usually it's something runtime generated and not backed into mesh. If there are actually morphs there, provide some upk with such mesh (here or via PM).

Yeah there is built in @spiritovod
VC2N892NX2HXYCQF0REHFEBF on the Steam version
Object pc_wr_f_00_face_sk this one have 44 morph.

(The one generated at runtime work how ? Bone deform ? Multiple mesh with one base and other with for exemple different facial expression ?)

@Fia: I've updated specific build, it's now possible to export morphed models (to gltf only), like in more recent builds. Only mentioned package has been tested though, if there will be issues with other meshes, please let me know.

Thank you so much for the response. I got it working.
Is there a way to make sense of the upk file names to find models easier?
I'm only opening the .upks one by one to check what's inside at the moment.

@andrewdesi09: You can check page 6, where sylvester334 provided some explanation about packages names.

Newbie Here,

Tried to open the steam version but get this error when I try to open with the specific Umodel Tool linked in this thread.


(https://media.discordapp.net/attachments/995177508293058650/1114818480538124338/SLD2_Error.PNG)

When I search the Steam files, it only has a SDL3.dll

What am I doing wrong?

hi

I am currently researching the data files of the Lost Ark game, specifically the .epf and .loa files. I understand that these files may contain various data and resources for the game, but I have not found any tools that can directly open or parse these files.

I was wondering if anyone knows how to open these files, or if there are any tools or methods available for parsing these files? I have some basic knowledge of programming and reverse engineering, so any technical suggestions would be greatly appreciated.

Thank you for your help!

So just curious. Are we seeing all the files in the game?
This is vykas
(https://i.imgur.com/4JsY9AN.jpg)
And this is her sword. From the viewer
(https://i.imgur.com/QcP8dsi.png)
I tried to find the textures of the sword, and couldn't found it even flipping through the entirety of the game's files.
It seems like it was meant to be between the vykas model/texture piles, but it just didn't get extracted properly
And therefore we can't see it/export it?

Just thought it was weird because there are lots and lots of models with not texture in the viewer that I also can't find the textures anywhere I look.

Edit: It could also just be that the game package file doesn't have the sword texture in it ... ?
I'm so confused.

The game recicles paths for a lot of files to avoid repeating textures, for instance the player's faces are located in jus one place and most faces point to that path (with a few exceptions) so some character files show up with no textures in the viewer, once extracted you can texture it manually if you manage to find the path where the weapons textures are located, the same happens for hair textures and eyes textures among other few.

This is a long shot but does anyone know where is beatrice's file in the western client? I looked through the entire packages folder and I didn't find her. I'm exhausted.

I just need the name of the file containing her models/textures.

Specific build is updated with fix for some textures, which couldn't be loaded properly.

It affects latest game versions from all regions, except russian one. The point is that crunched textures were originally implemented into ru version, and while other versions doesn't seem to use this compression, they now have respective flag, probably as leftover from general engine upgrades. Therefore support for crunched textures is now limited to ru version only to avoid related issues (when compression flag is set, but not actually used). If you'll notice something weird with separate textures while using updated build, please let me know, preferably with samples.

(https://imgur.com/Kdfi7zR)
Hello, is the issue of textures appearing black in the KR version for recently updated files, as shown in the provided image, due to the fact that the updated uemodel version does not support crunch textures?

@rays: Could you provide some sample packages, here or via PM? Both korean and chinese versions are currently region locked.

A few pages back user "sylvester334" has a chart to decode the files names, but even then it wont help because the files are not names after the ingame characters, Beatrice file is inside "GU1MUX4F1BZZE7TERW64SSP" and that translate to "NP  PABS  00" which is her filename (np_pabs_00_sk_loc_int)

I have the same problem with v5 for the Steam version, check the GU1MUX4F1BZZE7TERW64SSP model, the textures are all black, it doesnt happen with v4.

Well, I guess they're using some kind of fallback after all instead of proper usage of respective flag for textures. I've added something similar to updated build, most textures should work now. Though it may require some additional tests.

Update: I probably got the idea behind all this. Apparently they're processing compressed images (DXT) through crunch decoder according to respective flag, while uncompressed data (RGB) would be loaded directly, even if it has flag for crunch compression. Not sure what benefits you can get from such approach though.

Sir, i quite confuse which version of the extractor from spiritovod is the latest. can someone send a link of the latest link? thanks

@jericho777: If you mean custom umodel, latest build is always available in the same post (in this case the one from the first page). It works like that for all topics where I provide custom builds to ensure that people wouldn't be confused with multiple different links, at least within the same topic (and also for this reason I encourage people to not provide direct links to download, but links to original posts due to possible updates).
If you mean related quickbms scripts and such, they're now available at rin forum (https://cs.rin.ru/forum/viewtopic.php?f=10&t=100672) instead of zenhax (look for "other scripts for UE games"). I'm planning to update all my related posts with actual info in the next few days.
 

Hello, may I ask if you know how to open the EFTable_GameMsg.db file obtained by unpacking Lost Ark with BMS? I've tried using DB Browser and SQLiteStudio, but neither of them seems to work. I would appreciate your assistance. Thank you very much.

Where is the character's head and weapon

armors, hair and other for characters, filename begins with:
VC2N*
UB1M*
WD3O*

weapons for characters, filename begins with:
9W3O*
7U1M*

musical instruments, filename begins with:
IN2N*

weapons for characters (VIP) and NPC, filename begins with:
8V2N*

heads for NPC, filename begins with:
AH2N*

props (ears, beard, jewelry), filename begins with:
BB1M*


            heads for characters                         hair                                              name
____________________________________________________________________________________________________
VC2NJ32N002NXYCQF8LEH00E            VC2NJ3*          Deathblade, Shadowhunter, Reaper, Gunslinger, Soul Eater
WD3O5I3OY3IZ23I6ZHR6PKNG1
____________________________________________________________________________________________________
VC2NXN2N002NXYCQF8HEH00E          VC2NXN*         Glaivier, Scrapper, Soulfist, Wardancer
VC2NXN2NY12N5YGQ5OJMF8HE
____________________________________________________________________________________________________
VC2NA42N002NXYCQF8SEH00E          VC2NA4*          Sorceress, Summoner, Bard, Arcanist
VC2NA42NY12N5YGQ5OJMF8SE
____________________________________________________________________________________________________
VC2NGV2N002NXYCQF81EH00E          VC2NGV*         Artist, Aeromancer
VC2NGV2NY12N5YGQ5OJMF81E
____________________________________________________________________________________________________
VC2N892NX2HXYCQF0REHFEBF          WD3O9A3OY*         Slayer
VC2N892NX2H00FGREHFEB00X
____________________________________________________________________________________________________
VC2N4H2N002NXYCQF8BEH00E          VC2N4H*         Machinist, Deadeye, Artillerist, Sharpshooter, Striker
WD3OYO3OB3IZ23I6ZHR6PKNG1
____________________________________________________________________________________________________
VC2N892N002NXYCQF8REH00E          VC2N89*          Paladin, Gunlancer, Destroyer, Berserker
VC2N892NY12N5YGQ5OJMF8RE
____________________________________________________________________________________________________


full ID and names characters:

ID                international names
-------------------------------------------------------------------------
                        FEMALE:

dl       general armor (not unique) and animations
dbl     Deathblade = Blade = Клинок смерти = 블레이드
ddm   Shadowhunter = Demonic = Фурия = 데모닉
drp    Reaper = Жнец = 리퍼
dse    Soul Eater = Пожиратель душ = 소울이터
gn     general armor (not unique) and animations
gdh   Gunslinger = Охотница на демонов = 건슬링어
-------------------------------------------------------------------------
ft      general armor (not unique) and animations
fbm   Wardancer = Battle Master = Аватар = 배틀마스터
ffm    Soulfist = Soul Master = Ки-мастер = 기공사
fif      Scrapper = Infighter = Дуалист = 인파이터
flm    Glaivier = Lance Master = Мастер копья = 창술사
-------------------------------------------------------------------------
mg    general armor (not unique) and animations
mar   Arcanist = Arcana = Арканолог = 아르카나
mbd   Bard = Менестрель = 바드
mem  Sorceress = Чародейка = 소서리스
msm  Summoner = Призывательница = 서머너
-------------------------------------------------------------------------
sp      general armor (not unique) and animations
sdm   Artist = Художница = 도화가
smw  Aeromancer = Аэромант = 기상술사
-------------------------------------------------------------------------
wr     general armor (not unique) and animations
wbk   Slayer = Валькирия = 슬레이어
-------------------------------------------------------------------------

                       MALE:

ft       general armor (not unique) and animations
fbm   Striker = Тайгон = 스트라이커
gn     general armor (not unique) and animations
gam  Sharpshooter = Hawk Eye = Рейнджер = 호크아이
gbs   Artillerist = Blaster = Механист = 블래스터
gdh   Deadeye = Devil Hunter = Охотник на демонов = 데빌헌터
gst    Machinist = Scouter = Агент С.К.А.У.Т. = 스카우터
-------------------------------------------------------------------------
wr     general armor (not unique) and animations
wbk   Berserker = Берсерк = 버서커
wdr   Destroyer = Сокрушитель = 디스트로이어
wgl   Gunlancer = Warlord = Страж = 워로드
whk  Paladin = Holyknight = Паладин = 홀리나이트
-------------------------------------------------------------------------

matching the first letter in the ID indicates that the models have an identical skeleton, such models have compatible hair, head, armor and animations.

Is there a way to get makeup textures into the custom character face (example Mage/Sorceress) and is there options to edit eye color, iris color, hair color etc. Or do I have to do it manually with photoshop and 3d program?

They exist in the Texture2D folder and there is a file in MaterialInstanceConstant folder which has all the ScalarParamaterValues with different makeup/special.
So far there's only three basic materials on the mesh: face, eyelashes and eyes when viewing in UE Viewer.

1st of all - Thank you so much for this tool and all the support offered in this thread!

2nd - If you, like me, are a smoothbrain, haven't used uModel in years, and couldn't figure out how to make the Steam version work at first, here's a step by step:

(This assumes you already have the Steam version of Lost Ark downloaded)

-- Note: If you're using a game version other than Steam, I assume the process to be roughly the same, except for where the location of your game folder will be. I can't verify this, though!)

1 - Download the original uModel program: https://www.gildor.org/en/projects/umodel (/en/projects/umodel)
2 - Download the "special build" from the start of the thread we're currently in: https://www.gildor.org/smf/index.php/topic,3055.msg41220.html#msg41220 (/smf/index.php/topic,3055.msg41220.html#msg41220)
3) Unzip both of these programs
4) Open your Lost Ark game folder
[To find it:
- Open Steam -> Library
- Right click on "Lost Ark"
- "Properties"
- "Installed Files"
- Where it says "Size of Installation" there should be a button that says "Browse", click "Browse"
- It should open a folder that looks something like "C:\Program Files (x86)\Steam\steamapps\common\Lost Ark" ]

5) Pull up your extracted folders from the original umodel install and the custom build
6) Copy all the files inside of the Umodel original install folder, and paste them into your Lost Ark game folder (Do not give them their own folder, just let them sit there in the open)
7) Copy the file inside of the Umodel special install folder, and paste them into your Lost Ark game folder (Do not give it, it's own folder, just let it sit there in the open with the original one)
[ If you did the above steps correct, your Lost Ark game folder should look like this:
[Folder] Binaries
[Folder] EFGame
SDL2.dll
SDL2_64.dll
umodel
umodel_64
umodel_lostark_v5 ]

8 ) Open umodel_lostark_v5 (the "special build" program) and it will start
9) In "UE Viewer Start up Options" check that the "Path to game files:" is the same as your Lost Ark game folder [Example: C:\Program Files (x86)\Steam\steamapps\common\Lost Ark]
10) Check the box that says "Override game detection"
11) In the first dropdown, select "Unreal Engine 3"
12) In the second dropdown, select "Lost Ark"
13) Under "View / export object types" uncheck "Animation"
14) Leave UE3 Package compression as "Auto"
15) Region should be set to "Steam"
16) Press "OK"

It should now open the viewer for you.

17) On the right hand side, it should show you a list of folders:
[All Packages] > [Binaries] > [EFGame] > [ReleasePC]

18) Click on the little arrow beside the "ReleasePC" folder so that it shows the folder [Packages]
19) Click on the "Packages" folder
20) It should now show a list of .upk files, these are your files to browse

Use the filenames in this post: https://www.gildor.org/smf/index.php/topic,3055.msg45513.html#msg45513 (/smf/index.php/topic,3055.msg45513.html#msg45513)

To help you navigate the files

21) When you have decided on a .upk to check out, click it and press "Open", it will open the viewer now for you to see what they look like. You can continue to browse through the files within the .upk in the viewer using Pageup and Pagedown keys on your keyboard.
22) When you find one you want to extract, you can do so from the "Extract" drop down at the top of the viewer. Note that each one will have multiple files (a 3D model file, and also the various textures), and you will need them all to make a complete model in a 3D program such as blender, 3dsmax, etc.

 :) Happy ripping! &Wish me luck on finding the Spotless Meowdy helm and Epiphany cat paws, friends~ It's what I downloaded this for, lol

edit: think I found 'em!
Epiphany paws (?) : EFGame/ReleasePC/Packages/8V2NXIX2RY12R0SDYFGIFE9M.upk  
Spotless meowdy (?) : EFGame/ReleasePC/Packages/WD3O5I3OY3IZ23I1TLGUMPNMJ.upk

edit 2: I think this is the plain white texture for spotless meowdy head, but I can't figure out/find where it textures the bell from, or if there's a texture that combines them:
/VC2N4H2NY12N0SKYF8BEHM7E.upk

Found Kayangel Gate 2 model on 9G1M27NU1BZZE7DCGT64SSP but he is missing wings.
It seems a lot of textures effects are in EFGame/ReleasePC/DKV6KRSCXY3T6D9CJIK3G.upk
Anyone know where the Kayangel wings model and textures are located ?

I also found another boss character with black and purple armor, white hair, animated
wings in 9G1M2IIO1BZZE7DHHN64SSP , anyone know the name of this boss ?

the previous version works on animation why the version 5 its not working anymore? for kr ver

@jericho777: Animations were not affected in recent updates of the build - if something has stopped to work, it can be regional specific changes or something else (for example, they could move anim sets to different packages). Without sample packages it's hard to tell anything.

Can I extract a psa as a single file when I extract it?
It is difficult to manage all animations because they are all in one psa file.
I can check all the animations in blender but I don't know how to extract only the animations I want..

@ethan048: umodel is exporting only currently applied animset. If you'll open a mesh and select some compatible with it animset (from the same package or appended), upon export you get only that animset (collection of animations) in psa file. But if you're exporting whole package(s), then umodel will try to export all included animations as one animset.

Thank you for your hard working!
I have managed to extract recent legendary contume on KR server and it contains all meshes and textures.
They look really good on Blender.
It's really exciting when things work very well.

But for some models, textures are not included in the same package file so umodel cannot export them.
This packge (https://drive.google.com/file/d/1sEZF_8A1m37hjoWDgPHZbarbXVQdYdFZ/view?usp=sharing (https://drive.google.com/file/d/1sEZF_8A1m37hjoWDgPHZbarbXVQdYdFZ/view?usp=sharing)) for instance, have meshes but not textures.
My guess is that textures are stored elsewhere and it might be in LOD9LS7OEDEP1EBMOHOT5O.upk (https://drive.google.com/file/d/1MC2OvmwfYuz-wURpzspk55eZkBMcHLKK/view?usp=sharing (https://drive.google.com/file/d/1MC2OvmwfYuz-wURpzspk55eZkBMcHLKK/view?usp=sharing)), which is supposedly storing many many textures?
So I tried to open it, only to see umodel failed and the cmd said following.

*** Wrong package tag (7BEDB615) in file EFGame/ReleasePC/LOD9LS7OEDEP1EBMOHOT5O.upk. Probably the file is encrypted.

So it seems the dev changed encryption key for that particular package file, and I don't know how to solve this problem.
Maybe I can try brute forcing if thre's a way to do it.
Any help would be greatly appreciated!

@SausageTaste: It's explained in the post from the first page where you got custom build. Please read it carefully.

you have to look for similar clothes from a different character and get the textures from there.

for splitting or adding animation to the .PSA package there is a program "DN.UnPSA.Toolkit_GZD" download here ==> CLICK (https://github.com/Kizoky/PSA_ModeldefGen/releases/tag/v1.0)

Thank you for your answer.
I want to recreate the render look of the in-game in blender or Maya, do you have any packages with lighting?
Or is it impossible to reproduce it because it uses Unreal's own lighting?

Oh I got it.
Thank you for your kind help, sir!

Btw, it really makes sense once you know, that you don't want to pack duplicate textures...

Is there any way to extract texture atlas information? As in, coordinates and names of individual icons.

Also any way to select what I actually want to export? I unchecked everything but textures but its still exporting tons of other stuff like materials.

Guys, do you know if there is any way to change the game font? for example, arial. If possible, would I need to extract a UPK file?

I am looking for this kind of armors. Can anyone please tell me what .upk are those? Thank you!
https://i.imgur.com/m8HVEf0.png

Fonts are in LPK files. Fairly sure you can replace them safely, if you follow the same format (it works for replacing .db files for translation purposes).

I forgot to mention that updated script for lpk files supports proper decryption of databases - as it turned out, the adjustment was required all this time. The script is available in this topic (https://cs.rin.ru/forum/viewtopic.php?f=10&t=100672), just look for "other scripts for UE games". It's recommended to use quickbms with -Q argument to significantly speed up the process (it will just disable output logs).

The lpk files updated after the 5th anniversary patch of the KR server do not seem to work properly You know about this?
For your information, I think it's because aes and blowfish changed

Anyone knows where class icons are? I used class_symbol_0 before but they have a gradient/glow on them (I assume there must be a mask version somewhere) and there's no Souleater even after the update.

Does the script actually work? It didn't work for me before (over a year ago) and other people said they got malformed db files as well. I think it was trying to decrypt the whole db at once, instead of resetting IV after every 1024 bytes.

I'm using this JS script instead: https://pastebin.com/BZkk8DFD (it's only unpacking db files because I had some trouble getting zlib to work properly; I think blowfish library needs an older version because the latest one is ESM only).

@mutsa: Korean and chinese versions are region locked and hardly accessible from outside. Unless someone will provide dumped binary from that updated version (here or via PM), I can't do anything.

@d07riv: Yes, quickbms script is doing the same thing now. Anyway, both original scheme and this update were submitted by other people, I've only created implementation for it.

@spiritovod after recent updates to KR client special build of umodel crashes on some packages with LZ4 error. Probably format of the data was changed. Could you please update the tool?

@spiritovod
@d07riv

I'm having trouble unpacking the content of the lpk(db files) is the script working with latest Steam version? what I'm doing wrong?

Steps:
1- run: LAUTool_steam.exe -d data2.lpk data2.lpk.dec
command output the message: Done!
so I guess this work

2- run: quickbms.exe lpk_extract_v6.bms data2.lpk.dec folderName
this one fails with the error:

https://imgur.com/a/kRRrOAQ (https://imgur.com/a/kRRrOAQ)
(https://imgur.com/a/kRRrOAQ)

Thank you for your hard work!
I have managed to extract database files by using Quickbms script only.

However, some files are corrupted (not working) and don't open with SQL db viewers.
I get this error: An error occurred: file is not a database.
95% of files unpacked correctly, Except some large ones.


if anyone is interested I found Eshter weapon upgrade models in this table: EFTable_ItemEvolutionAppearance.db

1100000   10123   EFDLItem_WP_WWHK_TF01_01.WP_WWHK_TF01_01   HK_Item
1100001   10123   EFDLItem_WP_WWHK_TF01_01.WP_WWHK_TF01_01   HK_Item
1100002   10123   EFDLItem_WP_WWHK_TF01_03.WP_WWHK_TF01_03   HK_Item
1100003   10123   EFDLItem_WP_WWHK_TF01_03.WP_WWHK_TF01_03   HK_Item
1100004   10123   EFDLItem_WP_WWHK_TF01_04.WP_WWHK_TF01_04   HK_Item
1100005   10123   EFDLItem_WP_WWHK_TF01_04.WP_WWHK_TF01_04   HK_Item
1100006   10123   EFDLItem_WP_WWHK_TF01_06.WP_WWHK_TF01_06   HK_Item
1100007   10123   EFDLItem_WP_WWHK_TF01_06.WP_WWHK_TF01_06   HK_Item
1100008   10123   EFDLItem_WP_WWHK_TF01_09.WP_WWHK_TF01_09   HK_Item

Spent some time diving into the code to figure out the name obfuscation algorithm. The description from @sylvester334 helped a ton with this, but also cheers to smilegate for leaving the appropriately named FFileManagerWindows::ObfuscateFilename symbol in the EFGame DLL ;)

In short, the names are shifted around by a fixed amount based on the length of the string. Certain characters are first escaped before they are obfuscated, using a pair of characters based on the position % 4 inside the input string. The following table is used for that purpose:


If Q, -, _, X or ! appear in the input string, they will be replaced by one of these based on the position in the string, % 4. In other words, if the 3rd character (idx = 2) is a _, it will be replaced by QT (since 2 % 4 == 2, TABLE['_'][2] == "QT").

Some examples:


Afterwards, the ascii values will be rotated according to a simple caesar cipher, where rotation is offset by the length of the escaped string. This works for all strings longer than 20 characters.

For inputs shorter than 20 characters, the input will be padded by adding a `!` and several `.`s until 20 characters are reached. This string is then escaped. The obfuscation loop then overwrites the period characters with earlier emitted characters, roughly according to the following pseudocode:


For deobfuscation of filenames, you simply reverse the shift, undo the escaping (by checking every pair of characters, seeing if they are in the table and the position % 4 matches the expected substitution, and then replacing the pair with the original character), and possibly split by ! if the original input was padded.

Here's an implementation in Rust capable of replicating both obfuscation and deobfuscation, matching 1-to-1 with the values produced by the game: https://gist.github.com/molenzwiebel/284318d9e963672b239f9fca901be89a. The result after renaming is pretty good!

Oh, Thanks to you, I can deobfuscation everything and watch it neatly. That's cool

@Icos: Nobody has provided samples with non-working packages so far.

@molenzwiebel: Thank you for the explanation and solution for proper packages renaming. I've added reference for your post to base post on the first page.

@All others: Unfortunately implementing renaming into umodel itself wouldn't be effective for various reasons, and it's better to rename packages externally. Also about lpk in the updated korean client - apparently they've changed keys placement there and further research may take a while. I'll better wait until this change is rolled out to other regions (supposedly around January for NA version) to continue research on easily accessible client. Meanwhile, please don't clutter up the topic with related to that issues.

@spiritovod
Here is a small package from the recent KR client:
https://mega.nz/file/vA8CzZbZ#3KiWpSwPi450F2ejO0Ak_QNmKpAfyeh_S4d-tJMIoxc

Produces this error, when trying umodel on it:
Fatal Error: LZ4_decompress_safe returned -6

@Icos: Took a quick look - they've added additional encryption scheme, where key is derived for every suitable package (which is determined separately) from lookup table based on certain calculations on unwrapped package name or something. I suppose my previous post is applied here as well and further research will be postponed until the change is rolled out to other regions.

@spiritovod Thanks for the explanation. Will wait for the fix, once the changes come to other regions.

I made a python script to automatically convert all db files to json: https://raw.githubusercontent.com/BarutSRB/LA_Tools/main/tojson.py

This is the list improperly extracted db files:
https://raw.githubusercontent.com/BarutSRB/LA_Tools/main/failed.txt

Has anyone been able to extract properly the above files?

Is gildor or any debugger still working on this for the recent versions? I have 2023 version of this game, and I don't know where to find a 2021 version.

you can use steamdb to download old versions of games from steam ==> Guide to Download Older Versions of a Steam Game (https://steamcommunity.com/sharedfiles/filedetails/?id=889624474)

@Xanathar, @Barut: It was quickbms related stuff, which caused undefined behavior in some cases. It should be fixed now in the updated script, tested on steam version.

@Aurorans: Read the topic carefully, starting from this post (/smf/index.php/topic,3055.msg41220.html#msg41220). Currently only newest korean version has issues with proper support, other versions should work fine with specific umodel build.

Update Managed to find quickbms files, and the custom build should the inside the first page of this thread

Now   i have to understand how to deobfuscate the pack names i guess

could i ask where i can found the mount models of the game pls?

Will Lost Ark mod be created?
The black desert using Easy Anti-Cheat, such as Lost Ark, also uses the meta injector to apply the mod.
I tried to convert the black desert's meta injector to use in Lost Ark but failed..
Does anyone have any professional knowledge of programming and game modding?
I'm sure you can apply the mod in the same way as the black desert.

Online games can't turn off anti-cheats, so Black Desert also uses meta injectors to keep EAT from noticing that it changed files.
As a result, modding is possible if the meta injector is converted for LOSTARK.

I tried, but I felt limited with my programming skills...

I was stupid..
Blade and soul were also made with ue3, but there was a tool to modify the upk file.
It's sad that there are not many people interested in modding the Lost Ark

Wasn't the encryption of the lost ark already undone?
https://www.nexusmods.com/site/mods/587?tab=description
There is a perfect upk edit tool, but the they says there is no support for mmo.
I'll have to find another way.

there is a way to unpack the upk files of the games? lot's of models fail to load textures inside umodel :(

true, but a lot of models share textures, so for a lot of them the viewer can't find the proper textures, so a way to have all the proper textures, could be to extract the upk, and store the various texture in the same place, in that way loading a model, it could find also the proper texture

i don't know if there is  a smarter way to find where the specific textures are stored

oh really? so i guess we don't have any method to find all the textures of a specific model

@Serpicos: The thing about textures not loading for some models is related to obfuscated packages names and it previously was explained in this post (/smf/index.php/topic,3055.msg44268.html#msg44268). But even if you'll properly rename packages, for some packages you'll need to additionally rename them anyway, which would be more clear from umodel logs, when you open model or texture, and also mentioned in the base post. It's hardly related to umodel and package format in general (decompressed or not), if it's addressing "some.tfc" in the package, but it's "bdca.upk" among actual files. Because the game doesn't seem to use tfc much, you should be able to export almost all textures, though not cross-linked between packages.

@ethan048, @zarro: Please refrain from discussing modding in the topic, because it's out of scope of umodel and the forum in general. Or at least create separate topic for it.

i modified fontmap.xml in Binaries\Fonts\English folder
but it changes only Russian's xml file after repacking back to font.lpk with lpk_repack_test bms script
how can i replace it correctly? ty

now not work umodel dont lost ark ?
(https://s13.gifyu.com/images/Sjf3L.png)

The patch is live and .db files now come out as gibberish. Anyone knows if they changed the key, or the encryption scheme?

The xor value used to derive the database AES key was changed in the new base build.

Old:


New:


(yes, only the final byte changed)

any idea about editing EFTable_GameMsg.db?
a small edit works, "too much edits" and the messages in the game starts to glitch and some appears empty, but a "big edit" break the file , well the file is still working ofc , but the game it self stop reading it.
I tried many different sqlite versions, including the same one that is used by Smilegate

I also tried binary edit on the file to not change the sqlite information atall , but this take too much time so I cannot do a "big edit" I could do "too much edits" which made the messages in the game starts to glitch just like when I do "too much edits" in sqlite.
I wonder how LaoTranslation edited the database , also the Chinese currently editing and adding the CN translation up to date.

maybe a custom version of sqlite ?
I would have said that there is something other than the file preventing the process , however incase of the Chinese translation they are only editing the EFTable_GameMsg file and putting it in the font.lpk, so it should be something related only to this file

I also tried to rebuild the EFTable_GameMsg with the same original entries just incase , and it didn't work , the game stop reading it (just like doing a "big edit").
it would help there was a console or an error logs, i did try to find if the game write any error logs , but no luck.

I almost consumed all my ideas , what left is decompiling the game and trying to get the sqlite files and codes from it, which I doubt I would do anytime soon.

am up for any ideas, I need fresh ideas, a fresh mind other than mine ~.

Hi, I'm trying to fix the game's stuttering and pop-in issues by decompressing all the graphics files, but the tool doesn't seem to work. Anyone know how to fix it?

@spiritovod I have all of the KR files if you would like to take a further look into the issue @Icos was mentioning earlier.

@molenzwiebel: Thank you, updated it in respective scripts.

It seems like they've rolled out that new encryption method for packages to steam version, so I can take a proper look at it. Though it may take a while due to lack of free time.

@spiritovod could you please clarify if the issue with unpacking the textures in KR version was fixed and point me the to the scripts you've mentioned?

The Steam version has been resolved.
I don't think I found the AES key for the other versions.

https://cs.rin.ru/forum/viewtopic.php?f=10&t=100672
Check the link.

Thanks for the link @ethan048. I was hoping spiritovod would also update his custom version of umodel, which supports lostark, though. Looks like it's not the case yet.

Great work.
You succeeded in the end.
I want to talk about modding, but I don't think we should talk about modding here.
Can you make a new topic ?

hello guys any know lostark extract audio files :(

Hello! I'm trying to implement this with the rust-script and rust itself

I run into a build warning when using rust itself. Rust-Script runs it, but doesn't build. Nothing happens when using rust-script name-obfuscation.rs.

Here's my powershell command:


Running it in the Packages directory also does nothing, even if the script is located in that directory.

I am new to rust, what am I doing wrong?

Am I using an outdated version of UEViewer (LA BUILD) or is the file "LOD9LS7OEDEP1EBMOHOT5O.upk" still not able to be opened?

I've extracted every texture that's able to be extracted and I cannot find the textures for "Engraving Icons" so I just assume they're inside that file.. grrrrr

Hi guys! I have a VK version of a game, their using another method of filenames obfuscation. Any know how to deobfuscating that? Maybe just need a different conversion table?

Example:
      Filename: 9G1MBIV4N1GZZEF4H0RG63S.upk
      Object: mn_cdkbo_00_ani_sk
      Class: SkeletalMesh

I'm uploaded a txt file which contains of all obfuscated names.
https://filebin.net/0m9xcpf33zob5wvw/LostArkNames.txt

Hmm, not all packages can be scanned...

Version: umodel_lostark_v5.exe / Compiled Jul 7 2023 (build 1544 based) / VK Version of Game
File: https://filebin.net/0m9xcpf33zob5wvw/185TDNTNZS9YE9RD21SNDN1C1SYD29C9Y9K.upk

There was a post where someone wrote a tool in Rust that deobfuscates the filenames. I'm a C# guy and was able to convert it and made my own program to convert the names of the files.

Here's your txt file converted:
https://filebin.net/jj1h2wo70c4bqw5u/deobfuscated.txt

having all the names deobfuscated could help with the meshes that miss textures?

TheDeadNorth
> Here's your txt file converted
Wow, thank you!)

Np, ill release my program on GitHub when i get the chance to clean it up and make the repo

Hi y'all, did anyone figure out how to export your lost ark character? I'd imagine it's something along the lines of reading the customization (.cus) files and combining assets in the right places. Are character customization options common across UE or completely unique to Lost Ark? Any help is greatly appreciated!

Can you send a new link? the old one isnt working

Any chance of reupload the deobfuscated names?

CLICK (/smf/index.php?action=dlattach;topic=3055.0;attach=4926)

Ive uploaded a program to github. Theres a few things that need to be added but it should work as is.

https://github.com/Twigzie/Fantality-LostArkRenamer

Any issues, please open an issue on github, thanks!

Since the topic got derailed from its original purpose a way too much, all posts with unrelated to umodel issues will be removed from the topic from now on (including modding) - except for renaming utilities, which are related to umodel usage, or actual contributions. If you want to discuss those things, create a separate topic in other forum sections. Thanks for your understanding.

All things from the base post at the first page are mentioned there only for references and could be outdated. Also please don't report problems with some packages in recent game versions, it's a known issue (but thanks to all who did it already, it's actually helpful).