Gildor's Forums

English Forum => Other games => Topic started by: iservealot on July 08, 2010, 21:03



Title: Splinter Cell Chaos Theory/Double Agent
Post by: iservealot on July 08, 2010, 21:03
Helllo all, wanted to come on here and say thanks again to Gildor for creating such an awesome tool!
Glad to see a strong community with an interest in Unreal game animations and model assets so we can all learn and inspect them.

I had already attempted to contact you Via facebook, but thought I would do it in a more "official" way on your forums.

Once again, I am looking to see if you could possibly add support for Splinter Cell Chaos Theory and Splinter Cell Double Agent (Unreal Engine Warfare 2.x version 829). Up to date, I haven't found any record of anyone who was able to extract any Unreal data from either game because the traditional Unreal file format is not directly exposed (.unr, .usx, .ukx, .uax etc). I've been able to find a method to extract in-tact unreal files from both games, and would love nothing more than to see your tool add support for these engine builds. Currently, an "assertion failed" error is given. I do understand that your tool currently provides support for several compression schemes, but I would like to let you know that Double Agent nor Chaos Theory use traditional compression schemes, but instead use in-house developed localization that actually break Unreal data.

I have attached a link to in-tact Unreal data for both Chaos Theory and Double Agent. I am corssing my fingers in hopes that you can provide support for both of these games sooner rather than later as it will directly affect development of a future release project in the works right now.

Thanks again for all your support up until now and hope to see what magic you can work with this!

Chris

Link - http://rapidshare.com/files/405751319/Chaos_Theory_and_Double_Agent_Animations.zip


Title: Re: Splinter Cell Chaos Theory/Double Agent
Post by: iservealot on July 08, 2010, 22:22
I also forgot to mention that there is a strong possibility that some or all of the animations data might be Motion Builder Data (.fbx) format.

Don't know if that then makes this impossible or not. The model should still be .psk.

Also, there is a high chance that Havok Physics data is located somewhere inside either the .psk model, or animation data.


Title: Re: Splinter Cell Chaos Theory/Double Agent
Post by: Gildor on July 08, 2010, 22:36
I have checked Splinter Cell Chaos Theory 2 years ago without any success. But with a latest 2 years I've got some experience with reverse engineering Unreal-based games, so this task may be possible now :)

I have looked at files you have sent - it looks like these games are made with different UE modifications :(

I also forgot to mention that there is a strong possibility that some or all of the animations data might be Motion Builder Data (.fbx) format.
It's nonsense. FBX is an intermediate format not intended for direct use in realtime applications. It is closed format without any specification.
Also, Unreal never stored meshes in packages in PSK format - it is another intermediate format (but made by Epic Games, not by Autodesk). Umodel whould be trivial in a case Epic stored meshes directly in psk format ;)


Title: Re: Splinter Cell Chaos Theory/Double Agent
Post by: iservealot on July 09, 2010, 00:06
The only reason I mention .FBX (Motion Builder Data) is because the internal editor supported this method of impot (unreal editor).

I am willing to help in any way a I can to see that animation data can be exported.
This includes possibly revealing how to export Unreal data from Chaos Theory.

I can also create a custom brand new .ukx Unreal package from a .psk of your choosing, if it helps to identify how exactly the data is stored inside of the package.

Let me know!


Title: Re: Splinter Cell Chaos Theory/Double Agent
Post by: iservealot on July 10, 2010, 12:32
I have checked Splinter Cell Chaos Theory 2 years ago without any success. But with a latest 2 years I've got some experience with reverse engineering Unreal-based games, so this task may be possible now :)

I have looked at files you have sent - it looks like these games are made with different UE modifications :(

I also forgot to mention that there is a strong possibility that some or all of the animations data might be Motion Builder Data (.fbx) format.
It's nonsense. FBX is an intermediate format not intended for direct use in realtime applications. It is closed format without any specification.
Also, Unreal never stored meshes in packages in PSK format - it is another intermediate format (but made by Epic Games, not by Autodesk). Umodel whould be trivial in a case Epic stored meshes directly in psk format ;)

What do you mean by "different UE modifications" ?


Title: Re: Splinter Cell Chaos Theory/Double Agent
Post by: Gildor on July 10, 2010, 13:08
What do you mean by "different UE modifications" ?
Those games uses modified UE engine made by independent developers.


Title: Re: Splinter Cell Chaos Theory/Double Agent
Post by: iservealot on July 10, 2010, 13:14
Can you tell me how I can help your extraction process? Would it help you in figuring out the file layout/offsets?


Title: Re: Splinter Cell Chaos Theory/Double Agent
Post by: Gildor on July 10, 2010, 13:20
I'm not dealing with "offsets". It is not possible to correctly extract data from Unreal game without reading data format completely. Some data structures has variable size, so its even impossible to skip array of such structure type without parsing it.


Title: Re: Splinter Cell Chaos Theory/Double Agent
Post by: iservealot on July 10, 2010, 13:48
okay. Would import of a custom PSA/PSK import help at all?


Title: Re: Splinter Cell Chaos Theory/Double Agent
Post by: iservealot on August 25, 2010, 06:06
Just wanted to bump this and check the status of this.

I am happy to provide additional assets/support if need be.



Title: Re: Splinter Cell Chaos Theory/Double Agent
Post by: Gildor on August 25, 2010, 11:50
I have spent some time researching internal package structure for this game. I have (probably) found package [de]compression code, but unfortunately I'm too busy with other things to try this out.


Title: Re: Splinter Cell Chaos Theory/Double Agent
Post by: iservealot on August 25, 2010, 21:28
Are you refering to compression/decompression of .LIN and .HLN?
Or compression/decompression of the .ukx files that I sent you?


Title: Re: Splinter Cell Chaos Theory/Double Agent
Post by: Gildor on August 25, 2010, 22:52
I've spoken about Splinter Cell Conviction :)


Title: Re: Splinter Cell Chaos Theory/Double Agent
Post by: iservealot on August 26, 2010, 01:26
Oooohh sorry, I was referring to double agent/ chaos theory.

The .ukx I sent you was one I've made from the Double Agnet  engine build.

What are your thoughts about the file format/extractionof those animations?


Title: Re: Splinter Cell Chaos Theory/Double Agent
Post by: Gildor on August 26, 2010, 01:29
I don't have a game executable files to check, I cannot analyze pure data files.


Title: Re: Splinter Cell Chaos Theory/Double Agent
Post by: iservealot on August 26, 2010, 05:18
So sorry, let me arrange for you to get them.

Also, the Double Agent Demo and Chaos Theory demos have similar game structures, and this their .exe should work as well as a retail.

I'll send you a PM...

**edit - also, I can confirm that Conviction does in fact use ZLIB data for all Unreal package contents. I was only able to export out some small minor chunks correctly**


Title: Re: Splinter Cell Chaos Theory/Double Agent
Post by: Tosyk on October 11, 2010, 05:00
So what about Splinter Cell Games, Gildor? Do you still need a .exe file, or iservealot give it to you? I'm very interesting in this progress :)


Title: Re: Splinter Cell Chaos Theory/Double Agent
Post by: Gildor on October 11, 2010, 11:02
I have no executables for these 2 games.
Anyway, I have no enough time to implement everything I have planned.


Title: Re: Splinter Cell Chaos Theory/Double Agent
Post by: Tosyk on December 13, 2010, 18:14
I have *.u and *.exe files (http://www.mediafire.com/?pf4cpaawy8cs9cf) from Chaos Theory. Gildor please take a look at them.


Title: Re: Splinter Cell Chaos Theory/Double Agent
Post by: iservealot on December 16, 2010, 09:36
Gildor, I have also attached an animation file from Splinter Cell Double Agent and its associated .exe and debug.exe if it is of any help.

Also I provided DLL files if you find these useful. Let me know if there is anything else I can do to  help get this game supported.


P.S. - Splinter Cell 3 Chaos Theory .exe (previous post) contains DLL information baked into the .exe

http://www.mediafire.com/?03ic969944n47pq



Title: Re: Splinter Cell Chaos Theory/Double Agent
Post by: Gildor on December 16, 2010, 16:49
Tosyk and iservealot
I need a pkgtool report for game autodetection.

Tosyk
You have not provided any sample animation file. Plus, provided game exe is encrypted, I cannot analyze it.
But Double Agent is a next Splinter Cell game, probably its support allow umodel to load Chaos Theory files too (Double Agent files are not encrypted).


Title: Re: Splinter Cell Chaos Theory/Double Agent
Post by: Tosyk on December 16, 2010, 17:36
Tosyk and iservealot
I need a pkgtool report for game autodetection.

Tosyk
You have not provided any sample animation file. Plus, provided game exe is encrypted, I cannot analyze it.
But Double Agent is a next Splinter Cell game, probably its support allow umodel to load Chaos Theory files too (Double Agent files are not encrypted).

Here (http://www.mediafire.com/?w3xxooe6eogbx) is animation and texture packages from Chaos Theory. I find only one tool called pkgtool, but it for Linux only and i don't have linux :-\


Title: Re: Splinter Cell Chaos Theory/Double Agent
Post by: Gildor on December 16, 2010, 17:53
I find only one tool called pkgtool, but it for Linux only and i don't have linux :-\
You should use local forum search, not Web search :)
Or google ...
http://www.google.com/search?hl=en&source=hp&q=site:gildor.org+pkgtool&btnG=Google+Search&aq=f&aqi=&aql=&oq=&gs_rfai=


Title: Re: Splinter Cell Chaos Theory/Double Agent
Post by: Tosyk on December 16, 2010, 18:03
I find only one tool called pkgtool, but it for Linux only and i don't have linux :-\
You should use local forum search, not Web search :)
Or google ...
http://www.google.com/search?hl=en&source=hp&q=site:gildor.org+pkgtool&btnG=Google+Search&aq=f&aqi=&aql=&oq=&gs_rfai=

Sorry for delay and stupidity ;)
Quote
Found 124 game files (736 skipped)
Version summary:
Ver        LicVer     Count   Filename
175 ( AF)    0 (  0)   110    Versus/...


Title: Re: Splinter Cell Chaos Theory/Double Agent
Post by: Gildor on December 16, 2010, 18:10
175 ( AF)    0 (  0)   110    Versus/...
Strange ... U files you've sent to me have version
Code:
100 ( 64)  124 ( 7C)
You've used pkgtool on a wrong game?!


Title: Re: Splinter Cell Chaos Theory/Double Agent
Post by: Tosyk on December 16, 2010, 18:29
Quote
D:\Games>pkgtool.exe "D:\Games\ChaosTheory"
Found 124 game files (736 skipped)
Version summary:
Ver        LicVer     Count   Filename
175 ( AF)    0 (  0)   110    Versus/...

D:\Games>

is something wrong?


Title: Re: Splinter Cell Chaos Theory/Double Agent
Post by: iservealot on December 18, 2010, 21:32
Your tool found Versus game data, they ARE compiled weird. Versus data is the multipalyer game and IS a different Unreal Engine build and developed entirely differently in a different studio. (though there is a Versus Unreal Editor that shipped with that game)

I will provide Chaos Theory animation data. The data library is not original Unreal, but I will see about extracting .ukx files for you. Give me a moment.

(note - Chaos Theory and Double Agent are derived from same engine build, but offsets are different)


Title: Re: Splinter Cell Chaos Theory/Double Agent
Post by: iservealot on December 18, 2010, 21:40
Confirmed - Tosky uploaded game data from Versus, which is Chaos Theory's multiplayer game. (would be awesome to have animation data from that game, too)

Here are proper animation and SM data from Chaos Theory RETAIL Singple Player/Coop.
Note: Retail Chaos Theory and Demo Chaos Theory are not the same.


http://www.mediafire.com/?cpsd6sdlyz0d03w


Title: Re: Splinter Cell Chaos Theory/Double Agent
Post by: esr911 on December 18, 2010, 22:11
Confirmed - Tosky uploaded game data from Versus, which is Chaos Theory's multiplayer game. (would be awesome to have animation data from that game, too)

Here are proper animation and SM data from Chaos Theory RETAIL Singple Player/Coop.
Note: Retail Chaos Theory and Demo Chaos Theory are not the same.


http://www.mediafire.com/?cpsd6sdlyz0d03w


Don't get your hopes up. This is a very heavily modified version, with lots of hacks. I would bet
that if there isn't a donation on this.. it won't be supported as it would take too much time.

..:: ESR911 ::..


Title: Re: Splinter Cell Chaos Theory/Double Agent
Post by: iservealot on December 18, 2010, 22:18

The game engine itself is still core UE2, and stores information just as UE2 does. The big hurdle to pass is actually reading the original UE data as it is encrypted, proprietary format - but i have already done that (as seen in my attachment above)



Title: Re: Splinter Cell Chaos Theory/Double Agent
Post by: esr911 on December 18, 2010, 22:48
Confirmed - Tosky uploaded game data from Versus, which is Chaos Theory's multiplayer game. (would be awesome to have animation data from that game, too)

Here are proper animation and SM data from Chaos Theory RETAIL Singple Player/Coop.
Note: Retail Chaos Theory and Demo Chaos Theory are not the same.


http://www.mediafire.com/?cpsd6sdlyz0d03w


Don't get your hopes up. This is a very heavily modified version, with lots of hacks. I would bet
that if there isn't a donation on this.. it won't be supported as it would take too much time.

..:: ESR911 ::..

The game engine itself is still core UE2, and stores information just as UE2 does. The big hurdle to pass is actually reading the original UE data as it is encrypted, proprietary format - but i have already done that (as seen in my attachment above)

None the less Gildor - if efforts seem to take a lot of time to read this data out - what do you think is a fair donation?

As I am an artist and not a programmer you really have to PM him, and come to some arrangement, if he has the time. He has known to support formats on donation in the past, and has always done a stellar job.

..:: ESR911 ::..


Title: Re: Splinter Cell Chaos Theory/Double Agent
Post by: Gildor on December 21, 2010, 12:03
The data library is not original Unreal, but I will see about extracting .ukx files for you.
What does this mean?


Title: Re: Splinter Cell Chaos Theory/Double Agent
Post by: Gildor on December 21, 2010, 13:10
Splinter Cell Double Agent SkeletalMesh support is done.

(http://i043.radikal.ru/1012/3f/29ac3c8f04a5t.jpg) (http://radikal.ru/F/i043.radikal.ru/1012/3f/29ac3c8f04a5.jpg.html)

"-game=scell" is required (because I have no pkgtool report for this game).
Also I have no any utx package to test texture support.
Animations are not supported.


Title: Re: Splinter Cell Chaos Theory/Double Agent
Post by: logansan25 on December 21, 2010, 17:30
Pc or xbox 360?
Amazing gildor!!!!!!!!!!!!!!


Title: Re: Splinter Cell Chaos Theory/Double Agent
Post by: iservealot on December 21, 2010, 23:30
Do you see any information in the package that could relate to havok/collision tree


Title: Re: Splinter Cell Chaos Theory/Double Agent
Post by: Gildor on December 21, 2010, 23:54
Umodel does not read collision.


Title: Re: Splinter Cell Chaos Theory/Double Agent
Post by: iservealot on December 22, 2010, 03:57
Am I correct that the command should be

Umodel.exe -game=scell AnimPackageName.ukx

?

If so, I get assertion failed.


Title: Re: Splinter Cell Chaos Theory/Double Agent
Post by: Gildor on December 22, 2010, 09:44
You should also add "-noanim".


Title: Re: Splinter Cell Chaos Theory/Double Agent
Post by: Tosyk on December 23, 2010, 08:16
Why i get this error?
Code:
D:\ant\g\SplinterCellDoubleAgent\SCDA-Online\Packages\_Common\Animations>umodel.exe -game=scell -noanim Sperso.ukx
Found 10 game files (17 skipped)
******** Sperso.ukx ********
*** ERROR: assertion failed: size >= 0 && size < (256<<20)

appMalloc:size=-51 <- TArray::SerializeSimple <- FPackageFileSummary<<:Ver=174/0
<- UnPackage::UnPackage:Sperso.ukx, game=2003 <- UnPackage::LoadPackage:Sperso.ukx <- Main

p.s.: here (http://www.mediafire.com/?ggql0rqq3qj35sh) is textures from scell-da


Title: Re: Splinter Cell Chaos Theory/Double Agent
Post by: iservealot on December 23, 2010, 09:45
You are attempting to view iltiplayer packages. Goldie mist add support for that unreal 2 build as it is separate from the sp.

Send him the daonline.exe and anim package as it's all separate from the so contne t


Title: Re: Splinter Cell Chaos Theory/Double Agent
Post by: Tosyk on December 23, 2010, 11:25
Gildor please tell me exactly what package you tested, because i can't open anything in double agent.


Title: Re: Splinter Cell Chaos Theory/Double Agent
Post by: Gildor on December 23, 2010, 15:45
You can see on the screenshot - "swat.ukx". I've got this package from iservealot.


Title: Re: Splinter Cell Chaos Theory/Double Agent
Post by: Tosyk on December 24, 2010, 04:34
You can see on the screenshot - "swat.ukx". I've got this package from iservealot.
I can't find it in double agent folder, are you shure this file from that game?

And also can you look on the files from single game, because most interesting things exactly in those files, i'm uploaded "double agent" sample here (http://www.mediafire.com/?f16g2y2bwa46qb1).


Title: Re: Splinter Cell Chaos Theory/Double Agent
Post by: stonecoldnuts on December 24, 2010, 07:44
I couldn't find swat.ukx in Double Agent, either. Maybe from Chaos Theory?


Title: Re: Splinter Cell Chaos Theory/Double Agent
Post by: Gildor on December 24, 2010, 09:58
May be iservealot can answer - where did he get that files?


Title: Re: Splinter Cell Chaos Theory/Double Agent
Post by: Tosyk on December 30, 2010, 05:32
Gildor, can you look at the files from my previous posts, i attached both from chaos theory and double agent. Hope we have chance to see models from sc.

I couldn't find swat.ukx in folder chaos theory too.


Title: Re: Splinter Cell Chaos Theory/Double Agent
Post by: Gildor on December 30, 2010, 11:54
These files are archives, contains ordinary UE2 packages inside.


Title: Re: Splinter Cell Chaos Theory/Double Agent
Post by: Pepsee on July 07, 2018, 23:12
So far little progress on Double Agent and none on Chaos Theory, Double Agent (PS2/Xbox/Gamecube)... What about Splinter Cell 3DS? I extracted the .iso and files until I got a .bf file named "SC3.bf"... Pretty straight forward...
Here (https://mega.nz/#!gJQVRAiR) is the file, I have no idea what else to do to it...

Decryption key for download link on MEGA: !0-UWpX_JpMxKxiV0NRHg5pzxTsW-ITVrsAt7hroSPpc