Gildor's Forums

I tested Singularity for Xbox 360, and static mesh is not supported. Animation textures SkeletalMeshes & Textures are supported. Awesome...

..:: ESR911 ::..

Hy Guys!
Can i use umodel for extrackt models and animations and everything else from singularity?

You can extract everything with exception of StaticMesh.

I can't seem to find anything in the model archives , and what i found most of it was with low res textures.

READ!
Hi-Rez Texture Hunting with Umodel
http://www.gildor.org/smf/index.php/topic,207.0.html (/smf/index.php/topic,207.0.html)

..:: ESR911 ::..

******** RT2_heli_XSA.xxx:  Material3'Base_MeshBarfSplatter' ********

ERROR: assertion failed: H.Tag == PACKAGE_FILE_TAG

FCompressedChunkHeader<<:pos=70D0004 <- appReadCompressedChunk <- FByteBulkData::SerializeChunk <- UTexture2D::LoadBulkTexture:File=textures_p1.tfc <- UTexture2D::Decompress:Tex=vomitReflection_d <- UTexture2D::Bind <- GL_NormalmapShader <- UUnrealMaterial::SetMaterial:Base_MeshBarfSplatter <- AppDrawFrame <- Display <- VisualizerLoop <- MainLoop <- Main


Renamed the file that suppose to be the textures.tfc and there is the outcome of it.

Note: i got pc version.

You should not rename files. You can rename C:\WINDOWS\cals.exe to textures.tfc and umodel will crash. That's not my error.

Hy!
And how can i extract it. Like what: I wana export the bridge time repaired, or ladder repaired animations, sounds and musics. But i don't know how. I write  umodel -export "and the file name".xxx but many errors and forced export etc.. and i can't found nowhere the exported things. What can i do ?  ???:(

Dude stop asking stupid questions.. uModel does not export music or sound. Do some reading before you post. this is not about you not being able to find assets, look for them yourself, or PM someone. Umodel Instructions on usage is on the main website. READ IT! http://www.gildor.org/en/projects/umodel (/en/projects/umodel)

..:: ESR911 ::..

1. I don't asking stupid question. READ YOU a little up!!! Gildor say "You can extract everything with exception of StaticMesh." And my question is  HOW. I don't care your helpless! But if somebody say YES YOU CAN Then i wanna know it how! Do you understand me? Therefore i wana talk somebody who realy can help. Gildor what do you say. Can we export the files from this game, and if we can, then how? Thank you for your help.

umodel only supports skeletal meshes, static meshes, textures and animations.  Gildor meant that of those four things, only static meshes are not supported for this game. umodel has never supported sounds, as far as I know. I have exported all compatible files for this game with the correct textures sizes.  

To do this:
1. I had to make 4 copies coalesced.tfc and rename them to textures_p0.tfc, textures_p1.tfc, textures_p2.tfc,textures_p3.tfc. This is the only way I have been able to get it to work. Takes a lot of space but works fine. I had to do the same with 'Wolverine'
2. I made sure that those 4 files, and umodel were in the directory with all the .xxx files.
3. I made and ran a batch file with this code from that same directory:

@for /f "tokens=*" %%a in ('dir /b *.xxx') do ( umodel -all -export %%a )

Make sure you have a lot of free space and have fun sorting through all the files. Good luck.

p.s I can't take credit for that batch file code, I got it from someone else on this forum but I can't remeber who. sorry. but it works well.
 

I honestly have no idea what you just wrote, right there....

Nice post, I wrote how to do that and as I have said it is here: http://www.gildor.org/smf/index.php/topic,207.0.html (/smf/index.php/topic,207.0.html).

Wolverine was especially difficult. extract.exe will extract everything from upk files. that doesn't mean that all the assets are usable. that n00b should not be upset at me. I am trying to make sure people don't waste Gildor's time. To extract music and sound will only work if it's unencrypted OGG, and you would need to extract it with some OGG exporter, and yes uModel only supports StaticMesh, and Skeletal Mesh, animation & textures on some games.

If more functionality is necessary a quick PM to Gildor can easily answer your questions.

..:: ESR911 ::..

Well said esr911,

Has anyone looked at the files from both the PC version and the Xbox360 version? Is there a significant difference?  I have the x360 version, but would purchase the PC version if there are higher res textures, for example.

i can't extract anything from the pc version always getting a error on every package  :-\

using -nostat option lets me open the pc packages, (some of them, others wont decompress) but then trying to view a skeletal mesh making it close. textures seem fine for the most part. wait, the textures make it quit sometimes too with an HTAG error.  all i'm getting is cubemaps and effect textures...

Me too. I did exactly like it was stated in zardalu's post but i can't export any skeletal meshes, only anims and some textures. Any ideas?

well i've managed to extract the pistol mesh using -nostat imported into max with anims and textures works perfectly but i don't know where the hands are saved if someone knows please tell me  ;D

i deleted the renamed .tfc files (textures_p0-3) and now it works alright...

my guess for the hands is RvGame.xxx but it wont decompress for me.

hmm you could be right well i thought this file has unreal script.

won't extract work here too

Yes that seems to work, but now the textures are extremely small. Like icon size, 64x64 pixels. :-X

I went out and bought the PC version (yet another game purchased because of umodel  :)) . The PC version of coalesced.tfc is different than the xbox version. It is somewhat larger (1.2 GB compared to 900MB). I have uninstalled Singularity for the moment to make room for Transformers extracting, can someone post the error they get when they try to extract files with the renamed textures_p0-3 so that gildor can look at it if he has a moment?

PC UE3 uses LZO compression vs LZX on XBox360. LZO is faster, but produces worse compression ratios (that's why PC files may be larger than XBox 360 files).

umodel -export -nostat SP_RT_NPC_Katya_XSA.xxx

http://www.mediafire.com/?jnwbjhn1jth (http://www.mediafire.com/?jnwbjhn1jth)

here's a file that wont decompress

This file uses "whole package compression" scheme (which is used for script packages only, usually *.u). I think it is useless for most people :)
Technical info. PC UE3 uses zlib to compress packages of such type (scripts), but this package is compressed with LZO. Umodel tries to decompress it using zlib and failed (there is no way to detect compression algorithm by compressed data).

ohkk, is there any way to force umodel to use LZO?


I really think some of the multiple packages that won't decompress aren't just scripts, they seem too big.

all the files that have this also have a corresponding 1kb size ".xxx.uncompressed_size" type file.

No

So i'm guessing only 360 singularity package works fine then, and not for the pc one, correct?

No, I have tested Singularity for PC, and it works fine. All assets that  are supported are extracted perfectly.

..:: ESR911 ::..

esr911 or gildor, I would like to extract textures from this game (PC) but have not been able to.

gildor says don't rename, esr911 says rename :P

esr911, do you think you could help, since you have done this successfully?

Without renaming, only 64x64 thumbs are extracted.

With renaming, extract fails:

I can't help you because I have no this game (neither PC nor XBox360 versions).

I don't know what you are doing, or why this is difficult, I have this game and I have extracted the textures from SP_WL6_kismet_1950_XSA.xxx fine.

* Make sure you have the latest uModel version

1. Copy the SP_WL6_kismet_1950_XSA.xxx and the Textures_P1.tfc to one folder.
2. open CMD: Start>Run>CMD <Enter>. CD to the correct folder where you have placed both files. Make sure uModel is either in your path in your environment variables, or in the same folder.
3. use this command: umodel -export -nostat -nomesh -noanim "DestinationPath"SP_WL6_kismet_1950_XSA.xxx <Enter>

It should work without a problem. Make sure that Umodel is either in your path, or in the folder you are extracting from. I did this to test for you, and got no errors, and the textures are > 64k

..:: ESR911 ::..

Note: Renaming of the tfc is not necessary, look at your error. It is trying to find the Textures_P1.tfc. Just make sure it's in the same folder as the SP_WL6_kismet_1950_XSA.xxx file and you should be fine. Let me know if this works for you.

Thanks for being willing to help esr911. I am also not sure why this is difficult  :-\

As far as I know I've done exactly what you described - yes, I'm using latest umodel:

All I can think of is that you are trying to extract the PS3 version that has different compression. I don't know if that is the case. The version I have extracted is the PC version. I have check both package versions and they match. What is strange though is that my Textures_P1.tfc is only 998,872,182 so I would say that you and I are extracting different versions.

..:: ESR911 ::..

I bought the game for PC, on physical DVD, at retail in Canada. The files are copied directly from my installed copy of the game.

Textures_P1.tfc is renamed from coalesced.tfc, correct?

If that's all correct - and you say the package versions are the same - then for some reason, there exists different versions of the .tfc file for PC, and the version I happen to have - and probably others have this version as well - causes problems for umodel :(

I know the problem.

The problem is there are are 3 files for texture in this game. You do not have to rename anything for this game. Some games you do, but this one you don't.

the files are:

coalesced.tfc
Textures_P0.tfc
Textures_P1.tfc

Just copy all of them to a folder and try it again.  8)

..:: ESR911 ::..

Oops :-[  Wow I feel stupid :P  That's why I'm still a newbie :)

I didn't see the Textures tfc files when I was looking in the game files. Problem is there are a million files there ;)  Will look again tonight when I get home from work.

Thanks!!

Alright, yay, I'm not stupid :) Maybe :P

So I'm looking in the installation directory and searching for all .tfc files:

Program Files\Activision\Singularity(TM)

And there is only one .tfc file, coalesced.tfc, and it's in:

Program Files\Activision\Singularity(TM)\RvGame\CookedPC

There is no Textures_P0.tfc or Textures_P1.tfc file.

???

Bro, I never said you were stupid, but I don't know how to help you, we have different versions of the game obviously. Mine has 3 tfc's

My only suggestion is try to download it from the internet, and then try it if you can't figure it out.

..:: ESR911 ::..

Try to open package without copying files - directly from the game directory (check my tutorial movie (/projects/umodel/tutorials) if you don't understand me). Check the log - it should describe why low-res texture is used. Try to open specific texture only to reduce a log size, example:

I tried directly from the game directory (CookedPC, where all .xxx files and coalesced.tfc are located), with same results. umodel reports missing .tfc files and only gives 64x64 thumbnails.


I notice some complaints for Textures_P3.tfc for example, what did you do for those files?

I tried a downloaded copy (RELOADED) just in case it was different, but it was exactly the same. There is only one .tfc - coalesced.tfc.

I live in Canada so the copy I physically bought at retail was Canadian retail copy.

I don't know what the region is of the downloaded copy I tried.

I'm curious what region you live in? Maybe your region has different configuration / cooked files for whatever reason.

:(

Hi AJ. I too am from the Great White North  ;)

I had to make 4 copies of coalesced.tfc, and rename them to:

coalesced.tfc
Textures_P0.tfc
Textures_P1.tfc
Textures_P2.tfc
Textures_P3.tfc

I put all four of them in the same folder as the packages that I was trying to view.

I was then able to view and export everything correctly. This is probably not the right way to do it, but it worked for me.

You can use new option "-lzo". RvGame.xxx can be opened now.

Update.
I've implemented StaticMesh support. This game is fully supported now.

Awesome!  Thanks Gildor!  ;D

Nice! Thanks a whole bunch Gildor!

EDIT: I'm really sorry to bring back this topic, but I just decided to try out the Viewer on the game (PC version naturally) but somehow I'm having a totally different error.

For some reason, certain texture maps and/or Materials are crashing the Viewer and I cannot open them. Here is what I did (hopefully, someone can help me).

-Copied the .TFC file (x4) and renamed each one (Texture_P0 -> _P3)
-Tried using -lzo switch (doesn't work)
-Tried using -nostat and -noanim switch (doesn't work)
-Using -notext switch (will work correctly and show mesh, but no textures)
-Force export (only Mesh's are exported and only 1 normal map, but it's corrupted)

Exporting, with only coalesced.tfc doesn't crash the viewer, however, the textures are all 64x and the log complains about Textures_##.tfc missing. At the same time, I cannot export with Textures_##.tfc because it crashes the Viewer for some reason. Here is the latest log I got when I tried exporting normally:


The only thing I gathered is that the Materials are crashing the Viewer...because from certain packages, I'm able to View them both texture and mesh, but as soon as I press Up or Down, to go to the next 'asset', it crashes, usually when I'm on the material (I think).

Also (please note I'm ignorant on such stuff, so I could be wrong) but somehow, the latest Viewer (Feb-06) is about 50KB smaller then the older viewer (Feb-02)...is that correct?

Cheers, and ciao.

Ace, You are correct. I have also experienced the exact same thing.

..:: ESR911 ::..

If you will rename "readme.txe" to "textures_p1.tfc" it will also crash umodel  ;D
To be serious - renaming of tfc files is not correct thing.

Ofcourse, that was my first thinking also, so I tried keeping the original .TFC as backup + .TFC 0,1,2,3. I tried different combination's of .TFC in different folders and even in all .TFC in same folder, but nothing works. All mesh work, but texture and/or material crash the Viewer.

I checked Viewer on other games (again, PC) such as Mirror's Edge, Turok, and Mass Effect 1 and 2, and they all work fine, so nothing is broken.

I was wondering, is there a way to disable Materials? Not the Textures, but the Materials themselves? As I said, for some strange reason, the packages only load 'correctly' and stop crashing when I use -notex.

I hope I'm not bothering you. I can very easily get the X360 version and get all the assets from that game if the PC version is too complicated and brings problems all the time, but I would like someone to confirm if X360 version is working with latest update.

OR, if somone could upload Feb-02 version of Viewer so I can get Textures, and use latest version to get Models...works either way for me, I just would like to make sure with other people here.

Do you mean - an older umodel version were worked correctly with this game??

I think the previous one wasn't crashing with .TFC0-3 and only Static Mesh didn't work (-nostat), almost like Exsteel problem long time ago.

Again, it's not a big problem for you to waste time and fix, just wanted to make sure with other people.

Question: Will the Singularity.exe make a difference if it has been change? Like patched game, cause I downloaded latest Patch for game?

Static meshes has no effect on textures.
No.

Found problem: DXT-5 Textures work OK with TFC## packages, but DTX-1 crash.

Example: Monster Normal Map - DXT-5, show up in Viewer correctly, go to WaterNoise Normap Map - DXT-1 crash.

Low-Resolution Textures works OK on both, but High Resolution, only DXT-5 work...

Texture compression method does not affects this. The problem is with incorrect data pointers. Texture has a pointer to hi-res data in the tfc file (file offset), but tfc file has data in the different positions. That's why umodel may crash.

So no one willing to upload the February-02-2011 version of the Viewer? That would help me alot.

Why do you want to get an old umodel? I have not changed texture support for Singularity, it should be the same in all versions.

zardalu was able to get it working with old version and export everything.

esr911 also said that he's getting the same problem now (on page 2-3 he didn't have the problem with old version).

What worked for me was extracting the textures from xbox360. The PC textures didn't extract at all when I renamed the tfc's it was needing.

..:: ESR911 ::..

Extracting textures from the PC version still doesn't work for me. It would be really great if it could work. If it works with an older version of umodel for some reason, it would be great to have the older version.

Or, now I have to find an Xbox copy of the game, if apparently it works with Xbox copy.

Hi guys, my apologies, I looked through these files again because of the confusion, and I should clear up what I had found earlier:

I have both versions of the game, xbox and PC, and I was only able to get the XBOX textures working.  PC Textures are not working for me, it doesn't matter which version of UE Viewer you use, old or new.

Sorry for the confusion.

The best solution I have found, is extract the x360 textures, and extract the PC textures to. Copy the larger textures over the smaller when you replace them.. PC has the best textures than PS3 or X360. So there you go.

..:: ESR911 ::..

Well I don't have Xbox version unfortunately, and I couldn't find an active Xbox torrent with reasonable download speed. I have legal retail PC version with only one TFC file. I checked PC torrents and they are all the same as mine, only one TFC file.

I am guessing some of you were getting confused when you said PC has multiple TFC files, maybe you were also looking at Xbox version instead?

esr911, you're saying PC has the best textures?

Maybe Gildor can look at it again one day, because I would really like to extract from this game.

I can supply any needed files for testing, either for download or mailed on a disc.

Hi.
What is the pass of Singularity psk files?
Thanks.

???

He's asking the Password for Uberblack3D's files...

http://uberblack3d.com/singularity/#comment-39

I can't find the Textures_XXX.tfc at all....why?
when I export,it said Textures_XXX.tfc is missing. ???

Why don't you get it from your iso/disk to install.

OK, I think we need to clear some stuff up once for all.

After testing alot, Singularity for PC has a different Texture file as opposed to the console version. So far, the only thing which is a sure-shot to take is the X360 version, dump it, and extract the textures from there, or alternatively, like me, use Uberblack's site to download the whole stuff from there.

Also, I would like to apologize for any confusion earlier, after much testing with a few old Umodel versions, and different renaming of the packages, I can say that the textures for the PC version won't be extracted, there isn't a magical bullet.

Both PC and X360 version have the same quality textures and same polycount on the models, there is no difference apart from compressions of the textures, but even that isn't a viable problem.

The point is simple, either dump the X360 version or download UberBlack's extracted files, because honestly, there is no difference between the versions in anyway or form.

Thanks for clearing it up, it's good to have the confirmation. It's sad that the PC textures aren't larger than the Xbox ones. The game has a lot of great design in the textures, but none of them are very large so you can't really appreciate the fine work that they did. I thought Singularity was a fun and unique game... I think if another publisher had published it, it might have got the recognition and publicity that it deserved.

I have problem decompress files.. ^(( fix it plz..

******** MP_CvS_Manufacturing_p.xxx ********

ERROR: zlib uncompress() returned -3
appDecompress:CompSize=34863 UncompSize=131072 Flags=0x1 <- DecompressBlock:block=388+882F <- FUE3ArchiveReader::PrepareBuffer <- FUE3ArchiveReader::Serialize <- FArchive::ByteOrderSerialize <- FPackageFileSummary<<:Ver=0/0 <- UnPackage::UnPackage:Startup_INT.xxx, ver=99999/0, game=0 <- UnPackage::LoadPackage:startup_xxx <- UnPackage::CreateImport:MP_CvS_Manufacturing_p.xxx:1294 <- UnPackage::SerializeUObject <- TArray::Serialize:0/2 <- ReadProperty:(UMaterial3.ReferencedTextures) <- CTypeInfo::SerializeProps <- UObject::Serialize <- LoadObject:Material3'MP_CvS_Manufacturing_p.BezierBeamTMD', pos=53626B, ver=584/126, game=8024 <- UObject::EndLoad <- UnPackage::CreateExport:MP_CvS_Manufacturing_p.xxx:2583 <- LoadWholePackage <- Main

Use "-lzo" switch.

Hi there. Recently i got hands on Singularity game and want to make HD texture pack. But... none of the unreal programs was able correctly unpack "hi-res" textures from tfc even umodel. So i dig deeper into tfc and found interesting thing.

Gildor FAQ says that tfc can't be unpacked directly. So that's normal that tfc has another TOC inside? Or someone overlook something?
(https://i.postimg.cc/2CZ7fRJ9/sing-toc.jpg)

From what i can see it looks like it has info for "hi-res" textures. But only offset/compressed size/decompressed size. No texture dimensions or format.

Upss... I overlook something...
So now it's clear and you are aware of that problem. But how to fix it?

Maybe i got the culprit... Multi chunks.
(https://i.postimg.cc/PTZZKMnD/multichunks.jpg)
After decompressing each of them with qickbms i got nice texture in 1K.
(https://i.postimg.cc/Y9zS7SHL/tex.jpg)

@h3x3r: Apparently the game is using its own unique way of handling tfc cache and bulk data for pc version. Instead of addressing bulk data directly from packages, like it usually works, packages are addressing some dummy offsets for bulk data - most of them are invalid, though some occasionally points to valid offsets. While tfc is serialized separately with two tables - short one with guids/hashes and offsets to bulk data for 3 mips for every included texture, and more complex one with filenames and bulk data summary for 3 mips. I guess in packages bulk size of -1 is flag that first 3 mips for current texture would be read from tfc (via hashes or filenames).

Implementing something like this in umodel is cumbersome, but I've included quickbms script for extracting raw textures from tfc with names (biggest mip only) in this topic (https://cs.rin.ru/forum/viewtopic.php?f=10&t=100672) (look for "other scripts for UE games"). Extracted textures can be converted with rawtex, while you can view approximate image sizes and format for a texture in umodel.

Thanks @spirit for the script. BTW who the hack can put toc offset pointer on the end of file?... This engine is real nightmare compared to id tech imo.

So if this game has it's own unique way of handling tfc then there is no way of creating another tfc with UPK Explorer and assigning it with TFC Installer?

@h3x3r: Actually, that's normal way to handle such things. UE4/5 packages works in around the same way, it allows to reduce amount of seek/read operations from hard drive and a lot of engines are using similar approach for data archives, except that index is usually stored in separate file.
As for the second thing, I'm almost sure that the game will not understand normal tfc, because of the format and how bulk data is addressed in packages. Though it's applied only to pc version, judging by old posts from the topic.