Gildor's Forums

English Forum => Bioshock => Topic started by: MegaScience on March 23, 2013, 21:33



Title: Prepare to support BioShock Infinite?
Post by: MegaScience on March 23, 2013, 21:33
Hello. Several years ago, I used this program for documentation on BioShock Wiki. It was very helpful and provided us with many resources. Now that BioShock Infinite is a few days from release, I was curious if support could be planned to be added whenever there is time free to do so? I've even heard Steam has begun pre-loading pre-orders of the game for users, although I assume there would be problems testing with those files. Of course, you don't know the challenges in attempting this until you can get your hands on it, so you wouldn't tell me Yes or No now, but I'm hoping support can be made if possible.

I will say that they mentioned BioShock Infinite is 3 discs on PC because they provide higher quality textures and such for PC users with flexibly rigs. I'm not sure if this is a good or bad thing for this.


Title: Re: Prepare to support BioShock Infinite?
Post by: Gildor on March 23, 2013, 21:49
I'm planning to support this game (PC version) if I'd have free time. Next Wednesday (March 27) I'm moving to another country (UK), will work in Ubisoft Reflections now. Relocation is very hard thing to do, so I have no idea when I'll have free time - perhaps immediately after move, perhaps only in a few months. Anyway, it would be nice if someone will make me a Bioshock Infinite gift on the Steam instead of just providing me a few files from the game :) I can't order the game by myself, our family budget is quite narrow now.

Unfortunately I can't guarantee that the game will be supported - it's quite possible that the game engine received too much changes. Support for 1st Bioshock version was quite hard task and required a lot of time. But definitely I'll try to support it.


Title: Re: Prepare to support BioShock Infinite?
Post by: MegaScience on March 23, 2013, 21:54
Ah, understandable. Thanks. This is your Steam, right? (http://steamcommunity.com/id/gildor) I will see if I can find someone who can get you it. :) Even if you can't extract it, it'd be nice to have if you want to play something. xD


Title: Re: Prepare to support BioShock Infinite?
Post by: Gildor on March 23, 2013, 22:08
Ah, understandable. Thanks. This is your Steam, right? (http://steamcommunity.com/id/gildor)
Yes, it's me :)
Thank you for understanding.


Title: Re: Prepare to support BioShock Infinite?
Post by: theoneman on March 24, 2013, 03:31
I am just curious, you said you would release the source code for UE Viewer once you got employed?

Will you publish an umodel's source code?
Yes I will. I know - I've promised this for more than one year, but I will do it. Currently umodel acts as major position in my "resume". I'll publish umodel's source code  as soon as I can after get hired.


So instead of investing more of your time with UE VIEWER, you should do a public release so other people can add support for Bioshock Infinite or any other UDK game that they choose?

Would you consider doing this? I think your tool is awesome! Great job anyhow :)


Title: Re: Prepare to support BioShock Infinite?
Post by: MegaScience on March 24, 2013, 07:55
Then again, it is his program, and he has full knowledge of it. We'd be dependent on his knowledge, and he'd know best how to do some things. Basically, I think we'd be better off letting him do the support if possible.


Title: Re: Prepare to support BioShock Infinite?
Post by: Gildor on March 24, 2013, 09:29
So instead of investing more of your time with UE VIEWER, you should do a public release so other people can add support for Bioshock Infinite or any other UDK game that they choose?

Would you consider doing this? I think your tool is awesome! Great job anyhow :)
I'll publish the source after relocation. Currently I'm too busy.


Title: Re: Prepare to support BioShock Infinite?
Post by: howfie on March 25, 2013, 23:47
congratulations gildor.

P.S.
I was extracting files from the PS3 version of the game using samples someone sent me, which just contains ZLIB archives. was looking through some of the output and saw some references to "unreal" and oh... this is an unreal game... screw it... let gildor do it :D ha ha ha ha.


Title: Re: Prepare to support BioShock Infinite?
Post by: Nobby76 on March 26, 2013, 03:38
Hey gildor, so you are moving to my part of the world now.. Where about in the UK are you moving ( just general area, no need for exact address lol) I am currently Very close to Birmingham.

I can hardly wait for you to have a look at this game. i really do hope you can do something with it..
Not that im condoning it, but i noticed this game has already appeared on a few sites for download, even th

Anyway good luck with your relocation, perhaps one day we can have a beer together and laugh about that time you unpacked Bioshock 3 :)


Title: Re: Prepare to support BioShock Infinite?
Post by: Gildor on March 26, 2013, 08:40
I'm moving to Newcastle-upon-Tyne.


Title: Re: Prepare to support BioShock Infinite?
Post by: Nobby76 on March 26, 2013, 13:56
I'm moving to Newcastle-upon-Tyne.
Oh shit, good luck with that lol..

In all seriousness. Newcastle is a typical working mans town, so like a lot of the other big towns like that, you do get a lot of poverty in areas. Then again you also get some nice areas too. Its just a case of staying as best you can in the good areas and not get dragged into the rougher areas of town as thats when you can get people offer to stab you for 1 pound lol.
The nice parts of Newcastle are really nice, but the rough parts are not quite so awesome. But im sure you will love the experience anyway..

And Newcastle. a little bit more north than me but still doable by jumping on a train or bus.. We might get to have this beer yet :)


Title: Re: Prepare to support BioShock Infinite?
Post by: howfie on March 27, 2013, 09:33
lol, you hear that gildor? u gonna get robbed and butt-raped by a bunch of hoodlums in your new hometown :P. oh lovely huh ha ha ha ha?


Title: Re: Prepare to support BioShock Infinite?
Post by: MegaScience on March 27, 2013, 10:30
Ah Gildor, BioShock Infinite uses a different file structure than the past games. They did mention the PC version would be given higher definition models, textures, etc. for the increased capabilities of PCs. Instead of a majority of the files being in a bulk file or two, they seem partitioned out to a large number of .xxx and .tfc files. There are also .bin files, .uncompressed_size files, a .manifest file, and a .txt file for version. Not sure if this would help or hinder progress on it, but here's to hoping.


Title: Re: Prepare to support BioShock Infinite?
Post by: howfie on March 27, 2013, 13:17
if someone sends me sample PC xxx and tfc files on xentax i will take a look at them. i have a ps3 unpacker but model format on ps3 is difficult. on ps3 tfc files contain zlibbed texture data and xxx files contain zlibbed and uncompressed files (models, materials, game data).


Title: Re: Prepare to support BioShock Infinite?
Post by: MegaScience on March 28, 2013, 01:21
When I try to look up all these different filetypes, I end up back here. xD This might be easier to extract than the last game... Or not, but...

I do have one question: Why are animations not supported in similar games? BioShock 1/2 didn't I believe, and I got linked to Dishonored where you said it wasn't supported. Is there a specific reason you could say?


Title: Re: Prepare to support BioShock Infinite?
Post by: Ziegel on March 28, 2013, 01:57
When I try to look up all these different filetypes, I end up back here. xD This might be easier to extract than the last game... Or not, but...

I do have one question: Why are animations not supported in similar games? BioShock 1/2 didn't I believe, and I got linked to Dishonored where you said it wasn't supported. Is there a specific reason you could say?

Animation support also has to d with the skeleton setup of the model itself. but of course also coding. So it could be both. I think gildor can explain it much better since I'am only a modeler and animator.


Title: Re: Prepare to support BioShock Infinite?
Post by: MegaScience on March 28, 2013, 02:18
Ah yes, each animation must correspond to its respective model, which can be very dynamic. If you have to piggyback the model to find/define the animation, then you'd have trouble if you can't extract files 100% to begin with.

Edit: Gildor, I have a question for whenever you are back from moving to respond. Would you require a Russian BioShock Infinite key or can it be North American?


Title: Re: Prepare to support BioShock Infinite?
Post by: twiddle87 on March 28, 2013, 03:39
From what I can tell, on PC at least, xxx files are a variant of the *cooked* UPK file format with what I think is a new header and potentially a new compression scheme (though that might be simply due to me not being able to interpret the header correctly, hehe)
I've attached two screencaps showing the differences between a script package from the new Alice, and one from Bioshock Infinite. Its fairly obvious that there is some sort of table in the Bioshock file which is not present in the Alice one (correlating on the string "None" present in both). I note that the magic number for a UPK ( C1 83 2A 9E) occurs both at 0x0, before that table, and at 0x1c1 in that screenshot, possibly hinting at a file merge of some sort, or extra data added during the cooking process? Simply removing the data up to the second magic number did not yield a usable file, leading my thinking away from the former explanation.

As an aside, my interest in this is expanding the script files - keybinds in Infinite are not being read from the ini files as usual, but a serialized binary blob, and if I can expand the script packages, I can use UE Explorer to decompile the uscript and hopefully work out how that serialization occurs, so I can enable hold-to-zoom and such...



[вложение удалено Администратором]


Title: Re: Prepare to support BioShock Infinite?
Post by: MegaScience on March 28, 2013, 10:34
Well, as to be expected, CachedPackageList.bin suggests the file structure. At least, before compiling into the compressed files, but apparent original filenames and such?

Edit: If anyone else can gift gildor the game, that would not only be helpful for this program but, if he finds time, give him a wonderful game experience.


Title: Re: Prepare to support BioShock Infinite?
Post by: theoneman on March 28, 2013, 14:24
The reason was stated mutiple times, Bioshock(s) used a modified havok animation files, it is basically a unknown format.


Title: Re: Prepare to support BioShock Infinite?
Post by: twiddle87 on March 28, 2013, 14:47
Well, as to be expected, CachedPackageList.bin suggests the file structure. At least, before compiling into the compressed files, but apparent original filenames and such?

CachedPackageList.bin shows that Filename.upk is now Filename.xxx (ie it confirms my earlier surmise that xxx files were actually UPKs) - unfortunately it does not describe what is *inside* Filename.upk .


Title: Re: Prepare to support BioShock Infinite?
Post by: MegaScience on March 29, 2013, 02:36
The reason was stated mutiple times, Bioshock(s) used a modified havok animation files, it is basically a unknown format.

I knew that, but it's been like 2-3 years since I came around here, so couldn't remember immediately. x-x BioShock news died down, and it was the only Unreal game I really played.


Title: Re: Prepare to support BioShock Infinite?
Post by: twiddle87 on March 29, 2013, 02:45
Just in case it is unclear, my post referred to the .xxx files (ie UPK files) that contain game data, including compiled script, rather than headers for assets inside those files. Before we can begin to see if animations use custom formats or anything else, we need to sort out the new file header to begin extracting data. No way to tell if Infinite uses non-standard assets until we do.


Title: Re: Prepare to support BioShock Infinite?
Post by: MegaScience on March 30, 2013, 18:42
Gildor, you might have to play the game first before starting this. Otherwise, you'll be sad.


Title: Re: Prepare to support BioShock Infinite?
Post by: Ziegel on March 31, 2013, 02:09
Gildor, you might have to play the game first before starting this. Otherwise, you'll be sad.

Not if you only take a few models out of the game. And I dont even know gildor do play all games.
He barely have time at the moment. Still hope to get bioshock infinite supported soon because I need assets for crafting props and making the dresses.


Title: Re: Prepare to support BioShock Infinite?
Post by: MegaScience on March 31, 2013, 06:55
I'm just saying I think there's a large archive of assets he probably wouldn't want to see if he has any interest in playing it. In any case... We still need to find him a copy to test with. Amazon says used is $40, but I'm not sure how that would work since every game has its own key. I've checked the files on my disc, and they are actually Steam pre-load files. AKA not set up like the game, and requiring Steam to unpack them correctly.

Edit: I know it wouldn't work without Gildor having a try at it, but I wanted to test anyway. This is what happens when I try this line:

umodel -path="C:\Program Files (x86)\Steam\steamapps\common\BioShock Infinite\XGame\CookedPCConsole_FR" -list S_BW_Skyhook_Airlock_LOD

(http://i.snag.gy/57LJs.jpg)

Edit2: Different file:

umodel -path="C:\Program Files (x86)\Steam\steamapps\common\BioShock Infinite\XGame\CookedPCConsole_FR" -list S_TWN3_P

(http://i.snag.gy/lGPwb.jpg)


Title: Re: Prepare to support BioShock Infinite?
Post by: MegaScience on April 02, 2013, 10:47
It does appear possible to get the models out without your extensive experience, gildor: http://www.facepunch.com/showthread.php?t=1256964

In this case, we just need someone to buy you the game. It might not even be too difficult/too different from other games.


Title: Re: Prepare to support BioShock Infinite?
Post by: Gildor on April 02, 2013, 17:48
Hi everyone.
As I mentioned in "Relocation" thread, I've successfully moved to UK. Unfortunately I have no PC here yet, that's why Bioshock 3 is still not supported.
By the way I'm quite happy that people found a way to extract resources without umodel, so this game is not required to be supported by umodel anymore.


Title: Re: Prepare to support BioShock Infinite?
Post by: Ziegel on April 02, 2013, 19:19
Hi everyone.
As I mentioned in "Relocation" thread, I've successfully moved to UK. Unfortunately I have no PC here yet, that's why Bioshock 3 is still not supported.
By the way I'm quite happy that people found a way to extract resources without umodel, so this game is not required to be supported by umodel anymore.

Well Your tool is much better than all other strange work around that doesn't work properly. umodel is 1 of the best tools out there.
So I think when you support it. a lot of people will be happy to! Maybe there is something that could be changed or added by other programmers know a way so it supports every new UE game without needed updates or something.
Your way of handing the files is lot better than how those guys on facepunch doe. Its just putting parts of models together and hope the correct model will be created.


Title: Re: Prepare to support BioShock Infinite?
Post by: RipperOne on April 02, 2013, 20:48
Hi, Gildor! I'd like to buy this game for you. Not just because of UViewer, but because you have to play this game. Seriously, its something even better than HL2. Best game ever for me, no doubts.

But here is a problem. My Steam account is Russian, which means that every game i buyed can't be played anywhere else. So... what should i do? If it would be easy for you i can just transfer money to you so you can buy it yourself.


Title: Re: Prepare to support BioShock Infinite?
Post by: artisticVibe on April 02, 2013, 22:12
Hi everyone.
As I mentioned in "Relocation" thread, I've successfully moved to UK. Unfortunately I have no PC here yet, that's why Bioshock 3 is still not supported.
By the way I'm quite happy that people found a way to extract resources without umodel, so this game is not required to be supported by umodel anymore.

Not required? Oh God please do support this one. Not to rain on anyone's parade but that was facepunch, only one of the most laughable places ever online. One has to be pretty desperate to even remotely consider going there for support on Bioshock models.


Title: Re: Prepare to support BioShock Infinite?
Post by: grub on April 02, 2013, 23:35
Hello! I've registered an account just to ask you, beg you, PLEASE PLEASE don't drop support for Bioshock Infinite on umodel. It's still a better process than the finagling currently being done on facepunch. Right now, we're apparently only getting models with lower res textures, and other things that aren't being converted. Yours is still best!


Title: Re: Prepare to support BioShock Infinite?
Post by: Gildor on April 03, 2013, 01:03
Well, I understand that the support is still needed. By the way I"m still have no PC at home. My wife will bring our notebook from Russia on the next week. It's not so powerful, but should be enough for reversing. But in the same time, when my family will arrive here the real "relocation" begins :)
Regarding to Steam - my account is Russian too (of course), and the game should work no matter where it was purchased (it's true for most games)


Title: Re: Prepare to support BioShock Infinite?
Post by: grub on April 03, 2013, 07:01
Thanks, Gildor! You the man!


Title: Re: Prepare to support BioShock Infinite?
Post by: Gildor on April 06, 2013, 13:53
Many thanks to the RipperOne, he donated a game for me!


Title: Re: Prepare to support BioShock Infinite?
Post by: MegaScience on April 06, 2013, 16:05
Ah, I noticed earlier, actually. :) Thanks RipperOne!

They specifically noted the PC version had high definition graphics, which build the game up 14GB+, so installing it might take a while. Since I got a physical copy for Ultimate Songbird Edition, I installed off the disc, which was quicker. But that also means there might be additional files to look out for.


Title: Re: Prepare to support BioShock Infinite?
Post by: ACE66759 on April 08, 2013, 09:02
I also made an account just to ask for support of BioShock Infinite. I have used this program before and love it, and would like to continue using it.

Or if someone can tell me how to get the Vigor Bottles and Voxophone, or has them and would be willing to send them to me?.
If I could just get those models I would be eternally and forever grateful!!!!!!


Congrats on the relocation!


Title: Re: Prepare to support BioShock Infinite?
Post by: interdpth on April 13, 2013, 17:26
From what I can tell, on PC at least, xxx files are a variant of the *cooked* UPK file format with what I think is a new header and potentially a new compression scheme (though that might be simply due to me not being able to interpret the header correctly, hehe)
I've attached two screencaps showing the differences between a script package from the new Alice, and one from Bioshock Infinite. Its fairly obvious that there is some sort of table in the Bioshock file which is not present in the Alice one (correlating on the string "None" present in both). I note that the magic number for a UPK ( C1 83 2A 9E) occurs both at 0x0, before that table, and at 0x1c1 in that screenshot, possibly hinting at a file merge of some sort, or extra data added during the cooking process? Simply removing the data up to the second magic number did not yield a usable file, leading my thinking away from the former explanation.

As an aside, my interest in this is expanding the script files - keybinds in Infinite are not being read from the ini files as usual, but a serialized binary blob, and if I can expand the script packages, I can use UE Explorer to decompile the uscript and hopefully work out how that serialization occurs, so I can enable hold-to-zoom and such...


Interesting! Would anyone know where I could find the basic structure of what a UPK should look like structwise? That'd be helpful :)


Title: Re: Prepare to support BioShock Infinite?
Post by: klanlyjp on April 14, 2013, 23:04
decompressed(?) core.xxx and engine.xxx dumped from game process :)
https://docs.google.com/file/d/0B0QQ0_7gsAdLWXhRREJ1UzZhWTA/edit (https://docs.google.com/file/d/0B0QQ0_7gsAdLWXhRREJ1UzZhWTA/edit)

[вложение удалено Администратором]


Title: Re: Prepare to support BioShock Infinite?
Post by: MegaScience on April 15, 2013, 06:09
Well someone bought him the game. It comes down to finding time to download 17GB of game, run through the files, and update UModel accordingly. Since the game's launch coincided with a transition, it could be a bit before he finds time. But he can take his time.


Title: Re: Prepare to support BioShock Infinite?
Post by: Gildor on April 15, 2013, 16:04
It comes down to finding time to download 17GB of game, run through the files, and update UModel accordingly. Since the game's launch coincided with a transition, it could be a bit before he finds time. But he can take his time.
Unfortunately I have much more things to do for moving forward to Bioshock 3 reversing.

1. Rent a home, currently we're living in temporary apartment and must move in 2 weeks.
2. Find suitable Internet provider - currently all I can buy is 3G USB dongle with very expensive limited intertet offers (~ £15 for 2Gb of traffic, that's £135 ~ $200 just to obtain 17Gb of Bioshock 3); there's no unlimited 3G offers in UK! I thought UK is very technological country, but Russia is much better in mobile networks and home internet areas.
3. To buy a PC. I'll get my notebook soon. Perhaps I'll be able to use it for reverse engineering, but it's too unpowerful to run even UT3, so which performance could I expect for running a Bioshock 3? I checked UK shops for desktop PC offers - there are a lot of "brands" here (like HP, Dell) which are too expensive, and no ordinary PCs. This is another area where Russia moved forward - I could buy relatively good PC (non-brand) just for $300-400. Perhaps I'll buy a PC on Amazon, collecting it part-by-part. Also I'm looking for used PC which would be good enough to run a 2-3 years old game. I have a lot of things to do for my family here, and PC has much lower priority in our family budget, so used PC could be a solution. One of my friends (warrantyvoider) offers me his used PC, but it will be too expensive to send it over the postal from Germany to UK ...

So, you may see that there's not "just download the game and reverse it" :(


Title: Re: Prepare to support BioShock Infinite?
Post by: MegaScience on April 16, 2013, 03:28
Wow, that 'sucks,' to say the least. Well, take your time. This can't take priority over that, as much as we want this stupid stuff. Thanks for informing us.


Title: Re: Prepare to support BioShock Infinite?
Post by: ACE66759 on April 16, 2013, 04:56
:( Now I have to use Ninja Ripper. That program sucks. It can only make blocky junk models. AND that's with me playing on Ultra everything.


Title: Re: Prepare to support BioShock Infinite?
Post by: Dreadfred on April 16, 2013, 05:40
Hope you don't mind me asking gildor but how much money have you got to spend on a pc? www.overclockers.co.uk are pretty good for self build.


Title: Re: Prepare to support BioShock Infinite?
Post by: MegaScience on April 16, 2013, 06:15
None of that really matters when he has limited data usage, not to mention the even bigger events in his life. Maybe he can do a bare minimum update without testing if we provide the files he put in that tutorial for suggesting new games, but we should just give him his time then. I don't like Ninja Ripper either - It gave me GBs of duplicate files, and the log files are unlimited so I ended up with a file 2.3GB of plain text logging. Jaw droppingly unnecessary. But I'll stick it out for gildor. <3


Title: Re: Prepare to support BioShock Infinite?
Post by: dragbody on April 16, 2013, 09:17
gildor - Congratulations on your successful move. I hope you are seeing desires of yours fulfilled. Please take all the time you need to get settled and comfortable in your new home. Your contributions to the modding community are already vast and invaluable. We will always welcome future contributions, but we're certainly not entitled to them. Thanks again and I wish you all the best with your new life in the UK.


Title: Re: Prepare to support BioShock Infinite?
Post by: stonecoldnuts on April 16, 2013, 14:39
Very well said, dragbody! Best of luck, Gildor - it sounds very exciting for you and the family!


Title: Re: Prepare to support BioShock Infinite?
Post by: Nobby76 on April 22, 2013, 03:16

Unfortunately I have much more things to do for moving forward to Bioshock 3 reversing.

1. Rent a home, currently we're living in temporary apartment and must move in 2 weeks.
2. Find suitable Internet provider - currently all I can buy is 3G USB dongle with very expensive limited intertet offers (~ £15 for 2Gb of traffic, that's £135 ~ $200 just to obtain 17Gb of Bioshock 3); there's no unlimited 3G offers in UK! I thought UK is very technological country, but Russia is much better in mobile networks and home internet areas.
3. To buy a PC. I'll get my notebook soon. Perhaps I'll be able to use it for reverse engineering, but it's too unpowerful to run even UT3, so which performance could I expect for running a Bioshock 3? I checked UK shops for desktop PC offers - there are a lot of "brands" here (like HP, Dell) which are too expensive, and no ordinary PCs. This is another area where Russia moved forward - I could buy relatively good PC (non-brand) just for $300-400. Perhaps I'll buy a PC on Amazon, collecting it part-by-part. Also I'm looking for used PC which would be good enough to run a 2-3 years old game. I have a lot of things to do for my family here, and PC has much lower priority in our family budget, so used PC could be a solution. One of my friends (warrantyvoider) offers me his used PC, but it will be too expensive to send it over the postal from Germany to UK ...

So, you may see that there's not "just download the game and reverse it" :(

Regarding the "no name" PC.  There is no such thing as a no name pc in england unless you build it yourself.  And if you do its WAAAAY cheaper than any named equivalent pc. order online ( from somewhere like over clockers) rather than walking into a shop and buying the parts yourself, again it will be a lot cheaper.  you can build a dual core 3ghz pc with a decent gfx card and hdd space for less than £350 if you buy the parts online.

also for internet. Go with virgin media.  Im currently running the 100mbit unlimited package ( the fastest internet in the uk) and totally limit free, i can download 24/7 if i want... often i do :)


Title: Re: Prepare to support BioShock Infinite?
Post by: Gildor on April 22, 2013, 13:01
Thank you for recommendations, Nobby76 :)


Title: Re: Prepare to support BioShock Infinite?
Post by: MegaScience on April 22, 2013, 23:47
I just want to say how much I do appreciate your program. I actually noticed Ninja Ripper promotes your website on theirs, but... Well, their method makes sense, but it just comes out inefficient sadly. And making it do proper cleanup would be even more process intensive, so there's really no fixing it. I end up with GBs of excess, duplicate files from that method. Your program can be more pin-point, even though I can't just capture directly what I want. Even if this doesn't get updated, thanks for the effort and I'll use it with the past games. :)