[INFO] - Formats, tools and docs for the mods

The place to discuss scripting and game modifications for X Rebirth.

Moderators: Scripting / Modding Moderators, Moderators for English X Forum

Post Reply
User avatar
nonnex
Posts: 366
Joined: Wed, 28. Aug 13, 12:42
x4

[INFO] - Formats, tools and docs for the mods

Post by nonnex » Tue, 26. Nov 13, 11:17

Hello,

the main goal of this thread is to collect and share information about the used fileformats, tools, technical in depth informations, specifications and other usefull contributions for devs about X:RB.
It is not focused to be a beginner tutorial for programming or modding, but rather it should be a solid information basis for advanced modders or developers, because without information and proper tools a more comprehensive modding|programming is|will be hard or even impossible. How ever, here we go:
_________________________________________________

UI
Fileformats:
  • .dae : collada digital asset exchange schema
    .bgf : "Binary Game File" (Serialized) for inclusion into X:RB source, no public tools available, kind of a spec from "Gibbed Avalanche" project here.
    .bsg : "Binary Game File" (Serialized) for inclusion into X:RB source, no public tools available, kind of a spec from "Gibbed Avalanche" project here.
    .amw : "Anark Media Workspace" file extension. This file contains the project’s data and workspace settings, No public tools or specification known yet.

Information: Used for the 3D UI but no public tools available.
Used Software: Anark Studio 4.0 (abandoned middleware and not supported anymore) in conjunction with FCollada (C++ library which offers support for COLLADA interoperability)
Needs: Anark Studio 4.0, or proper tools from ES in the future
Alternative: None by now, proposal: Switch to UI-Composer, or implementing a wrapper for another 3DGUI capable systems (for example: Crazy Eddie's GUI System)

Modeling (Environment mesh + animation)
Fileformats:
  • .xmf : Xu Mesh File

Information: Mesh binary format (Xu Mesh File)
Used Software: 3DMax, Blender, or other...
Needs: xmf<=>dae converter (by arc_)
Alternative: None by now.

Fileformats:
  • .ani : No public tools or specification known yet.

Information: animates .xmf meshes (e.g. radar dishes that spin, crates that open - anything non-NPC). Presumably custom file format by ES. No tools or specification available known yet. (by _arc)
Used Software: ???
Needs: ???
Alternative: ???

Modeling (NPC mesh + animation)
Fileformats:
  • .xac : EmotionFX Actor file (NPC mesh). No public conversion tools available yet but upcoming.
    .xpm : EmotionFX facial animation. No public tools available but a basic specification.
    .xsm : EmotionFX skeletal animation. No public tools available but a basic specification.

Information: Used for NPC Meshes and animation.
Used Software: EmotionFX by "Mystic Game Development"
Needs: EmotionFX
Alternative: None by now.

Scripting
Fileformats:
  • .xpl : .lua renamed to .xpl, compiled with LUAjit

Information: LUAjit bytecode, mostly used for UI behavior
Used Software: LUA 5.1 + LUAjit
Needs: LUA Sources from ES
Alternative: Disassembling with luajit-decompiler

Fileformats:

Information: Used for low lvl scripting and diff patching in extensions
Used Software: Any txt editor
Needs: more love for properties and parameter documentation.
Alternative: not needed

FX
Fileformats:
  • .psb : Particle effects, binary, no specification yet

Information: Particle effects
Used Software: ???
Needs: Specification.
Alternative: ?

Fileformats:

Information: Each file stores a DirectX 9 "effect" which is a collection of vertex and pixel shaders. The shaders can be extracted using a little custom tool _arc has made, EffectExtractor - run it from the command line and pass it an .fbpc, and it'll put the extracted shaders next to it as .fx files. After that the shaders can be disassembled with fxc.exe, the FX Compiler from the MS DirectX SDK: "fxc.exe /dumpbin <path to .fx file>" (by _arc)
Used Software: MS Tools for DirectX Graphics
Needs: EffectExtractor, fxc (from MS DirectX SDK)
Alternative: None by now.

_________________________________________________

Would be nice if we share some in depth knowledge. I will keep the list fresh if there's something new, changed or additional.
_________________________________________________
UPDATES:
28.12.2013
+ Added xmfConverter. by (_arc).
+ Added XUMF definition link.
+ Added ".amw" description.
~ Changed Liststyle.
+ Information collected by _arc. Thank you pal.
+ Links to fileformats to specifications.
29.12.2013
+ DXShader informations and links.
+ More links for various keynames.
+ More informations about various filetypes.
30.12.2013
+ More information about .bgf (thanks brammie)
01.01.2014
~ Happy new year
+ New "Dev Tools" Section
Last edited by nonnex on Wed, 28. Nov 18, 11:17, edited 98 times in total.

jeroll3d
Posts: 665
Joined: Thu, 26. Jun 08, 02:28
x3ap

Post by jeroll3d » Tue, 26. Nov 13, 11:26

Entusiasta da série X3! The best game.

User avatar
nonnex
Posts: 366
Joined: Wed, 28. Aug 13, 12:42
x4

Post by nonnex » Sat, 28. Dec 13, 21:26

updated

User avatar
arc_
Posts: 62
Joined: Sat, 7. Dec 13, 20:30

Post by arc_ » Sat, 28. Dec 13, 22:57

Meshes:
+ .xac: EmotionFX Actor file (NPC mesh). No public conversion tools available yet but upcoming. Specification

Animations:
* .ani: animates .xmf meshes (e.g. radar dishes that spin, crates that open - anything non-NPC). Presumably custom file format by ES. No tools or specification available that I know of.
+ .xpm: EmotionFX facial animation (PM = Progressive Motion). No public tools available but a basic specification.
+ .xsm: EmotionFX skeletal animation (SM = Skeletal Motion). No public tools available but a basic specification.

FX:
* .fbpc: renamed .fx files. Each file stores a DirectX 9 "effect" which is a collection of vertex and pixel shaders. The shaders can be extracted using a little custom tool I made, EffectExtractor - run it from the command line and pass it an .fbpc, and it'll put the extracted shaders next to it as .fx files. After that the shaders can be disassembled with fxc.exe, the FX Compiler from the MS DirectX SDK: fxc.exe /dumpbin <path to .fx file>
Last edited by arc_ on Sat, 28. Dec 13, 23:07, edited 2 times in total.

User avatar
nonnex
Posts: 366
Joined: Wed, 28. Aug 13, 12:42
x4

Post by nonnex » Sat, 28. Dec 13, 23:02

thanks _arc

User avatar
nonnex
Posts: 366
Joined: Wed, 28. Aug 13, 12:42
x4

Post by nonnex » Sun, 29. Dec 13, 18:18

update

brammie
Posts: 100
Joined: Thu, 19. Dec 13, 23:26

Post by brammie » Sun, 29. Dec 13, 21:28

you want some schema's i've generated sofar that were missing?

like wares.xsd, savegame.xsd and so on
i've checked them with some generated code round tripping and they seem ok (setting up a repo at github but not there yet)

UniTrader
Moderator (Script&Mod)
Moderator (Script&Mod)
Posts: 14571
Joined: Sun, 20. Nov 05, 22:45
x4

Post by UniTrader » Sun, 29. Dec 13, 21:38

i would want them.. especially if they have some documentation in them :)
if not stated otherwise everything i post is licensed under WTFPL

Ich mache keine S&M-Auftragsarbeiten, aber wenn es fragen gibt wie man etwas umsetzen kann helfe ich gerne weiter ;)

I wont do Script&Mod Request work, but if there are questions how to do something i will GLaDly help ;)

User avatar
nonnex
Posts: 366
Joined: Wed, 28. Aug 13, 12:42
x4

Post by nonnex » Mon, 30. Dec 13, 01:28

always good. let me know when they're available at git.

brammie
Posts: 100
Joined: Thu, 19. Dec 13, 23:26

Post by brammie » Mon, 30. Dec 13, 02:45

and there we go

https://github.com/brammie73/xrebirth/tree/master/xsd

i've noticed some small errors when reversing them from xml, the generators seem to break on mixed content elements ...

filesystem source is there to:

https://github.com/brammie73/xrebirth/t ... filesystem

its a apache commons vfs implementation and works with all tools that uses is, like OtrosVfsBrowser. Looks like eclipse has there own vfs, gonne see if i can make that work to..

brammie
Posts: 100
Joined: Thu, 19. Dec 13, 23:26

Post by brammie » Mon, 30. Dec 13, 10:06

.bgf : No public tools or specification known yet.
.bsg : No public tools or specification known yet.


Both are AnarkBGF ...
Anark Gameface creates the media file along with the HTML page needed to call it.For game interfaces, the scene file can be exported as a .BGF binary file for inclusion in a game.
http://www.zoominfo.com/p/Anark-Gameface/1172968855

only code i've found sofar is
https://code.google.com/r/jmatth1-h/sou ... arkFile.cs

that is used in some modding suite

User avatar
nonnex
Posts: 366
Joined: Wed, 28. Aug 13, 12:42
x4

Post by nonnex » Tue, 31. Dec 13, 13:29

updated

iforgotmysocks
Posts: 1244
Joined: Fri, 8. Nov 13, 22:35
x4

Post by iforgotmysocks » Tue, 31. Dec 13, 19:26

brammie wrote:and there we go

https://github.com/brammie73/xrebirth/tree/master/xsd

i've noticed some small errors when reversing them from xml, the generators seem to break on mixed content elements ...

filesystem source is there to:

https://github.com/brammie73/xrebirth/t ... filesystem

its a apache commons vfs implementation and works with all tools that uses is, like OtrosVfsBrowser. Looks like eclipse has there own vfs, gonne see if i can make that work to..
Wow, just taking a look! :s

JonMicheelsen
Posts: 33
Joined: Tue, 15. Aug 17, 22:08
xr

Post by JonMicheelsen » Wed, 16. Aug 17, 03:44

Anyone happens to have a working link for the EffectExtractor mentioned above?

Sparky Sparkycorp
Moderator (English)
Moderator (English)
Posts: 8074
Joined: Tue, 30. Mar 04, 12:28
x4

Post by Sparky Sparkycorp » Sat, 23. Sep 17, 14:43

JonMicheelsen wrote:Anyone happens to have a working link for the EffectExtractor mentioned above?
I'm not familiar with the topic so I don't feel confident in suggesting a link but googling with "fxc.exe download" seems to provide some options.

JonMicheelsen
Posts: 33
Joined: Tue, 15. Aug 17, 22:08
xr

Post by JonMicheelsen » Sun, 24. Sep 17, 14:44

I found I had actually downloaded the above linked version on an old computer some years ago. Without the EffectExtractor, the fxc is not gonna help.

If anyone is interested I have this thread marked for monitoring. Though be warned, the assembly you end up with is not exactly modding friendly - and playing around with it, I never even got far enough to test if it was even possible to compile it back into the game.

tomchk
Posts: 1294
Joined: Mon, 26. Jan 15, 19:55
x4

Re:

Post by tomchk » Mon, 31. Aug 20, 23:36

JonMicheelsen wrote:
Sun, 24. Sep 17, 14:44
I found I had actually downloaded the above linked version on an old computer some years ago. Without the EffectExtractor, the fxc is not gonna help.

If anyone is interested I have this thread marked for monitoring. Though be warned, the assembly you end up with is not exactly modding friendly - and playing around with it, I never even got far enough to test if it was even possible to compile it back into the game.
I'd find this helpful, thanks! Please let me know if you have it.
Care to see what I've been creating? https://www.youtube.com/user/ytubrute

Post Reply

Return to “X Rebirth - Scripts and Modding”