Topology
Texture
Asset Processing
Our 4B-parameter model generates high-resolution fully textured assets with exceptional fidelity and efficiency with vanilla DiTs.
At the core is the native and compact structured latents, which push the frontiers of fidelity and compactness at the same time.
Reconstruction accuracy v.s. Latent compactness
Our method robustly handles complex structures, including open surfaces, non-manifold geometry, and enclosed interior structures, breaking the constraints of iso-surface fields.
Our method can model arbitrary surface attributes such as Base Color, Roughness, Metallic, and Opacity (i.e., Transparency or Alpha channel), enabling Physically Based Rendering (PBR) and photorealistic relighting.
Data processing for training and inference are simple, enabling instant conversions that are fully rendering-free and optimization-free.
TRELLIS.2's pipeline begins with an Instant Bidirectional Conversion that transforms meshes into our new representation termed O-Voxel. A Sparse Compression VAE then encodes these voxels into a compact Structured Latent space.
TRELLIS.2 is purely a research project. Responsible AI considerations were factored into all stages. The datasets used in this paper are public and have been reviewed to ensure there is no personally identifiable information or harmful content. However, as these datasets are sourced from the Internet, potential bias may still be present.
The materials made available on this page are provided solely for academic and research purposes in connection with the exploration of 3D generation technologies, as described in our tech report. These materials are not intended for commercial exploitation or use. If you believe that any content on this page infringes upon your intellectual property rights, including but not limited to copyright, please notify us by submitting a takedown request via email to jiaoyan (at) microsoft.com.