TRELLIS 2

TRELLIS.2 represents an open-source solution for creating 3D models from images, engineered to deliver finely detailed, textured assets using inherent 3D Variational Autoencoders (VAEs). It leverages native, compact, structured latents for both high fidelity and efficient compression.

The method can manage intricate designs, encompassing open surfaces, non-manifold geometries, and enclosed internal structures, thereby surpassing the constraints of iso-surface fields.

TRELLIS.2 extends its capabilities to model diverse surface characteristics, including Base Color, Roughness, Metallic properties, and Opacity, facilitating Physically Based Rendering (PBR) and true-to-life relighting.

This tool streamlines data pre- and post-processing for training and deployment, enabling rapid conversions free from rendering and iterative improvement.

It employs 'O-Voxel', a novel sparse voxel structure that avoids the need for traditional fields, designed to simultaneously encode detailed geometry and intricate visual appearance. A Sparse Compression VAE component is utilized to compress voxel data effectively, encapsulating completely textured 3D assets into a compact form with minimal loss of visual quality.

This facilitates efficient generative modeling at scale. It's important to recognize that TRELLIS.2 is exclusively a research endeavor with ethical considerations integrated at every stage.