KNOWLEDGE
How are pixel-art Gaussian splats made?
Videos of pixel-art 3D scenes said to be made with Fable 5.2 have been going around. How, and why, were they made?
It is one way to design in 3D. Its nature makes it easy for AI to handle: it is simple and structured (patterns).
Build it yourself
Build one blossom tree on an island in four steps. Move through the steps, and drag the picture or use the ← → keys to turn it.
1,262 points
1. Place points
- Person
- Combines shapes to build the form, and sets the spacing between points.
- Program
- Places points evenly on the surface.
- Principle
- Each shape tells the “distance to the surface”, so a point can be pulled onto the surface.
2. Lay discs
- Person
- Sets the size of the discs.
- Program
- Lays a flat disc (a Gaussian) on the surface at every point.
- Principle
- Seen from the side a disc is a line, so it fills the gaps without bulging.
3. Bake the light
- Person
- Sets the direction of the sun and the few colors to use.
- Program
- Paints a disc brighter the more it faces the light.
- Principle
- Bright and dark sides appear, so it looks solid.
4. Draw in pixels
- Person
- Sets the picture size (120 × 120 pixels).
- Program
- Paints the nearest discs first, cuts the edges, and scales the picture up.
- Principle
- Only when the soft edges are cut do the chosen colors alone remain.
Sources: the disc thickness (0.3 × the width) follows ink studio's value for box and slab surfaces, cutting the edges (at opacity 0.5) follows crucible issue 1744, and projecting to the screen and painting the nearest first follow the 3DGS paper, §4 and §6. The numbers on screen were measured by drawing this scene.
Compared with polygons
3D scenes are commonly written as polygons (meshes). A polygon file is a list of vertices and the faces that join them (triangles in this article). Writing the same blossom tree on an island both ways:
| Compared | Polygon file | This method |
|---|---|---|
| Writing the scene | about 107,000 characters | 974 characters |
| Making it finer | grows about 4 times | stays the same |
| Making the blossoms bigger | move 643 vertices | change five numbers |
So AI can turn an order given in words (“one island, one trunk, five blossom balls”) into short code, and draw it, look, and fix it easily.
All the code for this scene (974 characters)
function sdCyl(x, y, z, cx, cy, cz, r, hh) {
const qx = Math.hypot(x - cx, z - cz) - r, qy = Math.abs(y - cy) - hh;
return Math.min(Math.max(qx, qy), 0) + Math.hypot(Math.max(qx, 0), Math.max(qy, 0));
}
function sdSph(x, y, z, cx, cy, cz, r) { return Math.hypot(x - cx, y - cy, z - cz) - r; }
function smin(a, b, k) { const h = Math.max(k - Math.abs(a - b), 0) / k; return Math.min(a, b) - h * h * k * 0.25; }
function sdf(x, y, z) {
const island = sdCyl(x, y, z, 0, -0.15, 0, 1.0, 0.15);
const trunk = sdCyl(x, y, z, 0, 0.25, 0, 0.09, 0.25);
let can = sdSph(x, y, z, 0, 0.8, 0, 0.38);
can = smin(can, sdSph(x, y, z, 0.3, 0.66, 0.12, 0.26), 0.14);
can = smin(can, sdSph(x, y, z, -0.28, 0.7, -0.12, 0.28), 0.14);
can = smin(can, sdSph(x, y, z, 0.04, 0.64, -0.3, 0.23), 0.14);
can = smin(can, sdSph(x, y, z, -0.06, 0.62, 0.3, 0.22), 0.14);
let d = island; MAT = 0;
if (trunk < d) { d = trunk; MAT = 1; }
if (can < d) { d = can; MAT = 2; }
return d;
}
Sources: “commonly polygons (meshes)” is from the 3DGS paper, §1 (“Meshes and points are the most common 3D scene representations”). The character and vertex counts were measured on this scene. The polygon file is a closed surface extracted on a grid with the same spacing.
Frequently asked questions
What are pixel-art Gaussian splats?
They are 3D pictures made by laying flat, disc-shaped Gaussians on the surface of shapes built in code, painting their colors in advance, and drawing them at low resolution. Nothing is learned from photos. The four tools this article read (ink studio, pixelart-gaussiansplat, SyntaxSplat, crucible) all build scenes in code.
How are they different from Gaussian splatting?
The original Gaussian splatting (Kerbl et al., 2023) learns the position, shape and color of each Gaussian from many photos. Pixel-art splats are drawn the same way, but the Gaussians are placed by code and their soft edges are cut so that only the chosen colors remain.
Why are they easy for AI to make?
Because the scene is short code. This article's blossom tree on an island is 974 characters of code, and the polygon file of the same scene is about 107,000 characters. To make the blossoms bigger, you change five numbers in the code.
Why are the soft edges cut off?
If the soft edges stay, the colors of neighboring discs mix and colors appear that are not in the palette. Drawing this article's scene at 120 × 120 pixels uses 2,147 colors with the soft edges and 12 with them cut. crucible issue 1744 cuts at opacity 0.5 for the same reason.
Further reading
- siliconjungle/shapeshift-labs-ink-studio: Sculpting, animation and simulation toolkit for pixel-art Gaussian splats
- cobanov/pixelart-gaussiansplat: Pixel-art Gaussian splats in the browser
- iamvillain/SyntaxSplat: Write scenes as code, get Gaussian splats
- codepawl/crucible issue 1744: pixel-art output and surface-to-splat baking for code-built splat dioramas
- B. Kerbl, G. Kopanas, T. Leimkühler, G. Drettakis, 3D Gaussian Splatting for Real-Time Radiance Field Rendering (ACM TOG 42(4), 2023)
- awesome-fable-5.2: things people built with Claude Fable 5.2 (entry: Pixel-art Gaussian splats, @JungleSilicon)