한국어

KNOWLEDGE

How are pixel-art Gaussian splats made?

Videos of pixel-art 3D scenes said to be made with Fable 5.2 have been going around. How, and why, were they made?

It is one way to design in 3D. Its nature makes it easy for AI to handle: it is simple and structured (patterns).

Build it yourself

Build one blossom tree on an island in four steps. Move through the steps, and drag the picture or use the ← → keys to turn it.

1,262 points

1. Place points

Person
Combines shapes to build the form, and sets the spacing between points.
Program
Places points evenly on the surface.
Principle
Each shape tells the “distance to the surface”, so a point can be pulled onto the surface.

2. Lay discs

Person
Sets the size of the discs.
Program
Lays a flat disc (a Gaussian) on the surface at every point.
Principle
Seen from the side a disc is a line, so it fills the gaps without bulging.

3. Bake the light

Person
Sets the direction of the sun and the few colors to use.
Program
Paints a disc brighter the more it faces the light.
Principle
Bright and dark sides appear, so it looks solid.

4. Draw in pixels

Person
Sets the picture size (120 × 120 pixels).
Program
Paints the nearest discs first, cuts the edges, and scales the picture up.
Principle
Only when the soft edges are cut do the chosen colors alone remain.

Sources: the disc thickness (0.3 × the width) follows ink studio's value for box and slab surfaces, cutting the edges (at opacity 0.5) follows crucible issue 1744, and projecting to the screen and painting the nearest first follow the 3DGS paper, §4 and §6. The numbers on screen were measured by drawing this scene.

Compared with polygons

3D scenes are commonly written as polygons (meshes). A polygon file is a list of vertices and the faces that join them (triangles in this article). Writing the same blossom tree on an island both ways:

ComparedPolygon fileThis method
Writing the sceneabout 107,000 characters974 characters
Making it finergrows about 4 timesstays the same
Making the blossoms biggermove 643 verticeschange five numbers

So AI can turn an order given in words (“one island, one trunk, five blossom balls”) into short code, and draw it, look, and fix it easily.

All the code for this scene (974 characters)
function sdCyl(x, y, z, cx, cy, cz, r, hh) {
  const qx = Math.hypot(x - cx, z - cz) - r, qy = Math.abs(y - cy) - hh;
  return Math.min(Math.max(qx, qy), 0) + Math.hypot(Math.max(qx, 0), Math.max(qy, 0));
}
function sdSph(x, y, z, cx, cy, cz, r) { return Math.hypot(x - cx, y - cy, z - cz) - r; }
function smin(a, b, k) { const h = Math.max(k - Math.abs(a - b), 0) / k; return Math.min(a, b) - h * h * k * 0.25; }
function sdf(x, y, z) {
  const island = sdCyl(x, y, z, 0, -0.15, 0, 1.0, 0.15);
  const trunk = sdCyl(x, y, z, 0, 0.25, 0, 0.09, 0.25);
  let can = sdSph(x, y, z, 0, 0.8, 0, 0.38);
  can = smin(can, sdSph(x, y, z, 0.3, 0.66, 0.12, 0.26), 0.14);
  can = smin(can, sdSph(x, y, z, -0.28, 0.7, -0.12, 0.28), 0.14);
  can = smin(can, sdSph(x, y, z, 0.04, 0.64, -0.3, 0.23), 0.14);
  can = smin(can, sdSph(x, y, z, -0.06, 0.62, 0.3, 0.22), 0.14);
  let d = island; MAT = 0;
  if (trunk < d) { d = trunk; MAT = 1; }
  if (can < d) { d = can; MAT = 2; }
  return d;
}

Sources: “commonly polygons (meshes)” is from the 3DGS paper, §1 (“Meshes and points are the most common 3D scene representations”). The character and vertex counts were measured on this scene. The polygon file is a closed surface extracted on a grid with the same spacing.

Frequently asked questions

What are pixel-art Gaussian splats?

They are 3D pictures made by laying flat, disc-shaped Gaussians on the surface of shapes built in code, painting their colors in advance, and drawing them at low resolution. Nothing is learned from photos. The four tools this article read (ink studio, pixelart-gaussiansplat, SyntaxSplat, crucible) all build scenes in code.

How are they different from Gaussian splatting?

The original Gaussian splatting (Kerbl et al., 2023) learns the position, shape and color of each Gaussian from many photos. Pixel-art splats are drawn the same way, but the Gaussians are placed by code and their soft edges are cut so that only the chosen colors remain.

Why are they easy for AI to make?

Because the scene is short code. This article's blossom tree on an island is 974 characters of code, and the polygon file of the same scene is about 107,000 characters. To make the blossoms bigger, you change five numbers in the code.

Why are the soft edges cut off?

If the soft edges stay, the colors of neighboring discs mix and colors appear that are not in the palette. Drawing this article's scene at 120 × 120 pixels uses 2,147 colors with the soft edges and 12 with them cut. crucible issue 1744 cuts at opacity 0.5 for the same reason.

Further reading