- Sean Lilley, @lilleyse
- Tom Fili, @CesiumFili
- Patrick Cozzi, @pjcozzi
- Dan Bagnell, @bagnell
The Point Cloud tile format enables efficient streaming of massive point clouds for 3D visualization. Each point is defined by a position and optional properties used to define its appearance, such as color and normal, and optional properties that define application-specific metadata.
Using 3D Tiles terminology, each point is a feature.
A tile is composed of a header section immediately followed by a body section.
Figure 1: Point Cloud layout (dashes indicate optional fields).
The 28-byte header contains the following fields:
Field name | Data type | Description |
---|---|---|
magic |
4-byte ANSI string | "pnts" . This can be used to identify the arraybuffer as a Point Cloud tile. |
version |
uint32 |
The version of the Point Cloud format. It is currently 1 . |
byteLength |
uint32 |
The length of the entire tile, including the header, in bytes. |
featureTableJSONByteLength |
uint32 |
The length of the feature table JSON section in bytes. |
featureTableBinaryByteLength |
uint32 |
The length of the feature table binary section in bytes. If featureTableJSONByteLength is zero, this will also be zero. |
batchTableJSONByteLength |
uint32 |
The length of the batch table JSON section in bytes. Zero indicates that there is no batch table. |
batchTableBinaryByteLength |
uint32 |
The length of the batch table binary section in bytes. If batchTableJSONByteLength is zero, this will also be zero. |
If featureTableJSONByteLength
equals zero, the tile does not need to be rendered.
The body section immediately follows the header section, and is composed of a Feature Table
and Batch Table
.
Code for reading the header can be found in PointCloud3DModelTileContent.js in the Cesium implementation of 3D Tiles.
Contains per-tile and per-point values that define where and how to render points. More information is available in the Feature Table specification.
The pnts
Feature Table JSON Schema is defined in pnts.featureTable.schema.json.
These semantics map to an array of feature values that are define each point. The length of these arrays must be the same for all semantics and is equal to the number of points. The value for each point semantic must be a reference to the Feature Table Binary Body; they cannot be embedded in the Feature Table JSON Header.
If a semantic has a dependency on another semantic, that semantic must be defined.
If both POSITION
and POSITION_QUANTIZED
are defined for a point, the higher precision POSITION
will be used.
If both NORMAL
and NORMAL_OCT16P
are defined for a point, the higher precision NORMAL
will be used.
| Semantic | Data Type | Description | Required |
| --- | --- | --- | --- | --- |
| POSITION
| float32[3]
| A 3-component array of numbers containing x
, y
, and z
Cartesian coordinates for the position of the point. | ✅ Yes, unless POSITION_QUANTIZED
is defined. |
| POSITION_QUANTIZED
| uint16[3]
| A 3-component array of numbers containing x
, y
, and z
in quantized Cartesian coordinates for the position of the point. | ✅ Yes, unless POSITION
is defined. |
| RGBA
| uint8[4]
| A 4-component array of values containing the RGBA
color of the point. | 🔴 No. |
| RGB
| uint8[3]
| A 3-component array of values containing the RGB
color of the point. | 🔴 No. |
| RGB565
| uint16
| A lossy compressed color format that packs the RGB
color into 16 bits, providing 5 bits for red, 6 bits for green, and 5 bits for blue. | 🔴 No. |
| NORMAL
| float32[3]
| A unit vector defining the normal of the point. | 🔴 No. |
| NORMAL_OCT16P
| uint8[2]
| An oct-encoded unit vector with 16-bits of precision defining the normal of the point. | 🔴 No. |
| BATCH_ID
| uint8
, unit16
(default), or uint32
| The batchId
of the point that can be used to retrieve metadata from the Batch Table
. | 🔴 No. |
These semantics define global properties for all points.
Semantic | Data Type | Description | Required |
---|---|---|---|
POINTS_LENGTH |
uint32 |
The number of points to render. The length of each array value for a point semantic should be equal to this. | ✅ Yes. |
RTC_CENTER |
float32[3] |
A 3-component array of numbers defining the center position when point positions are defined relative-to-center. | 🔴 No. |
QUANTIZED_VOLUME_OFFSET |
float32[3] |
A 3-component array of numbers defining the offset for the quantized volume. | 🔴 No, unless POSITION_QUANTIZED is defined. |
QUANTIZED_VOLUME_SCALE |
float32[3] |
A 3-component array of numbers defining the scale for the quantized volume. | 🔴 No, unless POSITION_QUANTIZED is defined. |
CONSTANT_RGBA |
uint8[4] |
A 4-component array of values defining a constant RGBA color for all points in the tile. |
🔴 No. |
BATCH_LENGTH |
uint32 |
The number of unique BATCH_ID values. |
🔴 No, unless BATCH_ID is defined. |
Examples using these semantics can be found in the examples section below.
POSITION
defines the position for a point before any tileset transforms are applied. Positions may be defined relative-to-center for high-precision rendering [4]. RTC_CENTER
defines the center position.
If POSITION
is not defined, positions may be stored in POSITION_QUANTIZED
which defines point positions relative to the quantized volume.
If neither POSITION
or POSITION_QUANTIZED
are defined, the tile does not need to be rendered.
A quantized volume is defined by offset
and scale
to map quantized positions into model space.
Figure 2: A quantized volume based on offset
and scale
.
offset
is stored in the global semantic QUANTIZED_VOLUME_OFFSET
, and scale
is stored in the global semantic QUANTIZED_VOLUME_SCALE
.
If those global semantics are not defined, POSITION_QUANTIZED
cannot be used.
Quantized positions can be mapped to model space using the formula:
POSITION = POSITION_QUANTIZED * QUANTIZED_VOLUME_SCALE + QUANTIZED_VOLUME_OFFSET
If more than one color semantic is defined, the precedence order is RGBA
, RGB
, RGB565
, then CONSTANT_RGBA
. For example, if a tile's feature table contains both RGBA
and CONSTANT_RGBA
properties, the runtime would render with per-point colors using RGBA
.
If no color semantics are defined, the runtime is free to color points using an application-specific default color.
In any case, 3D Tiles Styling may be used to change the final rendered color and other visual properties at runtime.
Per-point normals are an optional property that can help improve the visual quality of points by enabling lighting, hidden surface removal, and other rendering techniques. The normals will be transformed using the inverse transpose of the tileset transform.
Oct-encoding is described in A Survey of Efficient Representations of Independent Unit Vectors by Cigolle et al.. An implementation for encoding and decoding these unit vectors can be found in Cesium's AttributeCompression module.
Points that make up distinct features of the point cloud may be batched together using the BATCH_ID
semantic. For example, the points that make up a door in a house would all be assigned the same BATCH_ID
, whereas points that make up a window would be assigned a different BATCH_ID
.
This is useful for per-object picking and storing application-specific metadata for declarative styling and application-specific use cases such as populating a UI or issuing a REST API request on a per-object instead of per-point basis.
The BATCH_ID
semantic may have a componentType
of UNSIGNED_BYTE
, UNSIGNED_SHORT
, or UNSIGNED_INT
. When componentType
is not present, UNSIGNED_SHORT
is used.
The global semantic BATCH_LENGTH
defines the number of unique batchId
values, similar to the batchLength
field in the Batched 3D Model header.
These examples show how to generate JSON and binary buffers for the feature table.
This minimal example has four points on the corners of a unit length square.
var featureTableJSON = {
POINTS_LENGTH : 4,
POSITION : {
byteOffset : 0
}
};
var featureTableBinary = new Buffer(new Float32Array([
0.0, 0.0, 0.0,
1.0, 0.0, 0.0,
0.0, 0.0, 1.0,
1.0, 0.0, 1.0
]).buffer);
The following example has four points (red, green, blue, and yellow) above the globe. Their positions are defined relative-to-center.
var featureTableJSON = {
POINTS_LENGTH : 4,
RTC_CENTER : [1215013.8, -4736316.7, 4081608.4],
POSITION : {
byteOffset : 0
},
RGB : {
byteOffset : 48
}
};
var positionBinary = new Buffer(new Float32Array([
0.0, 0.0, 0.0,
1.0, 0.0, 0.0,
0.0, 0.0, 1.0,
1.0, 0.0, 1.0
]).buffer);
var colorBinary = new Buffer(new Uint8Array([
255, 0, 0,
0, 255, 0,
0, 0, 255,
255, 255, 0,
]).buffer);
var featureTableBinary = Buffer.concat([positionBinary, colorBinary]);
In this example, the 4 points will have normals pointing up [0.0, 1.0, 0.0]
in oct-encoded format and they will be placed on the corners of a quantized volume that spans from -250.0
to 250.0
units in the x
and z
directions.
var featureTableJSON = {
POINTS_LENGTH : 4,
QUANTIZED_VOLUME_OFFSET : [-250.0, 0.0, -250.0],
QUANTIZED_VOLUME_SCALE : [500.0, 0.0, 500.0],
POSITION_QUANTIZED : {
byteOffset : 0
},
NORMAL_OCT16P : {
byteOffset : 24
}
};
var positionQuantizedBinary = new Buffer(new Uint16Array([
0, 0, 0,
65535, 0, 0,
0, 0, 65535,
65535, 0, 65535
]).buffer);
var normalOct16PBinary = new Buffer(new Uint8Array([
128, 255,
128, 255,
128, 255,
128, 255
]).buffer);
var featureTableBinary = Buffer.concat([positionQuantizedBinary, normalOct16PBinary]);
In this example, the first two points have a batchId
of 0, and the next two points have a batchId
of 1. Note that the batch table only has two names.
var featureTableJSON = {
POINTS_LENGTH : 4,
BATCH_LENGTH : 2,
POSITION : {
byteOffset : 0
},
BATCH_ID : {
byteOffset : 48,
componentType : "UNSIGNED_BYTE"
}
};
var positionBinary = new Buffer(new Float32Array([
0.0, 0.0, 0.0,
1.0, 0.0, 0.0,
0.0, 0.0, 1.0,
1.0, 0.0, 1.0
]).buffer);
var batchIdBinary = new Buffer(new Uint8Array([
0,
0,
1,
1
]).buffer);
var featureTableBinary = Buffer.concat([positionBinary, batchIdBinary]);
var batchTableJSON = {
names : ['object1', 'object2']
};
In this example, each of the 4 points will have metadata stored in the batch table JSON and binary.
var featureTableJSON = {
POINTS_LENGTH : 4,
POSITION : {
byteOffset : 0
}
};
var featureTableBinary = new Buffer(new Float32Array([
0.0, 0.0, 0.0,
1.0, 0.0, 0.0,
0.0, 0.0, 1.0,
1.0, 0.0, 1.0
]).buffer);
var batchTableJSON = {
names : ['point1', 'point2', 'point3', 'point4']
};
The Batch Table contains application-specific metadata, indexable by batchId
, that can be used for declarative styling and application-specific use cases such as populating a UI or issuing a REST API request.
If the BATCH_ID
semantic is defined, the Batch Table stores metadata for each batchId
, and the length of the Batch Table arrays will equal BATCH_LENGTH
.
If the BATCH_ID
semantic is not defined, then the batch table stores per-point metadata, and the length of the Batch Table arrays will equal POINTS_LENGTH
.
See the Batch Table reference for more information.
.pnts
TODO, #60
application/octet-stream