Snapshot service

Latest snapshots

ChainSafe provides a snapshot service for the Filecoin network. The latest snapshots are generated approximately hourly and are available for the mainnet and calibration networks. The snapshots are stored on the ChainSafe Filecoin Snapshot Service. They store the last 2000 tipsets and are enough to bootstrap a new node. A checksum is provided for each snapshot to ensure its integrity.

info

The snapshots are compressed with the zstd algorithm. Both Forest and Lotus can read them, so there's no need for a manual decompression. On top of that, the snapshots include an index (hence the extension .forest.car.zstd) that allows them to be read-in place without importing it to a database (only Forest supports this feature). See the Forest CAR format documentation for more details. You might also want to watch Filecoin Snapshots Explained.

Archival snapshots

Archival snapshots are available free of charge. Note that they are not actively generated and are provided on a best-effort basis. Two types of archival snapshots are available:

• Lite snapshots: historical snapshots containing complete state trees for the 900 most recent epochs, plus the full block header history back to genesis. They are available at 30,000 epoch intervals.
• Diff snapshots: incremental snapshots containing only the new IPLD key-value pairs since the last diff snapshot. Published every 3,000 epochs. A diff snapshot must be used together with its matching base lite snapshot — it does not contain a complete state tree on its own.

For detailed usage instructions, including how to set up a partial archival node and how to figure out which snapshots you need, see the Archival Snapshots guide.

Snapshot generation details

The snapshot service is no longer open-source and not under Forest team's aegis. For past implementation, see the service docker image and the Terraform module.

That said, the general algorithm for snapshot generation should stay the same. The service generates snapshots by:

1. Download the latest snapshot from the network (or use the last one it generated).
2. Import the snapshot into the node and wait for it to sync.
3. Export the snapshot.
4. Upload the snapshot.

Snapshot generation performance

Forest produces snapshots compatible with Lotus, with much faster generation times and smaller memory usage. Below are the results of a recent comparison between Forest and Lotus snapshot generation.

This benchmark was performed on a bare metal server with the following specifications:

• AMD EPYC 7F32 8-Core Processor
• 512 GiB RAM
• 4 TiB NVMe SSD

	Generation time [min]	Avg. CPU usage [%]	Peak CPU usage [%]	Avg. memory usage [GiB]	Peak memory usage [GiB]
Forest	28	1.64	1.97	11	14
Lotus	93	6.15	10.6	122	276