Chaindata Snapshots Community Update

heyy all!! Polygon’s latest compressed snapshots have landed for all 6 snapshot combinations we support: bor-mainnet, bor-mumbai, heimdall-mainnet, heimdall-mumbai, erigon-mainnet-archive, erigon-mumbai-archive (https://snapshots.polygon.technology/)

note: moving forward, our plan is to only support monthly compressed, pruned snapshots for the above networks (potential for 2x a month). this decision follows work that’s progressing on a community-driven “snapshot aggregator” system. having a snapshot aggregator system, powered by a party of snapshot providers, will add important redundancies and improve reliability of node bootstrapping. moreover, other snapshot providers are free to refactor and improve upon our logic to drive efficiencies and introduce new features like daily incremental snapshots. we have plans to open-source our snapshot scripts for community reference.

to summarize, on Polygon’s side moving forward, our plan is to only provide snapshots for the above networks on the 1st day of every month. exact landing time depends on network / chaindata size. please expect more updates on the snapshot aggregator system over the next few months!!

Hi,

our plan is to only support monthly compressed, pruned snapshots for the above networks ",

I’m guessing this doesn’t apply for Erigon snapshots since those should not be pruned?

we have plans to open-source our snapshot scripts for community reference.

Looking forward to this.

  1. I’m curious how we would check that the snapshots vended by other providers are correct and don’t have corrupt data! Seems like a possible attack vector if we’re not careful.

Today is March 13th and the most recent snapshot is February 1st.

What is the progress on said snapshot aggregator system?

How much has been done on the “open-source our snapshot scripts” front? That’s a 20 minute job. And there are other scripts available which would work with minimum adaptations, such as https://github.com/polkachu/cosmos-validators/tree/6e37d4e4836ead0a20620c51d49d48d600501b95/roles/support_snapshot

Unrelated side-question: why is state-sync not available for heimdall?

when will you upload new snapshots? its March 30th and latest is from a month ago?

I take you mean TWO months ago… NEAR has no problem keeping a 1TB+ snapshot up to date, daily. With a streamlined download (no decompression required). Polygon has more resources than NEAR. There are much smaller chains which keep TB+ snapshots available.