![Common Crawl logo](CC_Logo_Blue.svg)

# Common Crawl Data

An open repository of web crawl data freely available to researchers, developers, and innovators worldwide. 

## Main Crawl Archives

The archives of the main crawl are released on a monthly basis. For details about the data format and how to access the data, see

- [Get started with Common Crawl data on Hugging Face](https://commoncrawl.org/blog/getting-started-with-common-crawl-data-on-hugging-face)
- [Get started - data location and formats](https://commoncrawl.org/the-data/get-started/)
- [Announcement of the new crawl data](https://commoncrawl.org/blog/april-2026-crawl-archive-now-available-in-a-hugging-face-storage-bucket)
- [Examples & Resources: Tools, code, articles, and more from the community](https://commoncrawl.github.io/cc-examples/)

The following monthly crawl archives have been released on 🤗 Hugging Face:

<!-- start crawl table -->
|   ID/Location   | Announcement | Billion Pages | Total Size Compressed (TiB) |
|:---------------:|:------------:|:-------------:|:---------------------------:|
| [CC-MAIN-2026-17](https://huggingface.co/buckets/commoncrawl/commoncrawl/tree/crawl-data/CC-MAIN-2026-17) | [April 2026](https://commoncrawl.org/blog/april-2026-crawl-archive-now-available)   | 2.19          | 106.3                      |
| [CC-MAIN-2026-21](https://huggingface.co/buckets/commoncrawl/commoncrawl/tree/crawl-data/CC-MAIN-2026-21) | [May 2026](https://commoncrawl.org/blog/may-2026-crawl-archive-now-available)   | 2.16          | 107.1                      |
| [CC-MAIN-2026-25](https://huggingface.co/buckets/commoncrawl/commoncrawl/tree/crawl-data/CC-MAIN-2026-25) | [June 2026](https://commoncrawl.org/blog/june-2026-crawl-archive-now-available)   | 2.10          | 102.7                      |
| [CC-MAIN-2026-30](https://huggingface.co/buckets/commoncrawl/commoncrawl/tree/crawl-data/CC-MAIN-2026-30) | [July 2026](https://commoncrawl.org/blog/july-2026-crawl-archive-now-available)   | 2.14          | 105.2                     |
| [CC-MAIN-2026-34](https://huggingface.co/buckets/commoncrawl/commoncrawl/tree/crawl-data/CC-MAIN-2026-34) | [August 2026](https://commoncrawl.org/blog/august-2026-crawl-archive-now-available)   | 2.14          | 105.1                     |
| [CC-MAIN-2026-39](https://huggingface.co/buckets/commoncrawl/test-bucket/tree/crawl-data/CC-MAIN-2026-39) | [September 2026](https://commoncrawl.org/blog/september-2026-crawl-archive-now-available)   | 2.17          | 103.4                     |
<!-- end crawl table -->


---

[Common Crawl](https://commoncrawl.org/) is a California 501(c)(3) registered non-profit organization. 

[Terms of Use](https://commoncrawl.org/terms-of-use) | [Privacy](https://commoncrawl.org/privacy-policy)