C4 (Colossal Clean Crawled Corpus)

Cleaned Common Crawl derivative introduced with T5.

Category

Pre-training corpus

Published by

Google DeepMind

Modalities

Text

Licence

ODC-BY

Size

~750 GB (English)