Dataset

The Pile

The Pile is a diverse, open-source language modeling dataset.