SlimPajama: A 627B token cleaned and deduplicated version of RedPajama
SlimPajama: A 627B token cleaned and deduplicated version of RedPajama
www.cerebras.net SlimPajama: A 627B token, cleaned and deduplicated version of RedPajama - Cerebras
Cerebras has built a platform for push-button training of large language models that can accelerate time to insights without having to orchestrate across a large cluster of small devices.
![SlimPajama: A 627B token, cleaned and deduplicated version of RedPajama - Cerebras](https://lemmy.world/pictrs/image/d197884a-0b8c-422d-bf93-3d0374b51def.jpeg?format=webp&thumbnail=256)
Sounds like Cerebras will be training a model soon based on this dataset, will likely rival OpenLLaMa and RedPajamas models – thoughts??
0 comments