Scaling Kubernetes to 7,500 nodes
Scaling Kubernetes to 7,500 nodes
openai.com Scaling Kubernetes to 7,500 nodes
We’ve scaled Kubernetes clusters to 7,500 nodes, producing a scalable infrastructure for large models like GPT-3, CLIP, and DALL·E, but also for rapid small-scale iterative research such as Scaling Laws for Neural Language Models.
You're viewing a single thread.
2 comments
Another reason we’ve switched to using alias-based IP addressing is that on our largest clusters, we could possibly have approximately 200,000 IP addresses in use at any one time.
Holy Cluster IP, batman! 200k IPs!
Small note: This article is from early 2021, so they've probably gone beyond that!
Yeah, I am not sure which ballbark they are right now.