“@jamesdouma @farzyness Training compute should soon not be so much of a limiting factor. Very difficult bringing the 10k H100 cluster online btw. Similar experience to bringing our now 16k A100 cluster online. Uptime & performance are low at first, then improve with lots of work by Tesla & Nvidia.”