Cloud Accelerators Are Abundant; Just One GPU is in Scarce Supply
Share This Post
Every hour for a week, TechInsights probed Amazon Web Services to see what accelerators were available in what regions. In general, accelerator-based instances from AWS are widely accessible from a wide range of regions. However, end-users seeking access to newer NVIDIA H100 instances, ideal for Large Language Models, are likely to face frustration due to ongoing supply chain issues. End-users should make advance reservations in the meantime, while supply chain issues ease and new capacity proliferates through cloud providers.
