ChatGPT’s growing demand for GPUs is going to directly benefit NVIDIA which is one of the largest players in the AI market, reports Trendforce.
ChatGPT’s Demand For AI GPUs Surges, New Model To Require Over 30,000 NVIDIA GPUs
Previous estimates had put the number of GPUs powering the GPT model around 10-20K but with the new model, OpenAI is expected to utilize way more than that. According to the report, 30,000 is the number that is expected for the latest model that is going to power ChatGPT but it looks like we might see even more demand.
In the case of the Generative Pre-Trained Transformer (GPT) that underlays ChatGPT, the number of training parameters used in the development of this autoregressive language model rose from around 120 million in 2018 to almost 180 billion in 2020. According to TrendForce’s estimation, the number of GPUs that the GPT model needed to process training data in 2020 came to around 20,000. Going forward, the number of GPUs that will be needed for the commercialization of the GPT model (or ChatGPT) is projected to reach above 30,000.
Note that these estimations use NVIDIA’s A100 as the basis for calculations. Hence, with generative AI becoming a trend, demand is expected to rise significantly for GPUs and thereby benefit the participants in the related supply chain. NVIDIA, for instance, will probably gain the most from the development of generative AI. Its DGX A100, which is a universal system for AI-related workloads, delivers 5 petaFLOPS and has nearly become the top choice for big data analysis and AI acceleration.
The research firm notes that the demand for AI GPUs is expected to reach beyond 30,000 and that estimation uses the A100 GPU which is one of the fastest AI chips around with up to 5 Petaflops of AI performance. That number can go higher or lower depending on the chips being used but that’s going to put a lot of pressure on NVIDIA on whether they want to move their supply to AI GPUs or gaming GPUs.
NVIDIA’s CEO, Jensen Huang, has praised OpenAI’s ChatGPT tool multiple times, whether during interviews or during their financial earnings call. The company has made a lot of strides in the AI segment with the most recent introduction of the RTX Video Super Resolution which uses the AI prowess of its consumer GPUs to enhance the video and streaming quality across multiple apps. The company’s AI tensor cores are being used by game developers and production houses in the form of DLSS 3 for better performance throughput while retaining visual fidelity.
The surge of ChatGPT is definitely going to be a blessing in disguise for NVIDIA as demand for PC hardware slumps due to rising inflation across the globe. At the same time, the demand for more AI power in instances such as ChatGPT can offset the differences in revenue. The industry predicts that NVIDIA can see the demand outstrip the overall supply in the next coming quarters.
The post ChatGPT’s GPU Demand Expected To Exceed 30,000 Helping NVIDIA’s AI Business Boom by Hassan Mujtaba appeared first on Wccftech.
