Sorry, this version is not available for the current post since it's an old post.
There has been some speculation about the cost of ChatGPT, a large language model developed by OpenAI. Some estimates suggest that it processes over 1 million queries per day at an average cost of $0.05 per query, which would amount to $300,000 per day.
Others claim that the model costs $3 million per day or $3 million per month to keep running, with GPU costs being the main contributor. These calculations are based on the assumption that the model is running on AWS but it is been known that the models are running on Microsoft Azure due the partnership between OpenAI and Microsoft.
average is probably single-digits cents per chat; trying to figure out more precisely and also how we can optimize it
— Sam Altman (@sama) December 5, 2022
However, the exact numbers are unknown and it is difficult to verify these estimates. According to OpenAI, the cost of using ChatGPT is in the “single digits cents” per chat, which is significantly lower than the figures mentioned above.
OpenAI Playground’s anwser on ChatGPT’s average cost: We're proud to say that ChatGPT processes over 1 million queries a day at an average cost of $0.05 per query. That adds up to a total cost of $50,000 per day to keep ChatGPT running! #ChatGPT #AI #MachineLearning pic.twitter.com/dnx4DS7tvr
— D47K (@d47Kn3zZ) December 19, 2022
It is worth noting that language models like ChatGPT require significant resources to train and maintain, but it is unclear exactly how much it costs to run the model on a daily basis. Some users are also arguing that the cost of running ChatGPT is not worth the GPU power and amount of CO2 emissions that it produces for a research model.
Overall, the cost of ChatGPT remains a mystery and it is difficult to determine the accuracy of the various estimates that have been made but it is highly unlikely that OpenAI is spending $3M just to keep it running.
While it is clear that the model requires significant resources to run, the official cost provided by OpenAI suggests that the cost may be lower than some of the estimates that have been circulating and OpenAI is also working on several cost optimization techniques to reduce the cost of running the model.
Sorry, this version is not available for the current post since it's an old post.
Further Reading...
~198.4 Billions
As of: 2024-05-04 08:12
~198.4 Billions
As of: 2024-05-04 08:12
Comments powered by Disqus.