The ceo of open ai, Sam Altman, says PC's are a waste of the world's precious DRAM resources. Because 95% of the time the memory is just sitting idle. This is important to customers because it calls into question the need to own local PC's when you can just use cloud services with centralized resources. He is really implying a world where you just subscribe to stuff instead of owning high end PC's
OpenAI CEO argues local memory is inefficient for AI workloads
Sam Altman believes in a centralized cloud data center model where DRAM is used to the full potential when it comes to the AI applications. He thinks the model of dispersing memory across individual PC's is a waste. Which of course fits OpenAI's model of providing cloud subscriptions. Making money if people use their services over the cloud instead of locally.
Right now memory companies are focused on data center applications. This is driving up prices on the consumer side for PC hardware. So the supply chains are geared towards this model which means PC builders have less DRAM resources to work with.
We're catering to large scale AI systems now instead of individual users. Driving home the need for cloud solutions over local PC ownership.
Altman doesn't consider that there are non ai applications on PC's. Things like gaming, multitasking and regular applications. For people like gamers and professionals low latency local usage might be important.
And something that you can't always get on the cloud. The assumption is that everything you want to compute is a good candidate for remote processing. Which is limiting to many when it comes to local high end performance options.
Source: NotebookCheck




Discussion
0 comments