Most of the demand for data center GPUs comes from the big tech companies themselves, to develop products/services.
Facebook and Twitter are both now signaling that the resources they funded with vast amounts of capital would be worth more to shareholders if they were leased to the highest bidder.
This is either a realization that their internally developed product/service roadmap is not panning out, or that the lease demand is so high that they’d be fools not to take advantage.
Cool. So they’ll build and operate gas turbines (or probably contract operations to do so) and then drive demand on the natgas, as well as over burden the gas delivery networks.
I’d add that Excel didn’t kill the engineering field. It made them more effective and maybe companies will need less of them. But it also means more startups and smaller shops can make use of an engineer. The change is hard and an equilibrium will be reached.
I think many people don’t need to worry performance of reference type allocations vs value type.
I don’t mean to assume you do or do not need to worry about that consideration. But 99% of the code I’ve written does not need to be concerned about it.
Could you elaborate? I don’t see anything about improving the performance of enumerator. Zlinq appears to remove the penalty of allocating enumerators on the heap to be garbage collected. The link you sent mention improvements, but I don’t see how they lead to linq avoiding heap allocations.
This is my understanding as well. And the logistics of doing this can be simplified by re-using oil and gas facilities. Regardless of your feelings and levels of skepticism about oil and gas, this seems like the most straight-forward and low-energy path forward to me.
In my experience units of measure in technical apps is only interesting in the UI layer as most apps I’ve worked on have a “base” system of units that all calcs are expecting. What alternate experience have you seen?
I have to admit that, as a hack, the amount of planning, technical integration, and apparently flawless execution must have required an awesome amount of effort by very intelligent people.
As a human being though, this is revolting. A new avenue of mass destruction. I sure hope I am never around someone a Mossad-like organization wants to kill.
I don’t buy it. I think his strong suit is fostering innovation. It turns out that the logistics challenges of maintaining complex systems over long periods of time is a different strength that Stripe and Twitter seem not to Meet Expectations
Already answered below, but the bulk of the market for H100’s appears to be AI. HPC was historically the largest market for this class of accelerator, but it appears to have shifted to hyper scale cloud computing centers.
HPC’s are used to distribute the computation of differential equations using numerical methods and AI appears to be making inroads here as well. I would be interested in others’ opinion on whether it’s a settled question on whether or not AI will be able to produce equivalent solutions.
From HPC industry experience with Nvidia, my take is that they are the smartest guys in the room. They’re solution architects that help customers implement and optimize CUDA area by far the best SA’s I’ve ever worked with. If that hiring ethos is pervasive they’ll keep winning.
In the last few years they have dropped their recruiting significantly but ExxonMobil recruited Ph.D’s from the best universities for decades. Lots and lots of VERY smart people work there.
Facebook and Twitter are both now signaling that the resources they funded with vast amounts of capital would be worth more to shareholders if they were leased to the highest bidder.
This is either a realization that their internally developed product/service roadmap is not panning out, or that the lease demand is so high that they’d be fools not to take advantage.