Technology @lemmy.world vegeta @lemmy.world 6mo ago

Elon Musk's xAI plans to build 'Gigafactory of Compute' by fall 2025 — using 100,000 Nvidia's H100 GPUs

www.tomshardware.com Elon Musk's xAI plans to build 'Gigafactory of Compute' by fall 2025 — using 100,000 Nvidia's H100 GPUs

Plans couldn't wait for H200 or Blackwell GPUs.

96 comments

We really need to tax energy used by GPU-burning projects differently. AI training, blockchain, whatever. Such a wasteful endeavour.
- Fun fact they pay lower rate than households because fuxk you peasants ;)
  
  All industrial users pay lower, because they're able to apply economies of scale and locate themselves in places with lower power costs. Some of them are big enough that the utilities will build power lines and plants specifically to make electricity cheaper. It's not just a matter of "oh, they're rich, so we'll charge them less."
- Carbon tax, it was proposed so many years ago and it's always been a good idea.
  
  By now it should be a hard carbon budget and not a simple tax that can be dodged.
- Energy and water.
- No significant blockchains use GPUs any more. As for AI training, that produces AIs. It's not wasteful.
  
  As for AI training, that produces AIs. It's not wasteful.
  
  👀
(from Perplexity AI)
- you should try to ask the same question using xAI / Grok if possible. May also ask ChatGPT about Altman as well
Wow that's almost 6% of what Microsoft is buying this year for that same purpose.
- Yeah, but is their compute called a Gigafactory? I didn't think so.
  
  Yeah, it seems like Musk's innovation is calling it GIGAFACTORY!
  
  Obligatory exclamation point.
It will produce bigoted falsehoods so damn fast!
He's calling it a gigafactory? He already has a gigafactory, and it's actually a factory.

Just call it a datacenter, because that's what you're building.
- It’s also funny to use “giga” in the marketing when everyone else is dealing with petabytes
  
  processing measured in teraflops. data measued in petabytes. coolness measured in gigachads.
  
  Calling it a pedofactory fits his personality better.
Elon Musk is a full of shit cunt. That's it. That's the post.
So what everyone else has been doing but smaller while calling it giga. Let me buy some TSLA shares.
- Buy Nvidia shares. they're making the shovels...
  
  Yeah, but that's already priced in. Anyone wanting to get on the Nvidia train for the AI push is a few years too late. Honestly, I expect it to be overpriced, with AI hype boosting it over the value it should have.
  
  I was being sarcastic but yeah. 😁
Did he just invent self-hosting?
- Tech-bro's finest minds.
- How dare you! It's not self-hosting. It clearly says "GIGAFACTORY OF COMPUTE"
  
  I know but I'm sure he's just throwing words around, what he meant is "gigafactory of COMPUTERS"
Dude acting like he invented HPC and datacenters now?
- You haven't heard of The Cyber AI/data center majiger factory? Or do you mean XHpc? Part of the almighty X
- I don’t know, is he?
Him and everyone else. The only problem is that NVIDIA can only build them so fast, and there's only so much high power datacenter space.
You know, The Infinite Monkey Theorem states that if you chain a room full of monkeys to typewriters and let them all beat the keys at random, for an infinite amount of time, they will . . . eventually . . . through sheer random chance . . . produce the comple works of William Shakespeare. Maybe in 10 trillion years or so. THIS is current state of "AI."

What Musk is proposing is like building an army of very expensive, very wasteful fusion-powered robots to beat the monkeys in the hope that the monkeys will work just a little bit faster.
- that is to illustrate the vastness of infinity not the efficacy of monkeys
  
  assuming one infinite monkey:
  
  sonnet 18 has 592 characters- or a chance of 4.3x10^-848
  
  10 trillion is ^-13 for reference.
  
  And the universe is not even 14 billion years old.
  
  And the ^-848 was 14 lines, a onehundredth of a single percent of the complete works.
  
  However, it's infinite monkeys, so the time it would take is effectively how every long it takes for one monkey to type that many lines. A few days? A week? In an infinite monkey cage it's done at the first attempt: that's the size of infinity.
  
  All that to say, to replace that in power, if you converted all the mass in the universe to energy, and all the time until it's heat death and could combine them into one machine: probably not enough to clear Titus Andronicus.
With what money? SpaceX is the only company with any kind of steady revenue to its name and that's only because the US government subsidised it
- I'm guessing from new investors. That still believe Enron Musk groks it.
  
  In a presentation for investors, Elon Musk revealed that the new supercomputer will use as many as 100,000 Nvidia's H100 GPUs
  
  Ok I normally hate puns on peoples names, but Enron Musk is hilarious
  
  And how is he going to get all those cards? Does he know that all production is reserved for the big boys?
Wait what? $4 billions worth of h100 🙃 such a funny guy...
- H100 isn’t $40, it’s $40,000. You’re making the Bloomberg Mistake: it costs $4,000,000,000 - four billion.
  
  I can’t wait to see what clownshoes nonsense way he absolutely fucks this one up, but that’ll take a lot of liquidity he probably doesn’t have access to unless he gets the $45bn Tesla payout.
  
  xAI just finished up a funding round worth $6bn, he doesn't need to use his own money. It's the usual bunch of VC funds: Fidelity Sequoia, Kingdom Holdings (that's a Saudi fund).
  
  Ohh my fault
Can he stay out of jail by then?
- Why would he go to jail? I must be out of the loop?
  
  Fraud.
  
  Yes, you are out of the loop.
damn so much computing power.
- But can it run Crysis?
  
  How many open tabs can it have in Firefox?
  
  We will need at least 1 more gpu for that.
I hope the Muskrat chose a site with limited water resources. Without ample water, good luck keeping a data center cool enough to operate at 100%.
Ah, some interesting technology news. Let's read about what new developments are being made-

Oh, wait, Elon Musk is involved. I hate technology! Emerald mines and cave rescue submarines!
- It's more like "idiot billionaire builds bigger shiny gadget for a non specific purpose"
  
  Like what's the problem being solved here?
  
  Like what's the problem being solved here?
  
  Training AIs.
- yeah because if musk wasn't involved, lemmy's community always loves news on the latest ai hype cycle
  
  Ah yes, the wrong kind of technology.
  
  If it's a "hype cycle" I guess it'll be going away aaaaaany day now.

96 comments