They're just covering for all the possibilities. They don't want the astronauts to have "a bad day", so in case something does go wrong in testing, they can simply go with Plan B: Ride the Dragon.
something something shareholders something quarterly profit something
That's probably the real reason they cut back on a lot of stuff.
Shareholders need to hodl longer instead of trying to hit those quarterlies.
I remember
If anything, as long as local-run models get better, the power and potential for individuals to expand past their expertise grows. We're in a transitionary period, where what helps the good also helps the bad, but what harms the bad also harms the good much more.
As a general rule of thumb, you need about 1 GB per 1B parameters, so you're looking at about 405 GB for the full size of the model.
Quantization can compress it down to 1/2 or 1/4 that, but "makes it stupider" as a result.
I've noticed that performance starts slowing down when you get near full on these drives sometimes.
None of these drives are problem drives iirc.... if anything, how full are the drives percentagewise?
A Christian should not be voting at all. Their alliegance is with God, not the world.
So it seems that helping people out of the debt hole they've fallen / been tossed into makes them more able to work and contribute to society. What a concept!
It's fine... though, are you still in grade school?
When this happened to Linux and MacOS users of Crowdstrike some time ago, no one cared.
"I would do anything for clout..."
"But I won't do that!"
