Good. I love to hear about outages. Really wish all data centers would implode so we can be rid of this shit.
Fuck AI
"We did it, Patrick! We made a technological breakthrough!"
A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.
Once dead internet finishes manifesting, it'll be simply bots shilling & scamming themselves. The data centers will cease to feed the greedy pigs and will be left for the rats. However, the product will have no time to rejoice for we will already have become addicted to the next big thing.
And by "rats," you mean me. Me and my crowbar are ready and waiting to get our hands on a bunch of abandoned server hardware, especially those racks and racks of hard drives.
Think of how much pirated anime you could fit a couple of those arrays!
I work in one of those AI data centers. Remarkably little storage. And the servers are astonishingly specialized for the job. Not to mention power hungry. I'd much rather have a gen10 Proliant. Or a few NUCs and a qnap.
They have different data centers for storage (AI doesn't need much), but you're right, it's all unbelievably specialized to the point of being basically useless for any purpose that it wasn't specifically designed for. We really have been spoiled with how general purpose our computing infrastructure has been up until now. That's simply not how things are scaling up anymore.
They really don't need storage except for the models and training data right? And most of that isnt theirs to begin with so why store it?
So all that breathless reporting I've been reading lately about how the AI boom is causing a hard drive shortage is bullshit just like the AIs themselves? Can't say as I'm surprised one way or the other.
One Hundred Percent THIS ^^^
This article is from June 11th. Why are you posting it here now?
Not everyone is perpetually online budd, 1st time hearing about it
Also this is not a news article, it's an opinion essay. It's perfectly reasonable to read this at any time.
So firstly, shut up, nerd. You’ve clearly never worked a corporate job and don’t understand the compulsion to in-house nothing.
I WISH. Would have saved so much headache from rolling our own framework for the millionth time instead of using standard solution that already exists... Tell me you've never worked in corporate software without telling me you've never worked in corporate software.
Secondly, approximately 0.0% of chatbot users will ever run an LLM at home.
Wut. Individual models on huggingface have monthly downloads in the hundreds of thousands... Just Deepseek R1 was downloaded 550,000 times in the last month alone. Gemma 3n was downloaded over 120,000 times in the last 7 days.
Thirdly, it’s slow as hell even on a top-end home Nvidia card — and the data centre cards are expensive.
They literally run well on mobile phones and laptops lol.
The author is desperately grasping at straws at best, intentionally making up false claims at worst... either way, they aren't qualified to write on this subject.
LocalLMs run pretty good on a 12GB RTX 2060. They're pretty cheap, if a bit rare now.
So 12GB is what you need?
Asking because my 4GB card clearly doesn't cut it 🙍🏼♀️
4GB card can run smol models, bigger ones require an nvidia and lots of system RAM, and performance will be proportionally worse by VRAM / DRAM usage balance.
require an nvidia
Big models work great on macbooks or AMD GPUs or AMD APUs with unified memory
Not only that, but the "They spent $2 for every $1"...
Yeah, that doesn't account for the $20/hr middle management job that they don't have to pay for another 5 meetings this week with a poor powerpoint presentation. Of course they're spending to make their company as competitive as possible. And sure, AI hallucinates, but have you seen MAGA fanatics? I've seen a 1b parameter model hallucinate less than that. And they have jobs -- and VOTE...
Yeah, screw this guy. I came across him on YT. He goes out of his way to paint all AI as if it were an ineffectual, hype-only, resource hog with absolutely no redeeming qualities being foisted on us by EvilCorps everywhere who are simultaneously too dumb to know that it’s a farce.
What told me he was just going for eyeballs (gotta admit, his marketing is good! I see this mofo everywhere these days) was a YT post about a grift — that predates AI — which used AI and he blamed AI for the grift! Not the human, but the technology.
Didn't notice nor heard of it until this post. So they missed a day learning/training AI?
Luddites smashed looms...
Eco Activists block pipeline construction...
...
But I'm sure massive AI datacenters will be totally safe, while sucking water and energy out of the environs at an absurd pace.
...you could run an open source model in-house.” So firstly, shut up, nerd.
uuuh... tech companies roll their own shit all the time......