2
lol get rekt (awful.systems)

Text: Headline: ChatGPT in Trouble: OpenAI may go bankrupt by 2024, AI bot costs company $700,000 every day Subhead: OpenAI spends about $700,000 a day, just to keep ChatGPT going. The cost does not include other AI products like GPT-4 and DALL-E2. Right now, it si pulling through only because of Microsoft's $10 billion funding.

Sorry, folks, pull harder, you're obviously not putting EVERYTHING YOU HAVE into creating me.

you are viewing a single comment's thread
view the rest of the comments
[-] self@awful.systems 4 points 1 year ago* (last edited 1 year ago)

from the BI article:

In an effort to reduce the cost of running generative AI models, Microsoft is developing an AI chip it calls Athena, The Information first reported. The project, which started in 2019, comes years after Microsoft made a $1 billion deal with OpenAI which required OpenAI to run its models exclusively on Microsoft's Azure cloud servers.

oh man I can’t wait for this grift tech to strain our global IC manufacturing capability and create chip shortages and eventually a mountain of e-waste when it switches to being hosted on ASIC-powered nodes that can’t be used for anything but this specific grift tech nobody asked for (and of course as long as the grift keeps going, they’ll come up with “better” models that need bigger ASICs, creating more e-waste…)

what fucking year is it? I’m having deja vu

e: not to mention, making this shit ASIC-reliant means it’s incredibly easy to gatekeep who’s able to run these models via patents, licensing, and hostile pricing. a lot of the promptfans who think we’re one hardware accelerator away from running these on mobile devices aren’t just ignoring engineering — they’re arguing in the exact opposite direction of the cloud enshittification the industry has actually been pushing towards for years

[-] bitofhope@awful.systems 2 points 1 year ago

I just wanna buy computer hardware for a reasonable amount of money, man. Can't I try a video game from the current decade for once in my life?

If promptfans love ASICs so much, why not go commit corporate espionage at Broadcom and leak their networking chips' firmware sources (in Uplink the video game).

[-] jonhendry@awful.systems 1 points 1 year ago

I kinda doubt it'd be a rigid single-purpose ASIC like a miner. AI people like to fiddle with things too often for that I think.

[-] froztbyte@awful.systems 1 points 1 year ago
[-] self@awful.systems 1 points 1 year ago* (last edited 1 year ago)

this being just an ARM server should hopefully limit its potential as e-waste, assuming the cores aren’t absolute dogs for non-LLM workloads? but of course this being attached to AI hype will ensure its price tag is at least 10x what’d typically be considered reasonable for 144 ARM cores on a fast interconnect

e: some more details on the chip from before they went all-in on AI hype. it’s a nice datacenter chip that’ll host a whole lot of vCPUs, but it’s not architecturally innovative in any way I can see other than number going up in terms of performance

this post was submitted on 13 Aug 2023
2 points (100.0% liked)

TechTakes

1489 readers
30 users here now

Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.

This is not debate club. Unless it’s amusing debate.

For actually-good tech, you want our NotAwfulTech community

founded 2 years ago
MODERATORS