Rendered at 01:52:10 GMT+0000 (Coordinated Universal Time) with Cloudflare Workers.
k1w1 3 hours ago [-]
This is the part that really stood out to me.
> It’s not only new projects putting strain on the grid though. The report found that an estimated 13 percent of US cloud consumption, totaling more than 3 gigawatts, comes from so-called "zombie" workloads—abandoned test environments and unused applications that continue to draw power without doing any useful work.
Containerized sandbox environments for AI can be incredibly wasteful. If those sandboxes are kept available so the user gets sub-second access that is a continual user of RAM, and thus overall computing resources. We built the first version of https://www.aha.io/builder/overview using a typical containerized environment - just like you see with products like Replit - but were appalled at the inefficiency and waste. We rebuilt it from the ground-up to use shared architecture instead with Javascript-level isolation, and almost zero waste. Using shared computing instead of containers means instant startup time, and (almost) zero resource consumption when not active. You still consume disk to store the artifacts, but there is no ongoing RAM or CPU.
I think a reckoning is coming for container-based AI systems too. We are seeing tokens trend towards reflecting the actual cost, and I think the same will be true of containerized runtime environments too.
tadfisher 2 hours ago [-]
We need reliable and ubiquitous checkpointing, then it won't matter if your workload executes in a container runtime or in a WASM sandbox or even on bare metal.
trueno 1 hours ago [-]
inb4 "why would you want to hinder progress" types.
seriously its not hard calculus to understand that we were barely scaling energy needs for people, if you're in the US you got a hostile asf admin thats calling everything woke and cancelling the possibilities that we could scale this in a way thats good for the damn planet. so to have datacenters come in and feel entitled to the same utilities that deprioritizes actual living breathing people .... like there is no "progress" argument to be made here. that is the opposite of progress. that is a damn regression.
if datacenters want energy they should unilaterally front the cost of the energy infrastructure to power themselves. since these things are being bankrolled from billionaire entities and idiots, they should have no problem scheduling the mar a lago dinners with the million dollar checks to get this mob of an admin to allow them to do it using "woke" energy infra. we can still live without AI, so you're not a utility yet stop pretending you are one.
same shit as the bitcoin nonsense from 14-17, all the dorkus maximus types claimed that bitcoin mining would force energy to scale and everyone would collectively benefit from greener energy sources. total fever dreams touted by people chasing greed. all of that is a pipe dream, not happening with the powers that be in control and everyone knows it.
freakynit 5 hours ago [-]
The Coming ‘Power Wars’ Between Humans and Datacenters
Seems the humans love the AI chatbots though. But I guess they figure they run on magic, not actual electricity and water.
amanaplanacanal 4 hours ago [-]
Some humans do.
Nasrudith 2 hours ago [-]
The backlash is and always has been incredibly fucking stupid. The same dipshits who want to bring manufacturing back to the US cannot tolerate goddamned data centers when the negative externalities and infastructural strain would be orders of magnitude worse.
cybercatgurrl 42 minutes ago [-]
can’t wait for people to complain about how much water or energy bringing manufacturing back to america uses. oh wait, they won’t, cause it’s not AI. people didn’t care about data centres before AI. this is an ideological issue wrapped up with a bow on it by environmental issues. that’s not to say america is absolutely handling it’s energy transition terribly, it is
> It’s not only new projects putting strain on the grid though. The report found that an estimated 13 percent of US cloud consumption, totaling more than 3 gigawatts, comes from so-called "zombie" workloads—abandoned test environments and unused applications that continue to draw power without doing any useful work.
Containerized sandbox environments for AI can be incredibly wasteful. If those sandboxes are kept available so the user gets sub-second access that is a continual user of RAM, and thus overall computing resources. We built the first version of https://www.aha.io/builder/overview using a typical containerized environment - just like you see with products like Replit - but were appalled at the inefficiency and waste. We rebuilt it from the ground-up to use shared architecture instead with Javascript-level isolation, and almost zero waste. Using shared computing instead of containers means instant startup time, and (almost) zero resource consumption when not active. You still consume disk to store the artifacts, but there is no ongoing RAM or CPU.
I think a reckoning is coming for container-based AI systems too. We are seeing tokens trend towards reflecting the actual cost, and I think the same will be true of containerized runtime environments too.
seriously its not hard calculus to understand that we were barely scaling energy needs for people, if you're in the US you got a hostile asf admin thats calling everything woke and cancelling the possibilities that we could scale this in a way thats good for the damn planet. so to have datacenters come in and feel entitled to the same utilities that deprioritizes actual living breathing people .... like there is no "progress" argument to be made here. that is the opposite of progress. that is a damn regression.
if datacenters want energy they should unilaterally front the cost of the energy infrastructure to power themselves. since these things are being bankrolled from billionaire entities and idiots, they should have no problem scheduling the mar a lago dinners with the million dollar checks to get this mob of an admin to allow them to do it using "woke" energy infra. we can still live without AI, so you're not a utility yet stop pretending you are one.
same shit as the bitcoin nonsense from 14-17, all the dorkus maximus types claimed that bitcoin mining would force energy to scale and everyone would collectively benefit from greener energy sources. total fever dreams touted by people chasing greed. all of that is a pipe dream, not happening with the powers that be in control and everyone knows it.
https://sourceryintel.com/reports/humans-vs-datacenters