this post was submitted on 20 Oct 2025
370 points (99.5% liked)
Funny
12032 readers
2174 users here now
General rules:
- Be kind.
- All posts must make an attempt to be funny.
- Obey the general sh.itjust.works instance rules.
- No politics or political figures. There are plenty of other politics communities to choose from.
- Don't post anything grotesque or potentially illegal. Examples include pornography, gore, animal cruelty, inappropriate jokes involving kids, etc.
Exceptions may be made at the discretion of the mods.
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Caching is like accruing debt for CPU time between network connected devices. Let's suppose the following:
Computer X is talking to computer Y with a 32mb cache on each side. They both need to be involved in the following math that's about to take place. Computer X is doing the math, and Y is supplying the data, but also manipulating the return data for some data it will send in the future.
This is all well and good if this a 2-endpoint network. Computer Y will be ready for X's data at any time. However, the internet is not 2 endpoints, and both X and Y are talking to a bunch more computers about totally unrelated computationally networked tasks. So now Computer X can't send data to Y or vice versa because they're busy. X doesn't have anything to do so it works on the next problem it has lined up for Y and critically, adds this data to a cache marked "for Y, do not delete."
And now you might see how "caching" a varitable niagara falls of data (cloud compute requirements) to the wider world would get rather bloated, literally running up computational debt until storage is exceeded.
EDIT: To nail home the debt analogy, this debt also accrues interest in the form of the CPU cycles needed to manipulate data within the cache, including both retrieving and storing that data, although this often happens with any networking whatsoever so it's only measurable in a case where the cache is so bloated.