463
submitted 1 month ago* (last edited 1 month ago) by TriflingToad@sh.itjust.works to c/showerthoughts@lemmy.world

Had this thought the other day and tbh it's horrifying to think about the implications of one, or God forbid all, of them going down.
Stackoverflow too but that only applies to nerds haha

top 50 comments
sorted by: hot top controversial new old
[-] jlh@lemmy.jlh.name 76 points 1 month ago

All the more reason to data horde. The costs of storing these libraries are going down, and it is likely that everyone can have their own copy of it all in the near future.

https://annas-archive.org/blog/critical-window.html

[-] lud@lemm.ee 26 points 1 month ago

The amount of data is also increasing constantly and by a lot.

[-] dharmacurious@slrpnk.net 9 points 1 month ago

The article they linked goes over that. It's a really good read

[-] grue@lemmy.world 73 points 1 month ago

One of those is not a non-profit foundation, and that's a Problem.

[-] kamenlady@lemmy.world 20 points 1 month ago

And that one is not really comparable to the library of Alexandria.

[-] bjoern_tantau@swg-empire.de 21 points 1 month ago

But it would probably be the most interesting to future archeologists. At least all the noncommercial videos people make about their lives. The "you" part of YouTube.

load more comments (3 replies)
load more comments (1 replies)
[-] Tedesche@lemmy.world 53 points 1 month ago

I think it’s a bit ironic that Wikipedia hasn’t succumbed to the modern era of misinformation the way other information sources have, particularly given the warnings about it that have been given in the past. Not saying those warnings aren’t warranted, just that the way things have played out is counter to said expectations.

[-] JubilantJaguar@lemmy.world 29 points 1 month ago

There's an obvious reason for that. Wikipedia is owned by a nonprofit foundation and does not accept advertising.

[-] FundMECFSResearch@lemmy.blahaj.zone 17 points 1 month ago* (last edited 1 month ago)

It definitely has, just not to as large a scale.

In practice it’s ran like a heirarchical aristocracy, where a admins control articles they care about and are very picky about the changes they allow.

One article about an illness contains false information related to alternative medicine “treatments” and I edited it, this was removed by the person who made most of the page. I got into an argument with them, and turns out they have the same username and come from the same country as an account on other platforms selling alternative medicine products, which are subtly advertised on the page they control. They also are a wikipedia admin.

Anyways I reported this to the admin team, and my report was immediately deleted by the admin I was reporting, and I got a three year ban. Mind you I have over a thousand wikipedia edits and have made some big contributions so this was quite annoying.

And this is far from the only incident. The people who are most likely to edit wikipedia pages are those who really care about, or could really benefit from the topic. So you end up having situations where companies hire agencies to improve their image by changing the wikipedia article about them and their products, same thing for celebrities.

[-] JubilantJaguar@lemmy.world 6 points 1 month ago

Interesting anecdote. Though to judge by your username, it seems you may have an agenda yourself.

So you end up having situations where companies hire agencies to improve their image by changing the wikipedia article about them and their products, same thing for celebrities

This is a major problem that takes up a lot of time for the editors. It explains some of their trigger-happiness.

That said, you have a valid point. I once tried to water down what I considered to be excessively POV language in an article about diet. This earned me an official warning for "extremism" or "conspiracism" or whatever. My impressive account pedigree also counted for nothing. So there's definitely a bit of the political bias, the power-tripping and gatekeeping that you see in any online community. But it's a bit of a conundrum too, because they are fighting an uphill battle against people with strong incentives and sometimes money too.

[-] FundMECFSResearch@lemmy.blahaj.zone 7 points 1 month ago* (last edited 1 month ago)

Interesting anecdote. Though to judge by your username, it seems you may have an agenda yourself.

This wasn’t the ME/CFS article (the illness I am personally disabled by) and anyways all this happened before I became disabled.

Anyways my ban is over now, but I can’t get myself to edit wikipedia anymore. It was a pretty shitty experience and I don’t wanna go back.

And it wasn’t the only one. So much NPOV-violating stuff on most the fringe articles and whenever you edit to make more neutral tone or you remove something unsupported by citations you end up in an insufferable straw man argument chain on the talk page.

The main fun part is filling out abandoned articles and making new articles yourself. But anything showing problems in other people’s work becomes really tiring really quick with all the talk page nonsense and endless reverts.

[-] daddy32@lemmy.world 5 points 1 month ago

What's a shame. No way to report him higher in hierarchy?

[-] Mwa@lemm.ee 4 points 1 month ago

There is people who watch most popular articles,its not rlly misinformation.

[-] Beacon@fedia.io 46 points 1 month ago

Wikipedia essentially can't be destroyed without a global catastrophe that would mean we have way worse problems. Wikipedia is downloadable. Meaning the ENTIRE Wikipedia. And so there are many copies of it stored all around the planet.

If you have an extra 150 GB of space available then you can download a personal copy for yourself

https://www.howtogeek.com/260023/how-to-download-wikipedia-for-offline-at-your-fingertips-reading/

[-] Chozo@fedia.io 20 points 1 month ago
[-] Beacon@fedia.io 16 points 1 month ago

But that's just for the text version without media files

[-] TriflingToad@sh.itjust.works 14 points 1 month ago

25gb of text is a lot dang!

[-] Beacon@fedia.io 3 points 1 month ago

I assume that contains all the different languages. So most articles will repeat the same information like 10 times or whatever for all the different common languages. Still a huge amount of text though!

[-] macroplastic@sh.itjust.works 17 points 1 month ago* (last edited 1 month ago)

Nope, 25 gb is just english language wikipedia compressed, no images. All the other languages are smaller.

https://meta.wikimedia.org/wiki/Data_dump_torrents

[-] brbposting@sh.itjust.works 4 points 1 month ago

Ahh compressed so it’s like… a lot times a lot of text

load more comments (1 replies)
[-] lemmydividebyzero@reddthat.com 11 points 1 month ago* (last edited 1 month ago)

With scraping, you can fully download YouTube, too.

You just need an additional 10 EB of storage space, Millions of different IP addresses, a law firm to deffend against Alphabet, lots of time and energy, ...

[-] Beacon@fedia.io 11 points 1 month ago

I think i have an old thumb drive with 10 exabytes free on it

load more comments (1 replies)
load more comments (1 replies)
[-] Wiz@midwest.social 38 points 1 month ago

Let's help PeerTube replace YouTube.

[-] Gradually_Adjusting@lemmy.world 27 points 1 month ago

Alexandria was important in its time, but in terms of the volume and quality of information we keep on Wikipedia alone, it is a mosquito in the Taj Mahal.

[-] drosophila@lemmy.blahaj.zone 24 points 1 month ago

I would add Project Gutenberg and Open Street Map to your list.

[-] sit@lemmy.dbzer0.com 17 points 1 month ago

You can’t rely on YouTube videos staying up over time.

Better download what you want might want to look up again

[-] Wade@lemmy.world 12 points 1 month ago

Can't count on the library of Alexandria staying up over time either

[-] ellen_musk_0x@lemm.ee 3 points 1 month ago

I think we also overestimate the valve if what would have been at Alexandria.

Considering everything would have been hand copied/transcribed back then, and his expensive that would have been, the selection bias would be massive.

I doubt it could compare to Wikipedia.

[-] einlander@lemmy.world 16 points 1 month ago
[-] TriflingToad@sh.itjust.works 10 points 1 month ago

wikibooks is cool, had no idea that existed. I'm sure next time I get curious at 3am I'll end up there reading about the history of 'vectors' or some other random stuff lol

[-] TriflingToad@sh.itjust.works 16 points 1 month ago

There was a video I saw (I think it was hank or John Green), where they talked about the implications of twitter being deleted during the start of Elon. They pulled out a joke book they bought of "1000 twitter posts" and said how it would be the only recorded proof they (personally) had of what twitter was.

It's terrifying thinking of just how much information is just being put in the hands of companies that don't care or just on old hard drives about to give out due to funding. I wish there was a way to backup a random part of the information automatically, like a "I'll give you a terabyte of backup, make the most of it" automatically choosing what isn't backuped already.

Also add reddit too, the amount of times I've searched a question and went through 2024 website crap then went back to the search and added "site:reddit" into DuckDuckGo and got an answer instantly.

[-] UltraGiGaGigantic@lemmy.ml 12 points 1 month ago
load more comments (1 replies)
[-] SubArcticTundra@lemmy.ml 11 points 1 month ago

There pught to be a decentralized archive of YT. ...and Archive

[-] 9point6@lemmy.world 7 points 1 month ago* (last edited 1 month ago)

The problem with YouTube is the sheer amount of storage required. Just going by the 10 Exabyte figure mentioned elsewhere in the thread, there are about 25,000 fediverse servers across all services in total IIRC, so even if you evenly split that 10EB across all of them, they would still need 400TB each just to cover what we have today.

Famously YouTube needs a petabyte of fresh storage every day, so each of those servers would need to be able to accept an additional 40GB a day.

Realistically though, any kind of decentralised archive wouldn't start with 25,000 servers, so the operational needs are going to be significantly higher in reality

[-] coronach@lemmy.sdf.org 3 points 1 month ago

I know it's totally subjective, but I wonder how much "non-trash" YouTube is uploaded each day?

load more comments (1 replies)
load more comments (4 replies)
[-] possiblylinux127@lemmy.zip 8 points 1 month ago

I wish that the Internet Archive would focus on allowing the public to store data. Distribute the network over the world.

[-] csm10495@sh.itjust.works 4 points 1 month ago

In theory this could be true. In practice, data would be ripe for poisoning. It's like the idea of turning every router into a last mile CDN with a 20TB hard drive.

Then you have to think about security and not letting the data change from what was originally given. Idk. I'm sure something is possible, but without a real 'omph' nothing big happens.

[-] possiblylinux127@lemmy.zip 3 points 1 month ago

The data would be hashed so any changes would be thrown out.

load more comments (3 replies)
[-] Beacon@fedia.io 2 points 1 month ago

Nah, that's the easy part. Checksum technology has been around for many decades

https://www.lifewire.com/what-does-checksum-mean-2625825

load more comments (1 replies)
[-] antonim@lemmy.dbzer0.com 3 points 1 month ago

Huh? The public can store data on IA just fine. I've uploaded dozens of public-domain books there.

[-] Badoker@lemmy.nz 6 points 1 month ago

But all the data is on IA's servers. In the event their servers go down for good, that's it. There's no way to self host parts of the Archive fediverse style.

load more comments (2 replies)
[-] Kolanaki@yiffit.net 6 points 1 month ago

Man, it's gonna suck when Wikipedia burns to the ground twice.

They can't burn all of us (datahoarders)!

[-] antonim@lemmy.dbzer0.com 4 points 1 month ago* (last edited 1 month ago)

If we're going to stick to ancient Greek references, one of these is closer to the modern day Augean stables.

[-] spaduf@slrpnk.net 3 points 1 month ago

And they are just as fragile.

[-] Kcg@lemmy.ml 2 points 1 month ago

AnnasArchive.org is good at backing up knowledge on a large scale. They also have torrents to spread it around a bit.

load more comments
view more: next ›
this post was submitted on 23 Nov 2024
463 points (96.2% liked)

Showerthoughts

30044 readers
702 users here now

A "Showerthought" is a simple term used to describe the thoughts that pop into your head while you're doing everyday things like taking a shower, driving, or just daydreaming. A showerthought should offer a unique perspective on an ordinary part of life.

Rules

  1. All posts must be showerthoughts
  2. The entire showerthought must be in the title
  3. Avoid politics
    • 3.1) NEW RULE as of 5 Nov 2024, trying it out
    • 3.2) Political posts often end up being circle jerks (not offering unique perspective) or enflaming (too much work for mods).
    • 3.3) Try c/politicaldiscussion, volunteer as a mod here, or start your own community.
  4. Posts must be original/unique
  5. Adhere to Lemmy's Code of Conduct

founded 2 years ago
MODERATORS