@Morghur @matrix Thanks mate! I too need to start saving this crap. So many good posts are lost.

@newt @matrix I try to do the same. I will have to start classifying all the crap i find here. Inmensely good images and enlightening posts

@Morghur @matrix there needs to be a fedi archive or something

@newt @matrix Yeah, it would be in everyone's best interests to save and archive the best of the fediverse and also other related posts.

but tbh i don't trust a bot to do so.

@Morghur @matrix same. It probably won't work due to scopes and federation policies.

@Morghur @matrix on the other hand, if you can see the full thread, you can also save it. I suppose, writing a script that uses mastoapi to save threads is entirely within reach.

@newt @matrix Yeah, but to a certain degree cataloging and screening hellthreads is something very arduous.

@Morghur @newt @matrix At least with 4chan they have multiple archive sites, problem is finding them lol

@Telvannichad @matrix @newt True. With the Fediverse it would be better if each instance kept it's own archive or to be a general archive. But dunno if such thing could be done tbh

@Morghur @matrix @newt That would require the instance admins to run their own little server to archive their stuff. Idk who'd have the impetus or cash to set it up. Poast for example has like 70gb if media every few days uploaded.

@Telvannichad @matrix @Morghur poast is an exception. Most instances are smaller and this shouldn't be a problem. Stereophonic has around 30 gigs of media in total over the less than three year run of this instance.

@newt @matrix @Morghur Yeah true, honestly I'm thinking of either buying a cheap laptop to host my own instance in future since I'm strapped for cash lmao
Always wanted to see if I can set up a personal instance for my family to hang out in since FUCK whatsapp,FB,Insta bs. Invite to it and show them how it works in excruciating detail for retard proofing and a near endless amount of filters for all the trannies, degens, anime avis here.

@Telvannichad @matrix @Morghur just buy a $5/mo VPS. Should be plenty for a handful of people.

@newt @matrix @Morghur I might yeah but I'll still prob get that other machine just to mess around with. I'm studying how to set up my own basic site and some other self-hosted stuff. Don't want to mess around with that on my personal machine.

@Telvannichad @matrix @newt True. And efforts from users would be... Hard to say the least.

At least i keep saving most important and significant images posted on Fedi, from bots to users. But i doubt it's worth a damn.

@newt
I have something like that partially written, but I haven't touched it in over a year so I don't feel like studying my code again.
I wanted to write a scraper and a search engine that would double as an archive.
@Morghur

@matrix @Morghur what I’m worried about is how this software enables easy abuse. Imagine someone discussing personal matters and people just scraping entire threads to share for shits and giggle.

Granted, if you post personal stuff on fedi, you kinda have it coming. And yet, there’s plenty to go wrong here.

@newt @matrix @Morghur If you public post things you shouldn't have public posted you're going to have a bad time. No need for instances to add archives of themselves, the instance *is* the archive. sjw's posts from 3+ years ago are on here if you feel like scrolling back that far. Archiving with an external tool via the API is already done, I think it's called fediarchiver? Can't remember. But it's just json anyway so curl plus a small amount of bash is sufficient you don't have to wrangle arbitrary html or anything.

cc @Telvannichad sorry didn't notice that you weren't tagged in that branch when I replied

@roboneko No biggie

@roboneko @matrix @Morghur instances go offline left and right. What I'm thinking is more like shareable fedi bookmarks but with content attached.

@newt @matrix @Morghur Well you just have to post your copy somewhere, or just send them a link to the thread on your instance. Remote posts you've seen will be on your instance. (Unless you're trimming old ones?) Remote media is what might go missing but that's probably a disk space issue for most people anyway.

p has been talking about ipfs with revolver so that would presumably solve the "it's only on my instance how can I export it from the db" problem.

@newt >instances go offline left and right

speaking as someone who has been caught up in some pretty high-profile leaks in the past, data impermanence is not a bad thing whatsoever

@roboneko @matrix @Morghur

@knhy @matrix @Morghur @newt Data impermanence is a myth, it just means you aren't personally aware of the remaining copies. If you public post it's a safe assumption it will be around forever. You can still browse old usenet posts from the mid 90s for example.

@roboneko sure, but it makes digging up that data a lot more difficult

@matrix @Morghur @newt