@MoeBritannica Of the models, ye? How's it confirmed it's trained on CP?

His ISP may have just detected torrents going on and sent him legal threats against piracy for all that post actually says, if the guy that says he got a letter isn't lying, if the guy in the screenshot isn't lying, if the screenshot is real to begin with

@applejack screenshot comes from Stable Diffusion Training Labs, and sdupdate made the psa about it.
whether its trained on cp or not idc, i dont want my pc to glow green

@MoeBritannica I feel like anyone could say they got a letter with any general imggen set that's capable of understanding "naked" and "child", even loli/anime ones with "they used traced/filtered content"

You could even have an anime set really well made and then a while later it turns out one out of twenty billion images you scraped was actually traced CP so the whole thing has to be thrown out

@applejack @MoeBritannica afaik, your ISP won't flag you down just for downloading torrents because it's just a p2p connection and those happen often, plus torrents themselves are legal. if you're playing nintendo games online you're gonna' have a p2p connection, for instance. your isp will only send you a letter if there is a hollywood film studio that sends the isp a notice saying that you were pirating their movie, which they find by just looking at all of the IP addresses that are currently downloading the torrent.

@beardalaxy @MoeBritannica @applejack >torrenting hollywood shit

@Zerglingman @applejack @MoeBritannica yeah the last time i did that it was lightyear and that's only because my friend wanted to watch it but didn't want to pay for it because he knew it was gonna' suck lol. can't remember the time before that.

music doesn't really get torrented very much now either with streaming services around and youtube ripping but it's a problem there also.

idk if torrenting video games will get you flagged or not. it seems like game companies might not care as much because people won't be able to play them online if they are getting cracked ones. you can't really put DRM on a movie though, there are so many ways around it that are super easy, music is even easier, so that's probably why they hang around in torrents to catch people in the act.

@beardalaxy @MoeBritannica @applejack >music doesn't really get torrented very much now either with [bandcamp]

@beardalaxy @Zerglingman @applejack @MoeBritannica >"you illegally downloaded that game! That's stealing!"
>"It's a review copy, I'm reviewing it"
>"You've been playing it since 2010!"
>"I'm being thorough"

@Zerglingman @beardalaxy @MoeBritannica @applejack if only you could torrent laser disc remakes.

@beardalaxy @MoeBritannica ISPs can detect and regularly throttle torrents, they don't discriminate against legal or illegal, most of it's illegal, there's nothing illegal about sending vaguely threatening "piracy is a crime" emails and no reason for them not to do it

It's not just P2P, bittorrent packets have standard headers that people can and do detect. I don't think there's anything preventing them from detecting traffic, getting the metadata, making a list of titles and auto-generating an email like

We have detected Torrent activity of the following content:

* Cunnymancer AI-Training Model
* Season 5 Animedancers
* 50000tb of porn

We would like to remind you of the legal ramifications of pirating and other such crimes. Please refrain

@applejack @MoeBritannica well if that was the case you'd think they'd realize it was an antipiracy letter and not whatever else they got that spooked them

@applejack @MoeBritannica >How's it confirmed it's trained on CP?

It's possible to reconstruct the training data from the model, and there are multiple papers on how one might achieve this. This is a problem inherent to neural networks, and cannot be avoided no matter what the architecture or training method is.

It is why the US government *cannot* provide neural networks that detect CP to big tech companies - this is functionally equivalent to giving them a giant pile of CP.

@ceo_of_monoeye_dating @MoeBritannica Really? I would have thought it's just a one-way-function that ends up as a bunch of weights

I know the trained data becomes huge though so I guess that sounds plausible

@applejack @MoeBritannica That's what a lot of experts think too, and it's surprising to them when such attacks exist!

The upshot is that a neural network can be treated as a database which poorly fetches information from the training set. (This is NOT how experts think of it typically, but it is true). Because of this, it's possible that someone with the right information might come along and grab information you don't really want them grabbing [1].

For literally the first example of someone doing this I came across on google, see [2]. If you want to start diving into how long people have been doing this, check the references. (I am surprised they don't mention Dwork's paper at all, as it's sort of fundamental.)

1) http://audentia-gestion.fr/MICROSOFT/dwork.pdf
2) https://arxiv.org/abs/2206.07758