Trust & Safety

[Cyberes]

Stable Diffusion is extremely impressive but presents grave risks for out-of-scope use. Models and code for Stable Diffusion have spread far and wide and any member of the public is capable of generating dangerous images. The FBI has reported a 40% increase in images depicting child exploitation and theorizes this is a result of the widespread nature of Stable Diffusion^[1].

I have created an extension that seeks to limit the harm done to children and other vulnerable classes through an innovative heuristic system. Automatic, can you include this in the extension index or maybe it can be merged into the WebUI?

https://github.com/Cyberes/automated-fbi-reporter

Here are some examples of a report:

[chavinlo]

this will do nothing other than flood reports with false positives

just imagine anime prompts, a model trained on (trending) data will most likely have more bias towards big breasts
so if someone wants to create a character with a (flat chest) they will use said prompt
oh but they had this extension (unknowingly) installed! now they are in the fbi watchlist

meanwhile real pedos will most likely run the webui on a isolated instance, no internet connection
your software simply can't make the report because theres no internet to start with

good job

[Cyberes]

Why do you know so much about real-life pedos?

[denliner]

this will do nothing other than flood reports with false positives

just imagine anime prompts, a model trained on (trending) data will most likely have more bias towards big breasts so if someone wants to create a character with a (flat chest) they will use said prompt oh but they had this extension (unknowingly) installed! now they are in the fbi watchlist

meanwhile real pedos will most likely run the webui on a isolated instance, no internet connection your software simply can't make the report because theres no internet to start with

good job

I noticed that some tags tend to give larges breasts to the created character even if the tags is unrelated to breasts. For example you want to create a male character with hime cut, you are forced to use the "flat chest" tag if you don't want to create a male character with larges breasts because "hime_cut" automatically give larges breasts.

And don't forget that flat chested grown womens actually exists.

[chavinlo]

Why do you know so much about real-life pedos?

because you are on matrix

[G2G2G2G]

Why do you know so much about real-life pedos?

why do you? apparently you can detect them with a few quick pieces of software.

[ValcioDRG]

Are you trying to troll bait? Give this more than 1 minute of thought and you will realize this goes from pointless to an outright bad idea.

[G2G2G2G]

idiot

[admiralnelson]

spyware in MY stable diffusion? No, pal.

[alexgb0]

He warned us about people like you, man.

[drax-xard]

Don't feed the troll dummies.

[papuSpartan]

lol

[Kerikhan]

Please, don't. Literally the only images I'm generating are "photos of Edward Snowden nude and showing off his flat chest and cute tummy." I count 4 flagged terms right there. I can't help myself okay. He's just such a naughty little whistle blower...

Wait, will "whistle blower" be flagged? I use that one a lot too.

Notes: You should've called the extension unDeviant Art for extra lols.

[hoodady]

yeah sure what an idiot

[ice051128]

Stable Diffusion is extremely impressive but presents grave risks for out-of-scope use. Models and code for Stable Diffusion have spread far and wide and any member of the public is capable of generating dangerous images. The FBI has reported a 40% increase in images depicting child exploitation and theorizes this is a result of the widespread nature of Stable Diffusion[1].

I have created an extension that seeks to limit the harm done to children and other vulnerable classes through an innovative heuristic system. Automatic, can you include this in the extension index or maybe it can be merged into the WebUI?

https://github.com/Cyberes/automated-fbi-reporter

Here are some examples of a report:

The fbi source link just goes to some random wiki links bruh

[Nicoolodion]

The idea is good but I don't think that it will work... In the first picture I wouldn't see anything that would depict a child/loli (maybe I just haven't understood something.) In the second picture wouldn't I be too sure if "flat chest" means child/loli. I am a person who like small boobs and I defently dont like childs... cute also doesn't immediately mean child. Correct me if I just didn't understand how it works. Another thing, persons who want to generate such pictures defently wouldn't install that extension. And a person who didn't mean to create a child would never upload that picture to the internet.

[Nicoolodion]

Who is Edwart Snowden? What does he have to do with cp?

[acheong08]

Who is Edwart Snowden? What does he have to do with cp?

He leaked NSA documents. Nothing to do with cp. Some idiots in America think that the fact that he told people the US military was killing civilians caused ISIS to form...

[acheong08]

I support this. Lets flood the FBI with a few million false reports a day

[aliencaocao]

nsfw filter exists as an extension. As for FBI, you think people who actually want to abuse this tool will not know how to patch the code to turn off your reporter?

[acheong08]

It's always funny when people make stuff like this. Especially for open source software.

[Cookie2243]

The irony of using Edward Snowden in this as an example for spyware... can't tell if this is just trolling

[Nacurutu]

DONT FEED THIS TROOOOLLLLLLLL...!

Posts from this user should be closed. Troll bait everywhere...

Talking non-senses,

Look at this and his non-sense comments: #6394

Get a life @Cyberes and stop playing with something so delicated as Child Exploitation. You are the one who should be reported to the authorities. Child exploitation is not a fucking joke.