Attention @black_in_ai, @TaelurAlexis, @ModFigsPodcast.
---
RT @osazuwa
An image of @BarackObama getting upsampled into a white guy is floating around because it illustrates racial bias in #MachineLearning. Just in case you think it isn't real, it is, I got the code working locally. Here is me, and here is @AOC.
twitter.com/osazuwa/status/127

Follow

@peterdrake This entire thread is quite fascinating, I highly recommend reading it.

· · Web · 1 · 0 · 0
@realcaseyrollins @peterdrake most neural networks that process the photos of real people can't work with anyone who is not an european and who wear glasses. It just messes up with NN which never seen that or not trained enough.

I'm not a scientist but I'm not sure how this can be solved technically. But I guess it would an interesting and game changing paper if somebody started to research this.

@a1batross @peterdrake Hmm, that kinda makes sense. I do also wonder how much is just due to these models not being trained on as many non-whites in the first place

@realcaseyrollins @peterdrake as an asian, I also have this question.

These NNs just never work on my photos.
@abloo @peterdrake @realcaseyrollins I don't know if it was the NN or not but the banking software asked my dad about his photo to process it and remember how he looks like.

And you know what? It just couldn't see his face. He have normal face actually, no injures or like that. He is just 60 year old mongolian men.

That software was developed for some Kazakhstan bank and that's really weird it wasn't tested for it's first nation.

@death @a1batross @peterdrake You sure about this?

Someone should make a NN trained on all blacks and see how it works with whites, this would prove you right or wrong

@realcaseyrollins @a1batross @peterdrake

I am very sure that this gimmick of machine learning has zero real implications about race, and only idiots that want to seem relevant are presenting it as such, but you're welcome to think whatever you want.
@realcaseyrollins @a1batross @peterdrake

Does it hate Jews? Where did her nose go? Oh my god, anti-Semite AI is at it again... nevermind, it turns out that pixelation is a lossy transformation. False alarm.

@death @a1batross @peterdrake Haha well this goes right to my point...AIs aren't racist, you just gotta send it the right data

@blight @peterdrake @a1batross Not a particularly far-fetched claim but I find it more likely that it's not being fed enough non-white faces tbh

Says more about the devs than the racism of the AIs lol

@blight @peterdrake @realcaseyrollins I doubt it's racist but yes, we all look different and NNs just can't remember it yet. Or they wasn't trained for that.

Luckily, all NN stuff is mostly at research level. It would a lot funnier to see when corporations will not train their AI on all kind of people: black, mongolian, australian and so on. That would be a nice chance to call them on court.
@realcaseyrollins @blight @peterdrake why tf not?

I mean, someone should have a responsibility on AI. How can you scare the computer? Delete the model? I doubt it's trained to care.

@a1batross @blight @peterdrake I would love to see this happen. somebody is sure to be this irresponsible with their AI

@realcaseyrollins @blight @peterdrake remember the Microsoft's chat bot that was trained by reading Twitter that "Hitler was right"?

Yeah, I imagine something like this but when it will be sold to people and will affect their reputation.

@a1batross @blight @peterdrake Haha well I am proud to say that my bot @notcaseyrollins hasn't said anything racist, although @CvcvcvEbooks certainly does

so it's definitely all in the data

Potentially NSFW 

@realcaseyrollins I never called you far left. I also enjoyed the Rule of Four series.

@realcaseyrollins @blight @peterdrake @notcaseyrollins @CvcvcvEbooks it's __only__ data.
The current state of AI is really primitive and not nearly close to what's written in books.

The NNs are not new either. They are just trending now and we also have enough computing power to literally throw them into a wall and see what sticks.

Potentially NSFW 

@a1batross Both are wrong. #Trump's military advisers says we still have my main freeze on my PC either. Times out.

@blight @a1batross @realcaseyrollins

Not in the sense of "the AI has beliefs about white supremacy", but yes in the sense that AI systems can be used to deliberately or accidentally perpetuate racism (also sexism, ableism, etc.). The books "Weapons of Math Destruction" and "Technically Wrong" enumerate many examples.

One small example is the "racist soap dispenser", which astonishingly has been developed more than once:

youtube.com/watch?v=YJjv_OeiHm

youtube.com/watch?v=WHynGQ9Vg3

There's no reason to believe that a person (or AI) *decided* to behave this way. It's much more likely that the development team and the training data were both devoid of dark skin.

Sign in to participate in the conversation
Game Liberty Mastodon

Mainly gaming/nerd instance for people who value free speech. Everyone is welcome.