- cross-posted to:
- feminism@lemmy.ml
- cross-posted to:
- feminism@lemmy.ml
20 years after Mark Zuckerbergās infamous āhot-or-notā website, developers have learned absolutely nothing.
Two decades after Mark Zuckerberg created FaceMash, the infamously sexist āhot-or-notā website that served as the precursor to Facebook, a developer has had the bright idea to do the exact same thingāthis time with all the women generated by AI.
A new website, smashorpass.ai, feels like a sick parody of Zuckerbergās shameful beginnings, but is apparently meant as an earnest experiment exploring the capabilities of AI image recommendation. Just like Zuckās original site, āSmash or Passā shows images of women and invites users to rate them with a positive or negative response. The only difference is that all the āwomenā are actually AI generated images, and exhibit many of the telltale signs of the sexist bias common to image-based machine learning systems.
For starters, nearly all of the imaginary women generated by the site have cartoonishly large breasts, and their faces have an unsettling airbrushed quality that is typical of AI generators. Their figures are also often heavily outlined and contrasted with backgrounds, another dead giveaway for AI generated images depicting people. Even more disturbing, some of the images omit faces altogether, depicting headless feminine figures with enormous breasts.
According to the siteās novice developer, Emmet Halm, the site is a āgenerative AI party gameā that requires āno further explanation.ā
āYou know what to do, boys,ā Halm tweeted while introducing the project, inviting men to objectify the female form in a fun and novel way. His tweet debuting the website garnered over 500 retweets and 1,500 likes. In a follow-up tweet, he claimed that the top 3 images on the site all had roughly 16,000 āsmashes.ā
Understandably, AI experts find the project simultaneously horrifying and hilariously tonedeaf. āItās truly disheartening that in the 20 years since FaceMash was launched, technology is still seen as an acceptable way to objectify and gather clicks,ā Sasha Luccioni, an AI researcher at HuggingFace, told Motherboard after using the Smash or Pass website.
One developer, Rona Wang, responded by making a nearly identical parody website that rates menānot based on their looks, but how likely they are to be dangerous predators of women.
The sexist and racist biases exhibited by AI systems have been thoroughly documented, but that hasnāt stopped many AI developers from deploying apps that inherit those biases in new and often harmful ways. In some cases, developers espousing āanti-wokeā beliefs have treated bias against women and marginalized people as a feature of AI, and not a bug. With virtually no evidence, some conservative outrage jockeys have claimed the oppositeāthat AI is āwokeā because popular tools like ChatGPT wonāt say racial slurs.
The developerās initial claims about the siteās capabilities seem to be exaggerated. In a series of tweets, Halm claimed the project is a ārecursively self-improvingā image recommendation engine that uses the data collected from your clicks to determine your preference in AI-generated women. But the currently-existing version of the site doesnāt actually self-improveāusing the site long enough results in many of the images repeating, and Halm says the recursive capability will be added in a future version.
Itās also not gone over well with everyone on social media. One blue-check user responded, āBro wtf is this. The concept of finetuning your aesthetic GenAI image tool is cool but you definitely could have done it with literally any other category to prove the concept, like food, interior design, landscapes, etc.ā
Halm could not be reached for comment.
āIām in the arena trying stuff,ā Halm tweeted. āSome ideas just need to exist.ā
Luccioni points out that no, they absolutely do not.
āThere are huge amounts of nonhuman data that is available and this tool could have been used to generate images of cars, kittens, or plantsāand yet we see machine-generated images of women with big breasts,ā said Luccioni. āAs a woman working in the male-dominated field of AI, this really saddens me.ā
Wait, are you implying that in order for this app to be sexist, the very act of depicting a female individual would have to be a sexist act in and of itself?
Because I donāt think the author of the article is arguing that, nor anyone in here.
no, not at all. but the other person who was arguing me seemed to be saying that they thought I was wrong for saying an ai generated image of a black person wouldnāt automatically be racist.
this app isnāt sexist because it generates images of women, itās sexist (or not, since thatās whatās being debated) because it lets men (people) rate them, and perhaps because it seems to generate female images that overemphasise features that are considered to appeal to the male gaze.
personally, Iām unsure if I consider this app sexist. i would say that rating real women this way definitely is, but is it sexist to ask (your audience, or viewers) if a painting of a woman is attractive? even if itās of a fictional woman? what if the intent is to appeal to people who are axially attracted to women? thereās a lot of pornographic art out there, is it sexist to make these images?
the sexist part here, if anything, seems to be giving people the opportunity to rate the fictional women, and as i said, I think it is sexist to do that to real people, so even if this app isnāt sexist per se, Iād still consider it bad if it encourages people to do that to actual women. but if people only behave that way in the context of the app, then I think itās at worst harmless and possibly even beneficial, if it gives a harmless outlet for some urge which would otherwise be inflicted on real women.
I donāt think this situation is nearly as clear cut as most people seem to be taking it to be, in either direction.
I see what youāre saying. I think a better example to test what you are saying about real vs imaginary people would be if there was a realistic app where you whipped AI generated black people with a virtual whip and made them dance for watermelon.
Would that app be non racist simply because the depicted people are not real?
Would making the app/using the app be non-racist?
Note Iām not trying to say whipping people is equivalent to rating their looks. Obviously itās not. Iām just making a thought experiment to unpack this idea that imaginary interactions canāt be -ist.
oh, iām not denying in the slightest that interactions with imaginary people can still be racist, sexist, whatever. even if you were rating AI generated people of colour according to their looks, or probably nearly any other criteria, that could very well be racist.
In regards to the original topic, I just think thereās too much to unpack to give an easy verdict of sexist or not, at least for myself. But, i donāt know, if it were an app that rewarded you for discriminating (or abusing, definitely) someone, even an entirely fictional person, that would definitely be sexist, or racist, or whatever else.