Instagram is profiting from several ads that invite people to create nonconsensual nude images with AI image generation apps, once again showing that some of the most harmful applications of AI tools are not hidden on the dark corners of the internet, but are actively promoted to users by social media companies unable or unwilling to enforce their policies about who can buy ads on their platforms.

While parent company Meta’s Ad Library, which archives ads on its platforms, who paid for them, and where and when they were posted, shows that the company has taken down several of these ads previously, many ads that explicitly invited users to create nudes and some ad buyers were up until I reached out to Meta for comment. Some of these ads were for the best known nonconsensual “undress” or “nudify” services on the internet.

  • exanime
    link
    fedilink
    English
    arrow-up
    115
    arrow-down
    14
    ·
    edit-2
    7 months ago

    And yet, people are still scorned and offended as if they were.

    I think you are missing the plot here… If a naked pic of yourself, your mother, your wife, your daughter is circulating around the campus, work or just online… Are you really going to be like “lol my nipples are lighter and they don’t know” ??

    You may not get that job, promotion, entry into program, etc. The harm done by naked pics in public would just as real weather the representation is accurate or not … And that’s not even starting to talk about the violation of privacy and overall creepiness of whatever people will do with that pic of your daughter out there

    • 🔍🦘🛎@lemmy.world
      link
      fedilink
      English
      arrow-up
      46
      arrow-down
      4
      ·
      7 months ago

      I believe their point is that an employer logically shouldn’t care if some third party fabricates an image resembling you. We still have an issue with latent puritanism, and this needs to be addressed as we face the reality of more and more convincing fakes of images, audio, and video.

      • exanime
        link
        fedilink
        English
        arrow-up
        28
        arrow-down
        7
        ·
        7 months ago

        I agree… however, we live in the world we live in, where employers do discriminate as much as they can before getting in trouble with the law

        • 🔍🦘🛎@lemmy.world
          link
          fedilink
          English
          arrow-up
          18
          arrow-down
          3
          ·
          7 months ago

          I think the only thing we can do is to help out by calling this out. AI fakes are just advanced gossip, and people need to realize that.

          • TwilightVulpine@lemmy.world
            link
            fedilink
            English
            arrow-up
            10
            arrow-down
            7
            ·
            7 months ago

            But it doesn’t. Nobody who is harassed or has their prospects undermined because of AI fakes is helped by repeating that. Especially because as the technology advances the only way to verify its legitimacy will be to compare it with real intimate pictures, which the person cannot show without being exposed to the exact same treatment.

            It also doesn’t help that gossip can do all that harm as well so the point is moot.

            Trying to point out that this is illogical and that nudes shouldn’t even be such a big deal is an uphill battle against human emotional, social and cultural tendencies. It would take much more than some offhand comments to affect it at all, and I wouldn’t count on that shift happening before the harms of AI fakes spread.

            • 🔍🦘🛎@lemmy.world
              link
              fedilink
              English
              arrow-up
              5
              ·
              7 months ago

              The ubiquity of AI fakes will necessitate a cultural shift. Honestly, the world is going to be a nightmare of misinformation soon and nudes may very well be the least of our worries.

              What other options do we have? An ironclad verification system for any fabricated content? Wildly harsh penalties for all caught creating it? The ship has sailed - we won’t be able to prevent it from happening.

              I’d argue that overexposure will make people quickly become accustomed/nonplussed at information we don’t believe to be true and verify with the source. Look at how we treat other fabricated content - if I showed you a screencap of the Pope saying “Fuck” you’d want to verify with a source directly.

              • TwilightVulpine@lemmy.world
                link
                fedilink
                English
                arrow-up
                3
                ·
                7 months ago

                Does it seem to you that people are becoming more likely to verify sources?

                Nevermind, like I just said before, how exactly do you verify fake porn with the source? Who is going to be volunteering their intimate pictures as reference? Or, do you really think all that it takes to avoid all issues is for the victim to say “that’s fake, it’s not me”?

                Frankly, that sounds like pure wishful thinking to me.

                • 🔍🦘🛎@lemmy.world
                  link
                  fedilink
                  English
                  arrow-up
                  4
                  ·
                  7 months ago

                  In most cases, the answer should really be “It’s none of my business”, but yes, it’d involve asking the person whether they’re authentic if you needed to verify for some reason.

                  But yes it really is wishful thinking, because it’s honestly about to be a shitshow. People are going to start getting credibly framed for things like child porn.

        • Drewelite@lemmynsfw.com
          link
          fedilink
          English
          arrow-up
          10
          arrow-down
          2
          ·
          edit-2
          7 months ago

          Well I think the whole point of this post is that the world is changing towards this being the norm. If an employer says they’re not hiring me because of a nude photo, I’m just going to post 500 nudes of them and ask how they feel about it now 😂

          • exanime
            link
            fedilink
            English
            arrow-up
            5
            ·
            7 months ago

            It’s a race to the bottom then ;-)

          • psud@lemmy.world
            link
            fedilink
            English
            arrow-up
            5
            arrow-down
            1
            ·
            7 months ago

            This might even provide cover for those with real nude photos circulating

    • Thorny_Insight@lemm.ee
      link
      fedilink
      English
      arrow-up
      31
      arrow-down
      11
      ·
      7 months ago

      This is a transitional period issue. In a couple of years you can just say AI made it even if it’s a real picture and everyone will believe you. Fake nudes are in no way a new thing anyway. I used to make dozens of these by request back in my edgy 4chan times 15 years ago.

      • Duamerthrax@lemmy.world
        link
        fedilink
        English
        arrow-up
        20
        arrow-down
        1
        ·
        edit-2
        7 months ago

        Dead internet.

        It also means in a few years, any terrible thing someone does will just be excused as a “deep fake” if you have the resources and any terrible thing someone wants to pin on you with be cooked up in seconds. People wont just blanket believe or disbelieve any possible deep fake. They’ll cherry pick what to believe based on their preexisting world view and how confident the story telling comes across.

        As far as your old edits go, if they’re anything like the ones I saw, they were terrible and not believable at all.

        • TangledHyphae@lemmy.world
          link
          fedilink
          English
          arrow-up
          9
          ·
          7 months ago

          I’m still on the google prompt bandwagon of typing this query:

          stuff i am searching for before:2023… or ideally, even before COVID19, if you want more valuable, less tainted results. It’s only going to get worse from here, 2024 is the year of saturation with garbage data on the web (yes I know it was already bad before, but now AI is pumping this shit out at an industrial scale.)

        • CaptainEffort@sh.itjust.works
          link
          fedilink
          English
          arrow-up
          3
          ·
          7 months ago

          People do that now, even without the excuses of ai deepfakes. They simply ignore the stuff that doesn’t fit their worldview, only focusing on what does.

          Ai stuff may make that easier, but it certainly won’t be some new problem.

      • exanime
        link
        fedilink
        English
        arrow-up
        23
        arrow-down
        4
        ·
        7 months ago

        This is a transitional period issue. In a couple of years you can just say AI made it even if it’s a real picture and everyone will believe you.

        Sure, but the question of whether they harm the victim is still real… if your prospective employer finds tons of pics of you with nazi flags, guns and drugs… they may just “play it safe” and pass on you… no matter how much you claim (or even the employer might think) they are fakes

    • Panda (he/him)@lemmy.dbzer0.com
      link
      fedilink
      English
      arrow-up
      10
      ·
      7 months ago

      “Fools! Everybody at my school is laughing at me for having a 2-incher, but little do they know it actually curves to the LEFT!”

    • ඞmir@lemmy.ml
      link
      fedilink
      English
      arrow-up
      21
      arrow-down
      18
      ·
      7 months ago

      On the other end, I welcome the widespread creation of these of EVERYONE, so that it becomes impossible for them to be believable. No one should be refused from a job/promotion because of the existence of a real one IMO and this will give plausible deniability.

      • exanime
        link
        fedilink
        English
        arrow-up
        33
        arrow-down
        8
        ·
        7 months ago

        People are refused for jobs/promotions on the most arbitrary basis, often against existing laws but they are impossible to enforce.

        Even if it is normalized, there is always the escalation factor… sure, nobody won’t hire Anita because of her nudes out there, everyone has them and they are probably fake right?.. but Perdita? hmmm I don’t want my law firm associated in any way with her pics of tentacle porn, that’s just too much!

        Making sure we are all in the gutter is not really a good way to deal with this issue… specially since it will, once again, impact women 100x more than it will affect men

        • TwilightVulpine@lemmy.world
          link
          fedilink
          English
          arrow-up
          9
          arrow-down
          2
          ·
          7 months ago

          This is a consideration that a lot of people are glossing over. Schlubby dudes might not even be affected to it at all. It’s not going to be widespread for everyone.

        • ipkpjersi@lemmy.ml
          link
          fedilink
          English
          arrow-up
          2
          arrow-down
          1
          ·
          7 months ago

          How should we deal with this issue then? I’m not sure what can be done about it.

          • exanime
            link
            fedilink
            English
            arrow-up
            5
            arrow-down
            1
            ·
            7 months ago

            That’s a good question… I’m not an expert in this area but I do think it should be criminalized to a certain extent (even if it’s hard to enforce)

            Probably legislation should out some onus on the makers of these tools as well

      • BreakDecks@lemmy.ml
        link
        fedilink
        English
        arrow-up
        1
        arrow-down
        1
        ·
        7 months ago

        Yeah, let’s just sexually violate everyone. /s

        Who the hell is upvoting this awful take? Please understand that it would never be equitable. If this became reality, it would be women and girls that were exploited the most viciously.

        I guess if you don’t give a shit about people, especially women and girls, feeling safe in public at all, you would say something like this…

        • ඞmir@lemmy.ml
          link
          fedilink
          English
          arrow-up
          1
          arrow-down
          1
          ·
          7 months ago

          It’s already possible. Do you want to make it punishable by jail time? How do you prove some anon on 4chan that posts nudes of someone else actually deepfaked it?

          I don’t see how this can otherwise be contained.

          • BreakDecks@lemmy.ml
            link
            fedilink
            English
            arrow-up
            1
            arrow-down
            1
            ·
            7 months ago

            Do you want to make it punishable by jail time?

            Yes, sex crimes deserve harsh punishments.

            How do you prove some anon on 4chan that posts nudes of someone else actually deepfaked it?

            It’s either deepfaked, or revenge porn. Whichever charge sticks. If 4chan refuses to unmask anons posting illegal content, throw the book at 4chan. Way overdue anyway.

            I don’t see how this can otherwise be contained.

            See previous two answers.

            • ඞmir@lemmy.ml
              link
              fedilink
              English
              arrow-up
              1
              arrow-down
              1
              ·
              edit-2
              7 months ago

              Okay if you want to make everything punishable by law then we simply fundamentally disagree.

            • ඞmir@lemmy.ml
              link
              fedilink
              English
              arrow-up
              1
              arrow-down
              1
              ·
              edit-2
              7 months ago

              Okay if you want to make everything punishable by law then we simply fundamentally disagree.