Not a good look for Mastodon - what can be done to automate the removal of CSAM?

  • Reddit_was_fun@lemmy.world
    link
    fedilink
    arrow-up
    8
    ·
    edit-2
    1 year ago

    The article points out that the strength of the Fediverse is also it’s downside. Federated moderation makes it challenging to consistently moderate CSAM.

    We have seen it even here with the challenges of Lemmynsfw. In fact they have taken a stance that CSAM like images with of age models made to look underage is fine as long as there is some dodgy ‘age verification’

    The idea is that abusive instances would get defederated, but I think we are going to find that inadequate to keep up without some sort of centralized reporting escalation and ai auto screening.

    • rodneylives@kbin.social
      link
      fedilink
      arrow-up
      15
      ·
      1 year ago

      The problem with screening by AI is there’s going to be false positives, and it’s going to be extremely challenging and frustrating to fight them. Last month I got a letter for a speeding infraction that was automated: it was generated by a camera, the plate read in by OCR, the letter I received (from “Seat Pleasant, Maryland,” lol) was supposedly signed off by a human police officer, but the image was so blurry that the plate was practically unreadable. Which is what happened: it got one of the letters wrong, and I got a speeding ticket from a town I’ve never been to, had never even heard of before I got that letter. And the letter was full of helpful ways to pay for and dispense with the ticket, but to challenge it I had to do it it writing, there was no email address anywhere in the letter. I had to go to their website and sift through dozens of pages to find one that had any chance of being able to do something about it, and I made a couple of false steps along the way. THEN, after calling them up and explaining the situation, they apologized and said they’d dismiss the charge–which they failed to do, I got another letter about it just TODAY saying a late fee had now been tacked on.

      And this was mere OCR, which has been in use for multiple decades and is fairly stable now. This pleasant process is coming to anything involving AI as a judging mechanism.

      • CaptObvious@lemmy.world
        link
        fedilink
        arrow-up
        8
        ·
        1 year ago

        Off topic, but a few years ago a town in Tennessee had their speed camera contractor screw up in this way. Unfortunately for them, they tagged an elderly couple whose son was a very good attorney. He sued the town for enough winnable civil liability to bankrupt them and force them to disincorporate.

        Speed cameras are all but completely illegal in TN now.

        • Madison_rogue@kbin.social
          link
          fedilink
          arrow-up
          6
          ·
          edit-2
          1 year ago

          When I lived in Clarksville, they had intersection cameras to ticket anyone that ran a red light. Couple problems with it.

          1. Drivers started slamming on their brakes; causing more accidents
          2. The city outsourced the cameras, so they received only pennies on the dollar for every ticket.

          I think they eventually removed them, but I can’t recall. I visited last September to take a class for work, and I didn’t see any cameras, so they might be gone.

          • CaptObvious@lemmy.world
            link
            fedilink
            arrow-up
            3
            ·
            1 year ago

            Dresden’s House rep got a bill passed several years ago to outlaw them. The Australian vendor’s lobbyists managed to get a carve out for school zones and blind curves, but I haven’t even seen any of those in years.

            • Madison_rogue@kbin.social
              link
              fedilink
              arrow-up
              3
              ·
              1 year ago

              Wait…so the company that supplied the cameras wasn’t even from the U.S.?

              Wow…this just gets more insane the more I learn about it. As conservative as Tennessee can be, they first outsourced their law enforcement for a return of pennies on the dollar to the city, AND the taxpayers ended up subsidizing a foreign company.

      • mothringer@lemmy.world
        link
        fedilink
        arrow-up
        7
        ·
        edit-2
        1 year ago

        THEN, after calling them up and explaining the situation, they apologized and said they’d dismiss the charge–which they failed to do

        That sounds about right. When I was in college I got a speeding ticket halfway in between the college town and the city my parents lived in. Couldn’t afford the fine due to being a poor college student, and called the court and asked if an extension was possible. They told me absolutely, how long do you need, and then I started saving up. Shortly before I had enough, I got a call from my Mom that she had received a letter saying there was a bench warrant for my arrest over the fine