• Sunshine@piefed.caOP
    link
    fedilink
    English
    arrow-up
    26
    ·
    5 days ago

    I see a few mentions of Lemmy in the comments. C’mon folks help these people.

  • Riskable@programming.dev
    link
    fedilink
    English
    arrow-up
    20
    ·
    5 days ago

    So let me get this straight: Instead of wasting Reddit’s bandwidth, AI companies have been scraping the wayback machine.

    Because of this, Reddit is going to block the wayback machine from crawling it’s site which will ensure the AI companies crawl Reddit, directly.

    …Because if you think they’re suddenly going to stop crawling reddit—robots.txt be damned—you’re dreaming.

  • Sergio@lemmy.world
    link
    fedilink
    English
    arrow-up
    6
    ·
    5 days ago

    Reddit has a recent history of cutting off access to scraper tools as AI companies have begun to use (and abuse) them en masse, but it’s willing to provide that data if companies pay.

    There it is. People who post/comment/vote on reddit are creating monetizable resources for Reddit. ofc Reddit doesn’t want to give it away for free, they want to get PAID. Hey, maybe some of it will “trickle down” to the Worker Snoos.