• brucethemoose@lemmy.world
    link
    fedilink
    English
    arrow-up
    35
    ·
    edit-2
    1 day ago

    It’s literally impossible. I tried to explain it here: https://lemmy.world/comment/14763233

    But the short version is OpenAI doesn’t even offer access to the data you need for a “distillation,” as the term is used in the LLM community.

    Of course there’s some OpenAI data in the base model, but that’s partially because it’s splattered all over the internet now.