• @tal
    link
    17 months ago

    There are some external GPUs that can be USB-attached. Dunno about for the Mac. Latency hit, but probably not as significant for current LLM use than games, as you don’t have a lot of data being pushed over the bus once the model is up.