I kind of want to go for the framework laptop, but I still do like ARM and given I want to do more stuff around machine learning in the future, which is already kind of difficult to run large language models with only 8 gigabytes of RAM, it at least kind of runs with ARM. On my basement PC, It will barely do anything
There are some external GPUs that can be USB-attached. Dunno about for the Mac. Latency hit, but probably not as significant for current LLM use than games, as you don’t have a lot of data being pushed over the bus once the model is up.
I kind of want to go for the framework laptop, but I still do like ARM and given I want to do more stuff around machine learning in the future, which is already kind of difficult to run large language models with only 8 gigabytes of RAM, it at least kind of runs with ARM. On my basement PC, It will barely do anything
There are some external GPUs that can be USB-attached. Dunno about for the Mac. Latency hit, but probably not as significant for current LLM use than games, as you don’t have a lot of data being pushed over the bus once the model is up.
Those don’t work on Apple silicon Macs. sadly