I explicitly moved off my one foray into Nvidia-land, went AMD due to better Linux support, but I have to say that I’m pretty sure that AMD still doesn’t have transformers support. Most of the LLM software I’ve used doesn’t require it, but some does, like tortoise-tts.
If I expected to be doing a bunch of LLM work with it, I’d probably be careful to make sure that whatever I intend to use will run on AMD hardware.
I explicitly moved off my one foray into Nvidia-land, went AMD due to better Linux support, but I have to say that I’m pretty sure that AMD still doesn’t have transformers support. Most of the LLM software I’ve used doesn’t require it, but some does, like tortoise-tts.
If I expected to be doing a bunch of LLM work with it, I’d probably be careful to make sure that whatever I intend to use will run on AMD hardware.
Which GPU do you have? I have an RX 6900 XT and pytorch and therefore also transformers work.