for AI inference (generally hardware agnostic, which is different than AI training, which is heavily CUDA based) favors vram. Digits has to compete against both apples m series chips at max ram capacity, as well as the recently announced AMD Strix Halo devices, which come with up to 128 GB shared ram.
A fully kitted out Strix Halo device with 128gb ram is 2000$, a fully kitted out Mac Studio with 128GB ram is just under 5000$. Nvidia claims it starts at 3000$, so finding out the 128gb cost is still in the air.
for AI inference (generally hardware agnostic, which is different than AI training, which is heavily CUDA based) favors vram. Digits has to compete against both apples m series chips at max ram capacity, as well as the recently announced AMD Strix Halo devices, which come with up to 128 GB shared ram.
A fully kitted out Strix Halo device with 128gb ram is 2000$, a fully kitted out Mac Studio with 128GB ram is just under 5000$. Nvidia claims it starts at 3000$, so finding out the 128gb cost is still in the air.