It depends on your definition of “usually”, high end GPUs for data centers, AI, workstations or “enthusiasts” yea. For these applications you’re starting at like 16
It’s also fairly cheap to buy 32+ GB of RAM, lots of choices for under $80. Meanwhile, I’m not even sure how you find a video card with 32GB of VRAM (not that you really need this much, 12GB and 16GB are pretty solid for a video card nowadays).
Afaik for consumers only the 5090 has 32GB VRAM. So you’re correct, practically impossible to find. And even if you find it, prone to spontaneous combustion.
For servers, it tops out at 288GB currently, with the AMD Mi355X.
And they cost more than a high end PC. I’m not spending $3k on a card that can go up in smoke. Not to mention all of the honest reviewers I’ve seen say it’s performance improvements are all smoke and mirrors.
Only if you don’t count Apple Silicon with its shared RAM/VRAM. Ironically a Mac Mini / Studio is currently the cheapest way to get a GPU with lots of vram for AI
Tbf, we should be starting with 16GB for gaming GPUs too, especially for those prices. But … NVidia.
But yeah, modern HPC Processors have at least 48GB or so. And max. is the AMD Mi355X with 288GB VRAM afaik. Which is actually less than my servers RAM, ha! But also probably like a thousand times fasted, considering my RAM runs at 1600 MT/s.
It depends on your definition of “usually”, high end GPUs for data centers, AI, workstations or “enthusiasts” yea. For these applications you’re starting at like 16
GPUs for us plebs, no
It’s also fairly cheap to buy 32+ GB of RAM, lots of choices for under $80. Meanwhile, I’m not even sure how you find a video card with 32GB of VRAM (not that you really need this much, 12GB and 16GB are pretty solid for a video card nowadays).
https://www.nvidia.com/en-us/design-visualization/rtx-a6000/
48GB, so not enough. I want the A100 80GB.
https://www.horizoniq.com/blog/nvidia-a100-specs/
Afaik for consumers only the 5090 has 32GB VRAM. So you’re correct, practically impossible to find. And even if you find it, prone to spontaneous combustion.
For servers, it tops out at 288GB currently, with the AMD Mi355X.
And they cost more than a high end PC. I’m not spending $3k on a card that can go up in smoke. Not to mention all of the honest reviewers I’ve seen say it’s performance improvements are all smoke and mirrors.
Only if you don’t count Apple Silicon with its shared RAM/VRAM. Ironically a Mac Mini / Studio is currently the cheapest way to get a GPU with lots of vram for AI
Tbf, we should be starting with 16GB for gaming GPUs too, especially for those prices. But … NVidia.
But yeah, modern HPC Processors have at least 48GB or so. And max. is the AMD Mi355X with 288GB VRAM afaik. Which is actually less than my servers RAM, ha! But also probably like a thousand times fasted, considering my RAM runs at 1600 MT/s.
I’m seeing games today regularly hitting 11 GB, and that’s without raytracing or frame generation which require more VRAM.
The new 8GB GPU Nvidia just launched is a trap. It exists to trick people into buying a GPU that they’ll need to upgrade next year.