Moore’s law was about number of transistors, not number of operations per second. Am I missing something? (Edit: the FP8, FP4 comparison to FP16 is indeed suspicious to begin with)
With the power of AIs and LLMs, the number of marketing lies we produce every year can outpace Moore’s Law! Yippeeee!
Sir! That graph with ‘number go up’ has been completed! We’ll have another on your desk first thing in the morning.
I was confused as well. I mean, I always end up with the same joke when I think about Moore’s Law: Why don’t we make room sized computers again just to fit even more transistors in the parts? You could play everything maxed out, at 8k, and get infinite fps with a machine that powerful!
What a weird graph. Not only can’t you compare FP16/8/4 performance but also the newer Nvidia chips are plain larger and have a higher TDP.
I remember thinking my EVGA GTX 780 TI was a beast, and that combined with a PS4, I had it all. Shiiiiiiiiiiiiiit. Now it’s like, “Mah name Jeff.”