Running AI models without matrix math means far less power consumption—and fewer GPUs?

Running AI models without matrix math means far less power consumption—and fewer GPUs?

  • Pennomi@lemmy.worldEnglish
    2·
    5 months ago

    Only for maximum efficiency. LLMs already run tolerably well on normal CPUs and this technique would make it much more efficient there as well.