• tal
    link
    fedilink
    English
    arrow-up
    5
    ·
    edit-2
    4 months ago

    Well, it says 100k H100s.

    Looks like an H100 is 700W.

    looks at WP’s table of the TOP500 list of supercomputers

    https://en.wikipedia.org/wiki/TOP500

    The top entry there – has, as accelerator cards, 36,992 MI250Xs, which are apparently 500W each.

    It’s the highest compute card count other than one using Intel Max 1550s, which has 63,744 cards, which are 600W each.

    I’m not sure that the TOP500 is necessarily the best ranking here, since I don’t know if it’s the best metric for GPU-style compute, and the CPUs are also a factor. But at least going off what he’s saying, it’d probably rank above those for GPU power consumption (and compute capacity).