• kattenluik@feddit.nl
    link
    fedilink
    arrow-up
    13
    ·
    1 year ago

    CPUs can have special hardware accelerators for stuff like this, and you’d be surprised how powerful our little phone CPUs are and how optimized stuff like this can become.

    • PhobosAnomaly@feddit.uk
      link
      fedilink
      arrow-up
      8
      ·
      1 year ago

      Awesome, thanks for the insight.

      I’m showing my age here, but much like we had math coprocessors running beside the 286 and 386 gen CPUs to take on floating point operations; then graphics cards offloaded geometry-based math operations to GPU’s - are we looking at AI-style die or chips to specifically work on AI functions?

      Excuse my oversimplification, this isn’t my field of expertise!

      • Kevin Herrera@beehaw.org
        link
        fedilink
        English
        arrow-up
        5
        ·
        1 year ago

        Apple added (a while back) what they call a “Neural Engine,” which is hardware dedicated to efficient execution of ML workloads.

        https://en.m.wikipedia.org/wiki/Apple_A11

        They have been refining it ever since. I would not be surprised if they made advancements in both the hardware and software used for local GAI.

      • conciselyverbose@kbin.social
        link
        fedilink
        arrow-up
        5
        ·
        1 year ago

        They already have dedicated hardware they call the neural engine, and use for coreML, ARKit, some of the magic they do to turn terrible sensors and lenses into passable images, etc. There’s a lot of processing that already happens on your device. Being able to search your images by subject might be something Google does too, but Apple does it locally.

        So my guess is they’ll just adjust the architecture of the neural engine to accommodate any new requirements, rather than adding a “new core”. But it’s kind of all semantics. There will be new hardware components and intercommunication at a low level.

      • terminhell@lemmy.dbzer0.com
        link
        fedilink
        arrow-up
        5
        ·
        1 year ago

        Well, your not too off. Like ASICs are made for mining cryptocurrency. Specialized processing designed for specific computations. This indeed make it’s efficiency greater than a general purpose CPU.

      • beefcat@beehaw.org
        link
        fedilink
        arrow-up
        1
        ·
        1 year ago

        not a dedicated chip per se, the trend is to build it directly into the SoC (mobile devices) or the dedicated GPU

    • verysoft@kbin.social
      link
      fedilink
      arrow-up
      5
      ·
      edit-2
      1 year ago

      Yup, technology and especially phones have come a disgustingly long way in such a short amount of time. Running AI efficiently on them is the next step, one that we probably won’t struggle with too much.