Google's video-synthesis model creates minute-long 1080p videos from written prompts.

On Tuesday at Google I/O 2024, Google announced Veo, a new AI video-synthesis model that can create HD videos from text, image, or video prompts, similar to OpenAI’s Sora. It can generate 1080p videos lasting over a minute and edit videos from written instructions, but it has not yet been released for broad use.

    • @Grimy@lemmy.worldEnglish
      0•1 month ago

      Why not?

      I want to have fun generating my own shows and movies eventually. Just for my own fun. You can literally just not use it.

      • JackGreenEarthEnglish
        2•1 month ago

        That means not open, right? I’m only interested once the first good opens Circe video generator is released, more closed source ones aren’t interesting, once I heard about the first.

  • RubberDuckEnglish
    6•1 month ago

    Until they sunset it. No use getting invested in new Google products anyway.

  • @deathmetal27@lemmy.worldEnglish
    4•1 month ago

    After reading the wheresyouredat article I don’t have much faith in this one either for any serious work. It’s a curiosity at best.

  • AutoTL;DRBEnglish
    2•1 month ago

    This is the best summary I could come up with:

    Veo’s example videos include a cowboy riding a horse, a fast-tracking shot down a suburban street, kebabs roasting on a grill, a time-lapse of a sunflower opening, and more.

    Conspicuously absent are any detailed depictions of humans, which have historically been tricky for AI image and video models to generate without obvious deformations.

    Google says that Veo builds upon the company’s previous video-generation models, including Generative Query Network (GQN), DVD-GAN, Imagen-Video, Phenaki, WALT, VideoPoet, and Lumiere.

    While the demos seem impressive at first glance (especially compared to Will Smith eating spaghetti), Google acknowledges AI video-generation is difficult.

    But the company is confident enough in the model that it is working with actor Donald Glover and his studio, Gilga, to create an AI-generated demonstration film that will debut soon.

    Initially, Veo will be accessible to select creators through VideoFX, a new experimental tool available on Google’s AI Test Kitchen website, labs.google.

    The original article contains 701 words, the summary contains 150 words. Saved 79%. I’m a bot and I’m open source!

  • @mindbleach@sh.itjust.worksEnglish
    1•1 month ago

    it can generate 1080p videos lasting over a minute

    Any length limit is a sign you’re doing it wrong. You don’t need every single frame in-memory at the same time to figure out what any specific frame should look like. Local frames matter for fine changes. Further frames matter for continued movement. Distant frames matter for continuity. It should be possible to scan across an arbitrarily long sequence and gradually remove its flaws.

    … though admittedly once you get to about five minutes, you’ve covered nearly one hundred percent of all shots in film and television. One minute is already long enough for a human editor to work with. (And evidently people hate the idea of a robot churning out a whole finished product, cuts and all.) But if the network only need a few seconds at a time, it’ll be faster to train and easier to run.