Hacker News with Generative AI: Video Generation

Fast Video Generation with Sliding Tile Attention (hao-ai-lab.github.io)
TL;DR: Video generation with DiTs is painfully slow – HunyuanVideo takes 16 minutes to generate just a 5-second video on an H100 with FlashAttention3. Our sliding tile attention (STA) slashes this to 5 minutes with zero quality loss, no extra training required. Specifically, STA accelerates attention alone by 2.8–17x over FlashAttention-2 and 1.6–10x over FlashAttention-3.

Video Generation, Artificial Intelligence, Computer Vision, Optimization, Performance

12 points by zhisbug 2 days ago | 2 comments

Goku Flow Based Video Generative Foundation Models (github.com/Saiyan-World)
Goku is a new family of joint image-and-video generation models based on rectified flow Transformers.

Generative AI, Video Generation, Deep Learning, Transformers

34 points by lastdong 9 days ago | 11 comments

VideoJAM: Joint Appearance-Motion Representations for Enhanced Motion Generation (hila-chefer.github.io)
Despite tremendous recent progress, generative video models still struggle to capture real-world motion, dynamics, and physics.

Video Generation, Computer Vision, Artificial Intelligence, Machine Learning

8 points by geox 14 days ago | 0 comments

Veo 2: Our video generation model (deepmind.google)
Veo creates videos with realistic motion and high quality output, up to 4K. Explore different styles and find your own with extensive camera controls.

Video Generation, Artificial Intelligence, Deep Learning, Google, Computer Vision

587 points by mvoodarla 66 days ago | 327 comments

Veo and Imagen 3: Announcing new video and image generation models on Vertex AI (cloud.google.com)
Generative AI is leading to real business growth and transformation. Among enterprise companies with gen AI in production, 86% report an increase in revenue1, with an estimated 6% growth. That’s why Google is investing in its AI technology with new models like Veo, our most advanced video generation model, and Imagen 3, our highest quality image generation model.

Generative AI, Google Cloud, Video Generation, Image Generation

30 points by srameshc 78 days ago | 15 comments

OpenAI's Sora has been leaked (techcrunch.com)
A group appears to have leaked access to Sora, OpenAI’s video generator, in protest of what they’re calling duplicity and “art washing” on OpenAI’s part.

OpenAI, Generative AI, Video Generation, Artificial Intelligence, Leaks

25 points by cut3 86 days ago | 3 comments

The Matrix: a foundation world model for generating infinite-length videos (twitter.com)

Generative AI, Computer Vision, Video Generation, Artificial Intelligence

4 points by outrun86 91 days ago | 0 comments

Mochi 1 preview. A new SOTA in open-source video generation. Apache 2.0 (twitter.com)

Open Source, Video Generation, Artificial Intelligence, Software

15 points by modeless 121 days ago | 6 comments

Sora-like text-to-video model from Chinese startup Minimax, 10 examples (twitter.com)

Generative AI, Video Generation, China, Artificial Intelligence, Startups

10 points by eh_why_not 170 days ago | 2 comments

CogVideoX: A Cutting-Edge Video Generation Model (medium.com)