Hacker News with Generative AI: Video Processing

Bring Silent Videos to Life Sounds(Open-Source) (github.com/open-mmlab)
FoleyCrafter is a video-to-audio generation framework which can produce realistic sound effects semantically relevant and synchronized with videos.

Open Source, Audio Generation, Video Processing, Machine Learning

14 points by BruceWok 34 days ago | 4 comments

Benchmarking vision-language models on OCR in dynamic video environments (arxiv.org)
This paper introduces an open-source benchmark for evaluating Vision-Language Models (VLMs) on Optical Character Recognition (OCR) tasks in dynamic video environments.

Computer Vision, OCR, Video Processing, Benchmarking, Open Source

142 points by ashu_trv 48 days ago | 58 comments

Airflow – Stream media files directly from macOS to AirPlay devices (airflow.app)
Airflow is different We're not cutting any corners. This is not yet another FFmpeg wrapper like you might have seen elsewhere. Don't get us wrong, we love FFmpeg and use many of its parts under the hood, but our custom built video processing pipeline goes way beyond wrapping FFmpeg and calling it a day. We've been working on it for years it and it lets us do things that other similar software simply can't.

macOS, Streaming, Video Processing, AirPlay, Media

222 points by tiagod 63 days ago | 79 comments

FastVideo: a lightweight framework for accelerating large video diffusion models (github.com/hao-ai-lab)
FastVideo is a lightweight framework for accelerating large video diffusion models.

Deep Learning, Video Processing, Computer Vision, Generative AI, Software

110 points by zhisbug 106 days ago | 24 comments

Meta's new Video Understanding Multimodal Model used Qwen model for training (arxiv.org)
Despite the rapid integration of video perception capabilities into Large Multimodal Models (LMMs), the underlying mechanisms driving their video understanding remain poorly understood.

Meta, Artificial Intelligence, Video Processing, Computer Vision

7 points by BUFU 107 days ago | 1 comments

Representing Long Volumetric Video with Temporal Gaussian Hierarchy (zju3dv.github.io)
This paper aims to address the challenge of reconstructing long volumetric videos from multi-view RGB videos.

Computer Vision, Video Processing, 3D Reconstruction

7 points by pr337h4m 109 days ago | 0 comments

Don't Look Twice: Faster Video Transformers with Run-Length Tokenization (rccchoudhury.github.io)
We present Run-Length Tokenization (RLT), a simple and efficient approach to speed up video transformers by removing redundant tokens from the input.

Computer Vision, Machine Learning, Video Processing, Deep Learning, Transformers

75 points by jasondavies 138 days ago | 16 comments

Generating high-quality thumbnails from videos (apple.com)

Video Processing, Image Generation, Machine Learning

51 points by Austin_Conlon 143 days ago | 11 comments

Show HN: FFmpeg-over-IP – Connect to remote FFmpeg servers (github.com/steelbrain)
Connect to remote ffmpeg servers. Are you tired of unsuccessfully trying to pass your GPU through to a docker container running in a VM? So was I! ffmpeg-over-ip allows you to run an ffmpeg server on a machine with access to a GPU (Linux, Windows, or Mac) and connect to it from a remote machine. The only thing you need is Node.js installed and a shared filesystem (could be NFS, SMB, etc.) between the two machines.

Software, Video Processing, Remote Access, Docker

147 points by steelbrain 180 days ago | 72 comments

Video segmentation with Segment Anything 2 (SAM2) (roboflow.com)

Computer Vision, Video Processing, Generative AI, Machine Learning

32 points by SkalskiP 244 days ago | 3 comments

StreamPot: Run FFmpeg as an API with fluent-FFmpeg compatibility, queues and S3 (github.com/StreamPot)

API, Video Processing, FFmpeg, Cloud Storage, Software

218 points by thunderbong 249 days ago | 36 comments

Texture Enhancement for Video Super-Resolution (github.com/DachunKai)

Computer Vision, Video Processing, Deep Learning

179 points by smusamashah 281 days ago | 31 comments

The challenge of writing a on-demand transcoder (zoriya.dev)

Software Development, Video Processing, Technical Challenges

50 points by zoriya 293 days ago | 10 comments

Show HN: ffmpeg-english "capture from /dev/video0 every 1 second to jpg files" (github.com/dheera)