Direct-a-Video: driving Video Generation
Direct-a-Video is a text-to-video generation framework that allows users to individually or jointly control the camera movement and/or object motion. Authors: City University of HK, Kuaishou Tech & Tianjin.
𝐇𝐢𝐠𝐡𝐥𝐢𝐠𝐡𝐭𝐬:
Decoupling camera/object motion in gen-AI
Allowing users to independently/jointly control
Novel temporal cross-attention for cam motion
Training-free spatial cross-attention for objects
Driving object generation via bounding boxes
Paper: https://arxiv.org/pdf/2402.03162.pdf
Project: https://direct-a-video.github.io/
