Overdub - smart video edit
Marek Basler
I import a video with voice synced to the video. If I delete a word, all is fine, video is just cut out. But if I replace a word in my transcript with an overdub version, there is then no video for that section. I don't know how to deal with it. Sometimes the new audio is longer, sometimes shorter. There should be some way to tell Descript how should the video part be changed around the edited transcript so that the rest of the video stays in sync with the audio. Like speed up the video section, cut it at the beginning, cut the end, use still image instead etc.
Canny AI
Merged in a post:
How do I get the video to match my edited transcript and audio?
D
David Mills
How do I get the video to match my edited transcript and audio?
Canny AI
Merged in a post:
Regenerate a word for videos is really unpractical
P
Pat Sej
I understand this is a function in beta at the moment. It will be amazing when it works for videos.
When a word in a video is not heard properly we can regenerate the word (or a sentence) by selecting it and using Replace > Regenerate.
One then gets the following message: "Warning: Regenerate on video sequences.
Performing regenerate on media containing video sequences will
remove any video for the generated range. Do you want to
proceed?", meaning the image will disappear for this word.
To make it work for my videos,
- I make it generate the audio file. Then
- copy this file locally.
- undo the Regenerate
- add the generated audio file to the project
- move it at the correct location and trim it
- mute the word in the original video
This is really time-consuming. Do you plan to make it work for videos?
Thanks !
W. Curtis Preston
I occasionally use overdub to fix a word I mispoke in a video recording. As mentioned by others, I only want to replace the audio. Unfortunately, it replaces the video as well, with a black screen. I just leave it, because most people listen to the audio. Even video watchers probably just think it's a glitch. I'd rather it leave the video in place and just edit the audio. If the new audio is longer, then I'd add a transition to hide it.
Stefano
Ideally, Overdub should generate new frames, either with deepfake or AI lip syncing. Say you wanna add a new paragraph with Overdub. It should look at the last frame before the new paragraph and the first frame after it.
Then, render new frames with similar style & movement of both the camera & living beings either with deepfake or AI lipsync.
I think that's gonna be the future of video content generation.
Erik Pollitt
Another request for this. Even if it kept the orignal video & just overdubbed the word, it would be better than a black screen.
There are ai lipsync programs out there now, so in the future you could end up with something amazing, but for now, just the original footage redubbed with your new word/s would be better than blackscreen.
J
James Sebenius
This comment is relevant to Overdub, but comes from black screen on video when I edit audio by adding a gap space. The gap spaces I add make the audio sound more natural, with pauses where there had been cuts. It works great for audio but not so much for video. For the overdub as well as gap clips, I would think that your team could create a kind of “morph” that would work well if the scenes are similar, which would often be the case where the subject of the video is an interview. Premiere Pro has such a function—Morph Cut Transition— that very much does what it would be great for Descript to do. It works well as long as the background is fairly static.
J
Joshua
I would love for the video to keep going but the audio to be replaced. This would be great for editing explainer videos.
Harry Hawk
As noted in other similar requests.
Two types of Overdub. One as is that add net new text and leaves a black screen.
The 2nd in an 'insert' where it hold the prior image/frame over the inserted overdub. When exported these can be part of the meta data / EDL
D
Daniel Frank
I really wish for some options here. Right now it just gives a black screen on an overdub which is really distracting.