Controlling Motion Blur in Synthetic Long Time Exposures

• Published in: Computer graphics forum 2019-05, Vol.38 (2), p.393-403
• Main Authors: Lancelle, M., Dogan, P., Gross, M.
• Format: Article
• Language: English
• Subjects: Algorithms; CCS Concepts; Computational photography; Computer simulation; Computing methodologies; Exposure; Ghosting; Ground truth; Image processing; Image segmentation; Interpolation; Moving object recognition; Optical flow (image analysis)
• ISSN: 0167-7055; 1467-8659
• DOI: 10.1111/cgf.13646

In a photo, motion blur can be used as an artistic style to convey motion and to direct attention. In panning or tracking shots, a moving object of interest is followed by the camera during a relatively long exposure. The goal is to get a blurred background while keeping the object sharp. Unfortunately, it can be difficult to impossible to precisely follow the object. Often, many attempts or specialized physical setups are needed. This paper presents a novel approach to create such images. For capturing, the user is only required to take a casually recorded hand‐held video that roughly follows the object. Our algorithm then produces a single image which simulates a stabilized long time exposure. This is achieved by first warping all frames such that the object of interest is aligned to a reference frame. Then, optical flow based frame interpolation is used to reduce ghosting artifacts from temporal undersampling. Finally, the frames are averaged to create the result. As our method avoids segmentation and requires little to no user interaction, even challenging sequences can be processed successfully. In addition, artistic control is available in a number of ways. The effect can also be applied to create videos with an exaggerated motion blur. Results are compared with previous methods and ground truth simulations. The effectiveness of our method is demonstrated by applying it to hundreds of datasets. The most interesting results are shown in the paper and in the supplemental material.