SmartShots: Enabling Automatic Generation of Videos with Data Visualizations Embedded
Abstract:
Videos become prevalent for storytellers to inspire viewers' interests. To further enhance narrations, visualizations are integrated into videos to present data-driven insights. However, manually crafting such data-driven videos is difficult and time-consuming. Thus, we present SmartShots, a system that facilitates the automatic integration of in-video visualizations. Specifically, we propose a computational framework that integrates non-verbal video clips, images, a melody, and a data table to create a video with data visualizations embedded. The system automatically translates the multi-media material into shots and then combines the shots into a compelling video. In addition, we develop a set of post-editing interactions to incorporate users' design knowledge and help them re-edit the automatically-generated videos.
Main reference:
Tan Tang, Junxiu Tang, Jiewen Lai, Lu Ying, Peiran Ren, Lingyun Yu, and Yingcai Wu. 2020. SmartShots: Enabling Automatic Generation of Videos with Data Visualizations Embedded. In Proceedings of the 28th ACM International Conference on Multimedia (MM '20). Association for Computing Machinery, New York, NY, USA, 4509–4511. https://doi.org/10.1145/3394171.3414356
BibTeX:
@inproceedings{10.1145/3394171.3414356,
author = {Tang, Tan and Tang, Junxiu and Lai, Jiewen and Ying, Lu and Ren, Peiran and Yu, Lingyun and Wu, Yingcai},
title = {SmartShots: Enabling Automatic Generation of Videos with Data Visualizations Embedded},
year = {2020},
isbn = {9781450379885},
publisher = {Association for Computing Machinery},
address = {New York, NY, USA},
url = {https://doi.org/10.1145/3394171.3414356},
doi = {10.1145/3394171.3414356},
abstract = {Videos become prevalent for storytellers to inspire viewers' interests. To further enhance narrations, visualizations are integrated into videos to present data-driven insights. However, manually crafting such data-driven videos is difficult and time-consuming. Thus, we present SmartShots, a system that facilitates the automatic integration of in-video visualizations. Specifically, we propose a computational framework that integrates non-verbal video clips, images, a melody, and a data table to create a video with data visualizations embedded. The system automatically translates the multi-media material into shots and then combines the shots into a compelling video. In addition, we develop a set of post-editing interactions to incorporate users' design knowledge and help them re-edit the automatically-generated videos.},
booktitle = {Proceedings of the 28th ACM International Conference on Multimedia},
pages = {4509–4511},
numpages = {3},
keywords = {data-driven videos, storytelling, visualization},
location = {Seattle, WA, USA},
series = {MM '20}
}