PuzzleSorter: Certainty-aware visual restoration of multiple cultural artifacts
Abstract:
We present PuzzleSorter, a certainty-aware visual analytics system for cultural relic fragment restoration. Restoring cultural objects from broken fragments is a fundamental task in geometry and archaeology. Prior research proposes automatic models to classify fragments by types and assemble matched pairs successively. However, eroded fragments lead to erroneous results, posing two challenges for restorers to correct: (1) numerous fragments conceal errors within an overwhelming number of object appearances, and (2) the unknown difficulty of restoration hinders correction strategy development. To address these challenges, PuzzleSorter provides multi-criteria analysis that helps users identify certainties of current solutions and alternatives at the type, object, and fragment levels. Moreover, our system visualizes these certainties through a relation graph, which implies alternative assembly solutions with geometric context and indicates correction difficulties through neighbor proximity, number of neighbors, and path length. We demonstrate the feasibility and utility of our system through two case studies and expert interviews.
Main reference:
S. Ye et al., "PuzzleSorter: Certainty-Aware Visual Restoration of Multiple Cultural Artifacts," in Computational Visual Media, vol. 11, no. 6, pp. 1281-1302, December 2025, doi: 10.26599/CVM.2025.9450468.
BibTeX:
@ARTICLE{11060027,
author={Ye, Shuainan and Yin, Jianing and Zhou, Buwei and Tang, Tan and Yu, Lingyun and Yu, Ruohan and Jiang, Lu and Diao, Changyu and Wu, Yingcai},
journal={Computational Visual Media},
title={PuzzleSorter: Certainty-Aware Visual Restoration of Multiple Cultural Artifacts},
year={2025},
volume={11},
number={6},
pages={1281-1302},
keywords={Image restoration;Visualization;Cultural differences;Assembly;Shape;Predictive models;Object recognition;Uncertainty;Interviews;Computational modeling;fragment restoration;force-directed graph;uncertainty visualization;cultural heritage},
doi={10.26599/CVM.2025.9450468}}