High-Performance Graphics 2018

Permanent URI for this collection

Now showing 1 - 1 of 1

Detecting Aliasing Artifacts in Image Sequences Using Deep Neural Networks
(ACM, 2018) Patney, Anjul; Lefohn, Aaron; Patney, Anjul and Niessner, Matthias
In this short paper we present a machine learning approach to detect visual artifacts in rendered image sequences. Specifically, we train a deep neural network using example aliased and antialiased image sequences exported from a real-time renderer. The trained network learns to identify and locate aliasing artifacts in an input sequence, without comparing it against a ground truth. Thus, it is useful as a fully automated tool for evaluating image quality. We demonstrate the effectiveness of our approach in detecting aliasing in several rendered sequences. The trained network correctly predicts aliasing in 64×64×4 animated sequences with more than 90% accuracy for images it hasn't seen before. The output of our network is a single scalar between 0 and 1, which is usable as a quality metric for aliasing. It follows the same trend as (1-SSIM) for images with increasing sample counts.