Perceptual error optimization for Monte Carlo rendering

Vassillen Chizhov1,2, Iliyan Gerogiev3, Karol Myszkowski1, Gurprit Singh1
1Max Planck Institute for Informatics, Saarbrücken, 2 MIA Group, Saarland University, 3Autodesk, London
ACM Transactions on Graphics, Volume 41 issue 3, June 2022 (presented at SIGGRAPH 2022)
Snow
We devise a perceptually based model to optimize the error of Monte Carlo renderings. Here we show our vertical iterative minimization algorithm: Given 4 input samples per pixel (spp), it selects a subset of them to produce an image with substantially improved visual fidelity over a simple 4-spp average. The optimization is guided by a surrogate image obtained by regularizing the noisy input; we also show using the ground-truth image as a guide. The power spectrum of the image error, computed on 32x32-pixel tiles, indicates that our method distributes pixel error with locally blue-noise characteristics.

Abstract

Synthesizing realistic images involves computing high-dimensional light transport integrals. In practice, these integrals are numerically estimated via Monte Carlo integration. The error of this estimation manifests itself as conspicuous aliasing or noise. To ameliorate such artifacts and improve image fidelity, we propose a perception-oriented framework to optimize the error of Monte Carlo rendering. We leverage models based on human perception from the halftoning literature. The result is an optimization problem whose solution distributes the error as visually pleasing blue noise in image space. To find solutions, we present a set of algorithms that provide varying trade-offs between quality and speed, showing substantial improvements over prior state of the art. We perform evaluations using quantitative and error metrics, and provide extensive supplemental material to demonstrate the perceptual improvements achieved by our methods.

Material

Paper (author version) / Supplemental document / arXiv / ACM version

Fast-forward video / Talk video / HTML viewer

Results

Acknowledgements

Thanks to all the anonymous reviewers for their comments and thoughtful guidance. Our results show scenes (summarized in Figure 12) coming from third parties. We acknowledge the PBRT scene repository for San Miguel and Bathroom. Wooden staircase, Modern hall, Modern living room, Japanese classroom, White room, Grey & white room, and Utah teapot have been provided by Benedikt Bitterli.

Copyright Disclaimer

The Author(s) / ACM. This is the author's version of the work. It is posted here for your personal use. Not for redistribution. The definitive Version of Record is available at doi.acm.org.

Imprint / Data Protection