Diminished Reality for Emerging Applications in Medicine

The Diminished Reality for Emerging Applications in Medicine through Inpainting (DREAMING) challenge seeks to pioneer the integration of Diminished Reality (DR) into oral and maxillofacial surgery. While Augmented Reality (AR) has been extensively explored in medicine, DR remains largely uncharted territory. DR involves virtually removing real objects from the environment by replacing them with their background. Recent inpainting methods present an opportunity for real-time DR applications without scene knowledge. DREAMING focuses on implementing such methods to fill obscured regions in surgery scenes with realistic backgrounds, emphasizing the complex facial anatomy and patient diversity. The challenge provides a dataset of synthetic yet photorealistic surgery scenes featuring humans, simulating an operating room setting. Participants are tasked with developing algorithms that seamlessly remove disruptions caused by medical instruments and hands, offering surgeons an unimpeded view of the operative site.