INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS AND DATA SCIENCE

Optimizing 3D Scene Reconstruction with Differentiable Ray Tracing

1.University of Texas at Dallas

Published in issue

October 2026

Volume / Issue

Vol. 1 No. 4

Access

Open access

View PDF

The article details presented on this page reflect the published version of record. Readers may access the full-text PDF, review the citation information, and export the reference in supported citation formats.

Abstract

A fundamental limitation of classical rendering pipelines is that their discrete, non-differentiable structure makes them unsuitable for gradient-based parameter recovery. This paper presents a differentiable ray tracing framework that directly addresses this gap, enabling end-to-end optimization of object appearance, illumination, and viewpoint parameters from observed images. The framework is built around automatic differentiation, specifically the source-to-source AD mechanism provided by Zygote in Julia. In our experiments, AD-based gradient computation achieves a 60% reduction in wall-clock time compared to central finite differences for scenes with more than 50 optimized parameters, while reducing gradient approximation error by approximately two orders of magnitude. We validate the approach through controlled inverse rendering experiments. These results open practical pathways for applications in neural rendering, differentiable simulation, and broader inverse graphics research.
Keywords:Computer GraphicsAutomatic DifferentiationRay TracingNeural RenderingGradient-Based OptimizationDifferentiable RenderingScene ReconstructionInverse Graphics

Cite this Article

Use the following citation when referencing this publication in academic or professional work.

A. Veluru, "Optimizing 3D Scene Reconstruction with Differentiable Ray Tracing", Int. J. Intell. Syst. Data Sci., vol. 1, no. 4, Oct. 2026, doi: https://doi.org/10.67231/qjgz4220.

DOWNLOAD CITATION

Optimizing 3D Scene Reconstruction with Differentiable Ray Tracing | International Journal of Intelligent Systems and Data Science