98%
921
2 minutes
20
Objective: In this work, we propose a framework for differentiable forward and back-projector that enables scalable, accurate, and memory-efficient gradient computation for rigid motion estimation tasks.
Methods: Unlike existing approaches that rely on auto-differentiation or that are restricted to specific projector types, our method is based on a general analytical gradient formulation for forward/backprojection in the continuous domain. A key insight is that the gradients of both forward and back-projection can be expressed directly in terms of the forward and back-projection operations themselves, providing a unified gradient computation scheme across different projector types. Leveraging this analytical formulation, we develop a discretized implementation with an acceleration strategy that balances computational speed and memory usage.
Results: Simulation studies illustrate the numerical accuracy and computational efficiency of the proposed algorithm. Experiments demonstrates the effectiveness of this approach for multiple X-ray imaging tasks we conducted. In 2D/3D registration, the proposed method achieves ~8x speedup over an existing differentiable forward projector while maintaining comparable accuracy. In motion-compensated analytical reconstruction and cone-beam CT geometry calibration, the proposed method enhances image sharpness and structural fidelity on real phantom data while showing significant efficiency advantages over existing gradient-free and gradient-based solutions.
Conclusion: The proposed differentiable projectors enable effective and efficient gradient-based solutions for X-ray imaging tasks requiring rigid motion estimation.
Download full-text PDF |
Source |
---|---|
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC12393235 | PMC |
Differentiable rendering has been widely adopted in computer graphics as a powerful approach to inverse problems, enabling efficient gradient-based optimization by differentiating the image formation process with respect to millions of scene parameters. Inspired by this paradigm, we propose a physically-based inverse rendering (IR) framework, the first ever platform for PET image reconstruction using Dr.Jit, for PET image reconstruction.
View Article and Find Full Text PDFObjective: In this work, we propose a framework for differentiable forward and back-projector that enables scalable, accurate, and memory-efficient gradient computation for rigid motion estimation tasks.
Methods: Unlike existing approaches that rely on auto-differentiation or that are restricted to specific projector types, our method is based on a general analytical gradient formulation for forward/backprojection in the continuous domain. A key insight is that the gradients of both forward and back-projection can be expressed directly in terms of the forward and back-projection operations themselves, providing a unified gradient computation scheme across different projector types.
Designing nanophotonic structures traditionally grapples with the complexities of discrete parameters, such as real materials, often resorting to costly global optimization methods. This paper introduces an approach that leverages generative deep learning to map discrete parameter sets into a continuous latent space, enabling direct gradient-based optimization. For scenarios with non-differentiable physics evaluation functions, a neural network is employed as a differentiable surrogate model.
View Article and Find Full Text PDFPartially coherent beams (PCBs), with unique properties such as reduced speckles and self-reconstruction, hold great promise for optical communication, particle trapping, and laser material processing. However, designing optical elements for shaping PCBs remains a significant challenge. We present a differentiable design method of freeform lenses for shaping PCBs.
View Article and Find Full Text PDFIEEE Trans Pattern Anal Mach Intell
July 2025
In modern computer vision, the optimal representation of 3D shape remains task-dependent. One fundamental operation applied to such representations is differentiable rendering, which enables learning-based inverse graphics approaches. Standard explicit representations are often easily rendered, but can suffer from limited geometric fidelity, among other issues.
View Article and Find Full Text PDF