Reconstructing volumetric smoke from 2D images remains challenging in computer graphics. Although physics-based differentiable rendering offers a promising solution, existing methods are computationally expensive and impractical for interactive use. We introduce an efficient physics-based differentiable renderer tailored for smoke reconstruction, based on two insights: (ⅰ) for the optically thin-to-moderately dense smoke targeted in this work, appearance is well approximated by single scattering, allowing us to avoid costly multiple-scattering simulation, and (ⅱ) direction-independent terms can be precomputed to avoid redundant forward and backward passes. Our technical contributions include a pre-computation strategy that eliminates repetitive calculations, and an efficient ray marching method that computes density derivatives without costly Monte Carlo estimation or automatic differentiation. Comprehensive evaluation shows that our approach achieves real-time performance while maintaining high reconstruction quality. In contrast to current best methods that require minutes per frame, our method enables interactive smoke reconstruction while maintaining competitive visual fidelity. We demonstrate its utility in applications such as augmented reality and fluid motion reconstruction.
- Article type
- Year
- Co-author
Open Access
Research Article
Issue
Open Access
Research Article
Issue
We propose a normalizing flow based on the wavelet framework for super-resolution (SR) called WDFSR. It learns the conditional distribution mapping between low-resolution images in the RGB domain and high-resolution images in the wavelet domain to simultaneously generate high-resolution images of different styles. To address the issue of some flow-based models being sensitive to datasets, which results in training fluctuations that reduce the mapping ability of the model and weaken generalization, we designed a method that combines a T-distribution and QR decomposition layer. Our method alleviates this problem while maintaining the ability of the model to map different distributions and produce higher-quality images. Good contextual conditional features can promote model training and enhance the distribution mapping capabilities for conditional distribution mapping. Therefore, we propose a Refinement layer combined with an attention mechanism to refine and fuse the extracted condition features to improve image quality. Extensive experiments on several SR datasets demonstrate that WDFSR outperforms most general CNN- and flow-based models in terms of PSNR value and perception quality. We also demonstrated that our framework works well for other low-level vision tasks, such as low-light enhancement. The pretrained models and source code with guidance for reference are available at https://github.com/Lisbegin/WDFSR.
Open Access
Research Article
Issue
Depth-image-based rendering (DIBR) is widely used in 3DTV, free-viewpoint video, and interac-tive 3D graphics applications. Typically, synthetic images generated by DIBR-based systems incorporate various distortions, particularly geometric distortions induced by object dis-occlusion. Ensuring the quality of synthetic images is critical to maintaining adequate system service. However, traditional 2D image quality metrics are ineffective for evaluating synthetic images as they are not sensitive to geometric distortion. In this paper, we propose a novel no-reference image quality assessment method for synthetic images based on con-volutional neural networks, introducing local image saliency as prediction weights. Due to the lack of existing training data, we construct a new DIBR synthetic image dataset as part of our contribution. Experiments were conducted on both the public benchmark IRCCyN/IVC DIBR image dataset and our own dataset. Results demonstrate that our proposed metric outperforms traditional 2D image quality metrics and state-of-the-art DIBR-related metrics.
京公网安备11010802044758号