awesome-NeRF

NRF papers

A curated collection of papers on Neural Radiance Fields, a technique for representing and rendering 3D scenes in a more efficient and realistic way.

A curated list of awesome neural radiance fields papers

GitHub
7k stars
238 watching
598 forks
Language: TeX
last commit: about 1 year ago
Linked from 2 awesome lists

nerf

Awesome Neural Radiance Fields / Survey
Semantically-aware Neural Radiance Fields for Visual Scene Understanding: A Comprehensive Review , Thang-Anh-Quan Nguyen*, Amine Bourki*, Màtyàs Macudzinski, Anthony Brunel, and Mohammed Bennamoun (*: Equal contribution), Arxiv 2024 | |
BeyondPixels: A Comprehensive Review of the Evolution of Neural Radiance Fields , AKM Shahariar Azad Rabby and Chengcui Zhang, Arxiv 2023 |
Neural Volume Rendering: NeRF And Beyond , Dellaert and Yen-Chen, Arxiv 2020 | | |
NeRF: Neural Radiance Field in 3D Vision, Introduction and Review , Kyle Gao, Yina Gao, Hongjie He, Dening Lu, Linlin Xu, Jonathan Li
Neural Fields in Robotics: A Survey , Muhammad Zubair Irshad, Mauro Comi, Yen-Chen Lin, Nick Heppert, Abhinav Valada, Zsolt Kira, Rares Ambrus, Johnathan Trembley

Awesome Neural Radiance Fields / Papers
NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis , Mildenhall et al., ECCV 2020 | |
Learning Neural Transmittance for Efficient Rendering of Reflectance Fields , Mohammad Shafiei et al., BMVC 2021 |
Neural Sparse Voxel Fields , Liu et al., NeurIPS 2020 | |
AutoInt: Automatic Integration for Fast Neural Volume Rendering , Lindell et al., CVPR 2021 | |
DeRF: Decomposed Radiance Fields , Rebain et al. Arxiv 2020 |
DONeRF: Towards Real-Time Rendering of Compact Neural Radiance Fields using Depth Oracle Networks , Neff et al., CGF 2021 | |
FastNeRF: High-Fidelity Neural Rendering at 200FPS , Garbin et al., Arxiv 2021 |
KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPs , Reiser et al., ICCV 2021 | |
PlenOctrees for Real-time Rendering of Neural Radiance Fields , Yu et al., Arxiv 2021 | |
Mixture of Volumetric Primitives for Efficient Neural Rendering , Lombardi et al., SIGGRAPH 2021 |
Light Field Networks: Neural Scene Representations with Single-Evaluation Rendering , Sitzmann et al., Arxiv 2021 | |
RT-NeRF: Real-Time On-Device Neural Radiance Fields Towards Immersive AR/VR Rendering , Li et al., ICCAD 2022 |
ENeRF: Efficient Neural Radiance Fields for Interactive Free-viewpoint Video , Lin et al., SIGGRAPH 2022 | |
R2L: Distilling Neural Radiance Field to Neural Light Field for Efficient Novel View Synthesis , Wang et al., ECCV 2022 | |
Real-Time Neural Light Field on Mobile Devices , Cao et al., Arxiv 2022 | |
Hardware Acceleration of Neural Graphics , Mubarik et al., ISCA 2023 |
DyLiN: Making Light Field Networks Dynamic , Yu et al., CVPR 2023 | |
Depth-supervised NeRF: Fewer Views and Faster Training for Free , Deng et al., Arxiv 2021 | |
Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstruction , Sun et al., CVPR 2022 | |
Instant Neural Graphics Primitives with a Multiresolution Hash Encoding , Müller et al., SIGGRAPH 2022 | |
Plenoxels Radiance Fields without Neural Networks , Yu et al., CVPR 2022 | |
TensoRF: Tensorial Radiance Fields , Chen et al., ECCV 2022 | |
BakedSDF: Meshing Neural SDFs for Real-Time View Synthesis , Yariv et al., Arxiv 2023 |
Lightning NeRF: Efficient Hybrid Scene Representation for Autonomous Driving , Cao et al. ICRA 2024 | |
Variable Bitrate Neural Fields , Takikawa et al., SIGGRAPH 2022 | |
NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collections , Martin-Brualla et al., CVPR 2021 |
Ha-NeRF: Hallucinated Neural Radiance Fields in the Wild , Chen et al., CVPR 2022 | |
HDR-Plenoxels: Self-Calibrating High Dynamic Range Radiance Fields , Jun-seong et al., ECCV 2022 | |
UP-NeRF: Unconstrained Pose-Prior-Free Neural Radiance Fields , In-jae et al., NeurIPS 2023 | |
Deformable Neural Radiance Fields , Park et al., Arxiv 2020 | |
D-NeRF: Neural Radiance Fields for Dynamic Scenes , Pumarola et al., CVPR 2021 | |
Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstruction , Gafni et al., CVPR 2021 | |
Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Deforming Scene from Monocular Video , Tretschk et al., Arxiv 2020 | |
PVA: Pixel-aligned Volumetric Avatars , Raj et al., CVPR 2021 |
Neural Articulated Radiance Field 150 over 3 years ago , Noguchi et al., Arxiv 2021 | |
CLA-NeRF: Category-Level Articulated Neural Radiance Field , Tseng et al., ICRA 2022 |
Animatable Neural Radiance Fields for Modeling Dynamic Human Bodies , Peng et al., ICCV 2021 | |
A Higher-Dimensional Representation for Topologically Varying Neural Radiance Fields , Park et al., Arxiv 2021 | |
IBRNet: Learning Multi-View Image-Based Rendering , Wang et al., CVPR 2021 | |
Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenes , Li et al., CVPR 2021 | |
Animatable Neural Radiance Fields from Monocular RGB Videos , Chen et al., Arxiv 2021 | |
Neural Actor: Neural Free-view Synthesis of Human Actors with Pose Control , Liu et al., SIGGRAPH Asia 2021 |
TiNeuVox: Fast Dynamic Radiance Fields with Time-Aware Neural Voxels , Fang et al., SIGGRAPH Asia 2022 | |
HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Video , Weng et al., CVPR 2022 | |
AligNeRF: High-Fidelity Neural Radiance Fields via Alignment-Aware Training , Jiang et al., CVPR 2023 |
DynIBaR: Neural Dynamic Image-Based Rendering , Li et al., CVPR 2023 |
BundleSDF: Neural 6-DoF Tracking and 3D Reconstruction of Unknown Objects , Wen et al., CVPR 2023 | |
Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenes , Li et al., CVPR 2021 | |
Space-time Neural Irradiance Fields for Free-Viewpoint Video , Xian et al., CVPR 2021 |
Neural Radiance Flow for 4D View Synthesis and Video Processing , Du et al., Arxiv 2020 |
Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humans , Peng et al., CVPR 2021 | |
UV Volumes for Real-time Rendering of Editable Free-view Human Performance , Chen et al., CVPR 2023 | |
Neural 3D Video Synthesis from Multi-view Video , Li et al., CVPR 2022 |
Dynamic View Synthesis from Dynamic Monocular Video , Gao et al., ICCV 2021 |
Streaming Radiance Fields for 3D Video Synthesis Li et al. NeurIPS 2022 | |
GRAF: Generative Radiance Fields for 3D-Aware Image Synthesis , Schwarz et al., NeurIPS 2020 | |
GRF: Learning a General Radiance Field for 3D Scene Representation and Rendering , Trevithick and Yang, Arxiv 2020 | |
pixelNeRF: Neural Radiance Fields from One or Few Images , Yu et al., CVPR 2021 | |
Learned Initializations for Optimizing Coordinate-Based Neural Representations , Tancik et al., CVPR 2021 | |
pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesis , Chan et al., CVPR 2021 |
Portrait Neural Radiance Fields from a Single Image , Gao et al., Arxiv 2020 |
ShaRF: Shape-conditioned Radiance Fields from a Single View , Rematas et al., ICML 2021 |
IBRNet: Learning Multi-View Image-Based Rendering , Wang et al., CVPR 2021 | |
CAMPARI: Camera-Aware Decomposed Generative Neural Radiance Fields , Niemeyer & Geiger, Arxiv 2021 |
NeRF-VAE: A Geometry Aware 3D Scene Generative Model , Kosiorek et al., Arxiv 2021 |
Unconstrained Scene Generation with Locally Conditioned Radiance Fields , DeVries et al., Arxiv 2021 |
MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereo , Chen et al., ICCV 2021 | |
Stereo Radiance Fields (SRF): Learning View Synthesis from Sparse Views of Novel Scenes , Chibane et al., CVPR 2021 |
Neural Rays for Occlusion-aware Image-based Rendering , Liu et al., Arxiv 2021 |
Putting NeRF on a Diet: Semantically Consistent Few-Shot View Synthesis , Matthew Tancik et al., Arxiv 2021 |
MINE: Towards Continuous Depth MPI with NeRF for Novel View Synthesis , Jiaxin Li et al., ICCV 2021 | |
TöRF: Time-of-Flight Radiance Fields for Dynamic Scene View Synthesis , Benjamin Attal et al., NeurIPS 2021 |
CodeNeRF: Disentangled Neural Radiance Fields for Object Categories , Jang et al., ICCV 2021 |
StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesis , Gu et al., Arxiv 2021 |
Generative Occupancy Fields for 3D Surface-Aware Image Synthesis , Xu et al., NeurIPS 2021 | |
NeRF in the Dark: High Dynamic Range View Synthesis from Noisy Raw Images , Ben Mildenhall et al, arXiv 2021 |
Point-NeRF: Point-based Neural Radiance Fields , Xu et al., CVPR 2022 | |
SinNeRF: Training Neural Radiance Fields on Complex Scenes from a Single Image , Xu et al., ECCV 2022 | |
Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusion , Wang et al., CVPR 2023 | |
SurfelNeRF: Neural Surfel Radiance Fields for Online Photorealistic Reconstruction of Indoor Scenes , Gao et al., CVPR 2023 | |
NeO 360: Neural Fields for Sparse View Synthesis of Outdoor Scenes , Irshad et al., ICCV 2023 | |
X-NeRF: Explicit Neural Radiance Field for Multi-Scene 360° Insufficient RGB-D Views , Zhu et al., WACV 2023 | |
UFORecon: Generalizable Sparse-View Surface Reconstruction from Arbitrary and Unfavorable Sets , Na et al., CVPR 2024 | |
🏡Know Your Neighbors: Improving Single-View Reconstruction via Spatial Vision-Language Reasoning , Li et al., CVPR 2024 | |
BundleSDF: Neural 6-DoF Tracking and 3D Reconstruction of Unknown Objects , Wen et al., CVPR 2023 | |
iNeRF: Inverting Neural Radiance Fields for Pose Estimation , Yen-Chen et al. IROS 2021 |
A-NeRF: Surface-free Human 3D Pose Refinement via Neural Rendering , Su et al. Arxiv 2021 |
NeRF--: Neural Radiance Fields Without Known Camera Parameters , Wang et al., Arxiv 2021 | |
iMAP: Implicit Mapping and Positioning in Real-Time , Sucar et al., ICCV 2021 |
NICE-SLAM: Neural Implicit Scalable Encoding for SLAM , Zhu et al., Arxiv 2021 |
GNeRF: GAN-based Neural Radiance Field without Posed Camera , Meng et al., Arxiv 2021 |
BARF: Bundle-Adjusting Neural Radiance Fields , Lin et al., ICCV 2021 |
Self-Calibrating Neural Radiance Fields , Jeong et al., ICCV 2021 | |
DFNet: Enhance Absolute Pose Regression with Direct Feature Matching , Chen et al., ECCV 2022 | |
GARF: Gaussian Activated Radiance Fields for High Fidelity Reconstruction and Pose Estimation , Chng et al., ECCV 2022 |
L2G-NeRF: Local-to-Global Registration for Bundle-Adjusting Neural Radiance Fields , Chen et al., CVPR 2023 | |
NoPe-NeRF: Optimising Neural Radiance Field with No Pose Prior , Bian et al., CVPR 2023 | |
Loc-NeRF: Monte Carlo Localization using Neural Radiance Fields , Maggio et al., ICRA 2023 | |
Robust Camera Pose Refinement for Multi-Resolution Hash Encoding , Heo et al., ICML 2023 |
CROSSFIRE: Camera Relocalization On Self-Supervised Features from an Implicit Representation , Moreau et al., ICCV 2023 |
PoRF: Pose Residual Field for Accurate Neural Surface Reconstruction , Bian et al., ICLR 2024 | |
Neural Refinement for Absolute Pose Regression with Feature Synthesis , Chen et al., CVPR 2024 | |
NeRD: Neural Reflectance Decomposition from Image Collections , Boss et al., Arxiv 2020 | |
NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesis , Srinivasan et al. CVPR 2021 |
NeX: Real-time View Synthesis with Neural Basis Expansion , Wizadwongsa et al. Arxiv 2021 | |
NeRFactor: Neural Factorization of Shape and Reflectance Under an Unknown Illumination , Zhang et al. Arxiv 2021 | |
A Shading-Guided Generative Implicit Model for Shape-Accurate 3D-Aware Image Synthesis , Pan et al., NeurIPS 2021 | |
KiloNeuS: Implicit Neural Representations with Real-Time Global Illumination , Esposito et al., Arxiv 2022 |
NeRF++: Analyzing and Improving Neural Radiance Fields , Zhang et al., Arxiv 2020 | |
GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fields , Niemeyer et al., CVPR 2021,
Object-Centric Neural Scene Rendering , Guo et al., Arxiv 2020 |
Learning Compositional Radiance Fields of Dynamic Human Heads , Wang et al., Arxiv 2020 |
Neural Scene Graphs for Dynamic Scenes , Ost et al., CVPR 2021 |
Unsupervised Discovery of Object Radiance Fields , Yu et al., ICLR 2022 | |
Unsupervised Discovery and Composition of Object Light Fields , Smith et al., TMLR 2023 | |
Learning Object-centric Neural Scattering Functions for Free-viewpoint Relighting and Scene Composition , Yu et al., TMLR 2023 | |
Learning Object-Compositional Neural Radiance Field for Editable Scene Rendering , Yang et al., ICCV 2021 | |
MoFaNeRF: Morphable Facial Neural Radiance Field , Zhuang et al., Arxiv 2021 | |
In-Place Scene Labelling and Understanding with Implicit Scene Representation , Zhi et al., Arxiv 2021 |
NeRF-SOS: Any-view Self-supervised Object Segmentation on Complex Real-world Scenes , Fan et al., ICLR 2023 |
Contrastive Lift: 3D Object Instance Segmentation by Slow-Fast Contrastive Fusion , Bhalgat et al., NeurIPS 2023 ( ) |
Editing Conditional Radiance Fields , Liu et al., Arxiv 2021 | |
Editable Free-viewpoint Video Using a Layered Neural Representation , Zhang et al., SIGGRAPH 2021 | |
NeRF-In: Free-Form NeRF Inpainting with RGB-D Priors , Liu et al., Arxiv 2022 |
Unified Implicit Neural Stylization , Fan et al., ECCV 2022| |
CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fields , Wang et al., CVPR 2022| |
Local 3D Editing via 3D Distillation of CLIP Knowledge , Hyung et al., CVPR 2023| |
SINE: Semantic-driven Image-based NeRF Editing with Prior-guided Editing Field , Bao et al., CVPR 2023| |
General Neural Gauge Fields , Zhan et al., ICLR 2023| |
FiG-NeRF: Figure Ground Neural Radiance Fields for 3D Object Category Modelling , Xie et al., Arxiv 2021 |
NeRF-Tex: Neural Reflectance Field Textures , Baatz et al., EGSR 2021 |
Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fields , Barron et al., Arxiv 2021 | |
Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fields , Barron et al., Arxiv 2022 |
UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstruction , Oechsle et al., ICCV 2021 |
NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstruction , Wang et al., NeurIPS 2021 | |
Volume Rendering of Neural Implicit Surfaces , Yariv et al., NeurIPS 2021 | |
NeAT: Learning Neural Implicit Surfaces with Arbitrary Topologies from Multi-view Images , Meng et al., CVPR 2023 | |
NerfingMVS: Guided Optimization of Neural Radiance Fields for Indoor Multi-view Stereo , Wei et al., ICCV 2021 |
3D Neural Scene Representations for Visuomotor Control , Li et al., CoRL 2021 Oral |
Vision-Only Robot Navigation in a Neural Radiance World , Adamkiewicz et al., RA-L 2022 Vol.7 No.2 |
Differentiable Physics Simulation of Dynamics-Augmented Neural Objects , Le Cleac'h et al., RA-L 2023 |
Customizable Perturbation Synthesis for Robust SLAM Benchmarking , Xu et al., ArXiv 2024 |
Switch-NeRF: Learning Scene Decomposition with Mixture of Experts for Large-scale Neural Radiance Fields , Mi et al., ICLR 2023 | |
Block-NeRF: Scalable Large Scene Neural View Synthesis , Tancik et al., Arxiv 2022 |
NeRF-MAE: Masked AutoEncoders for Self-Supervised 3D Representation Learning for Neural Radiance Fields , Irshad et al., ECCV 2024 |
Ponder: Point Cloud Pre-training via Neural Rendering , Huang et al., ICCV 2023 |
PonderV2: Pave the Way for 3D Foundation Model with A Universal Pre-training Paradigm , Zhu et al., Arxiv 2023 | |
UniPAD: A Universal Pre-training Paradigm for Autonomous Driving , Yang et al., Arxiv 2023 | |

Awesome Neural Radiance Fields / Talks
NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis , Ben Mildenhall
Understanding and Extending Neural Radiance Fields , Barron et al
Towards Photorealism (2nd half) , Vladlen Koltun
Neural Radiance Fields for View Synthesis , Matthew Tancik

Awesome Neural Radiance Fields / Implementations
NeRF 10,030 over 1 year ago , Mildenhall et al., 2020 |
Nerual-Radiance-Fields , , , 2022
NeRF-PyTorch 5,557 over 1 year ago , Yen-Chen Lin, 2020 |
NeRF-PyTorch-Lighting 2,748 over 2 years ago , , 2020
NeRF-W 2,748 over 2 years ago , , 2021
NeRF-PyTorch3D 8,889 12 months ago , , 2020
JaxNeRF 34,478 11 months ago , Deng et al., 2020 |
Mip-NeRF 905 about 3 years ago , , 2021 |
[Jax + Flax] Minimal Implementation of NeRF , , , 2022
Visu3d 149 12 months ago , , 2022

Backlinks from these awesome lists:

More related projects: