awesome-NeRF

NRF papers

A curated collection of papers on Neural Radiance Fields, a technique for representing and rendering 3D scenes in a more efficient and realistic way.

A curated list of awesome neural radiance fields papers

GitHub

7k stars
238 watching
598 forks
Language: TeX
last commit: almost 2 years ago
Linked from 2 awesome lists

nerf

Awesome Neural Radiance Fields / Survey

Semantically-aware Neural Radiance Fields for Visual Scene Understanding: A Comprehensive Review, Thang-Anh-Quan Nguyen*, Amine Bourki*, Màtyàs Macudzinski, Anthony Brunel, and Mohammed Bennamoun (*: Equal contribution), Arxiv 2024 | |
BeyondPixels: A Comprehensive Review of the Evolution of Neural Radiance Fields, AKM Shahariar Azad Rabby and Chengcui Zhang, Arxiv 2023 |
Neural Volume Rendering: NeRF And Beyond, Dellaert and Yen-Chen, Arxiv 2020 | | |
NeRF: Neural Radiance Field in 3D Vision, Introduction and Review, Kyle Gao, Yina Gao, Hongjie He, Dening Lu, Linlin Xu, Jonathan Li
Neural Fields in Robotics: A Survey, Muhammad Zubair Irshad, Mauro Comi, Yen-Chen Lin, Nick Heppert, Abhinav Valada, Zsolt Kira, Rares Ambrus, Johnathan Trembley

Awesome Neural Radiance Fields / Papers

NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis, Mildenhall et al., ECCV 2020 | |
Learning Neural Transmittance for Efficient Rendering of Reflectance Fields, Mohammad Shafiei et al., BMVC 2021 |
Neural Sparse Voxel Fields, Liu et al., NeurIPS 2020 | |
AutoInt: Automatic Integration for Fast Neural Volume Rendering, Lindell et al., CVPR 2021 | |
DeRF: Decomposed Radiance Fields, Rebain et al. Arxiv 2020 |
DONeRF: Towards Real-Time Rendering of Compact Neural Radiance Fields using Depth Oracle Networks, Neff et al., CGF 2021 | |
FastNeRF: High-Fidelity Neural Rendering at 200FPS, Garbin et al., Arxiv 2021 |
KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPs, Reiser et al., ICCV 2021 | |
PlenOctrees for Real-time Rendering of Neural Radiance Fields, Yu et al., Arxiv 2021 | |
Mixture of Volumetric Primitives for Efficient Neural Rendering, Lombardi et al., SIGGRAPH 2021 |
Light Field Networks: Neural Scene Representations with Single-Evaluation Rendering, Sitzmann et al., Arxiv 2021 | |
RT-NeRF: Real-Time On-Device Neural Radiance Fields Towards Immersive AR/VR Rendering, Li et al., ICCAD 2022 |
ENeRF: Efficient Neural Radiance Fields for Interactive Free-viewpoint Video, Lin et al., SIGGRAPH 2022 | |
R2L: Distilling Neural Radiance Field to Neural Light Field for Efficient Novel View Synthesis, Wang et al., ECCV 2022 | |
Real-Time Neural Light Field on Mobile Devices, Cao et al., Arxiv 2022 | |
Hardware Acceleration of Neural Graphics, Mubarik et al., ISCA 2023 |
DyLiN: Making Light Field Networks Dynamic, Yu et al., CVPR 2023 | |
Depth-supervised NeRF: Fewer Views and Faster Training for Free, Deng et al., Arxiv 2021 | |
Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstruction, Sun et al., CVPR 2022 | |
Instant Neural Graphics Primitives with a Multiresolution Hash Encoding, Müller et al., SIGGRAPH 2022 | |
Plenoxels Radiance Fields without Neural Networks, Yu et al., CVPR 2022 | |
TensoRF: Tensorial Radiance Fields, Chen et al., ECCV 2022 | |
BakedSDF: Meshing Neural SDFs for Real-Time View Synthesis, Yariv et al., Arxiv 2023 |
Lightning NeRF: Efficient Hybrid Scene Representation for Autonomous Driving, Cao et al. ICRA 2024 | |
Variable Bitrate Neural Fields, Takikawa et al., SIGGRAPH 2022 | |
NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collections, Martin-Brualla et al., CVPR 2021 |
Ha-NeRF: Hallucinated Neural Radiance Fields in the Wild, Chen et al., CVPR 2022 | |
HDR-Plenoxels: Self-Calibrating High Dynamic Range Radiance Fields, Jun-seong et al., ECCV 2022 | |
UP-NeRF: Unconstrained Pose-Prior-Free Neural Radiance Fields, In-jae et al., NeurIPS 2023 | |
Deformable Neural Radiance Fields, Park et al., Arxiv 2020 | |
D-NeRF: Neural Radiance Fields for Dynamic Scenes, Pumarola et al., CVPR 2021 | |
Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstruction, Gafni et al., CVPR 2021 | |
Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Deforming Scene from Monocular Video, Tretschk et al., Arxiv 2020 | |
PVA: Pixel-aligned Volumetric Avatars, Raj et al., CVPR 2021 |
Neural Articulated Radiance Field150over 4 years ago, Noguchi et al., Arxiv 2021 | |
CLA-NeRF: Category-Level Articulated Neural Radiance Field, Tseng et al., ICRA 2022 |
Animatable Neural Radiance Fields for Modeling Dynamic Human Bodies, Peng et al., ICCV 2021 | |
A Higher-Dimensional Representation for Topologically Varying Neural Radiance Fields, Park et al., Arxiv 2021 | |
IBRNet: Learning Multi-View Image-Based Rendering, Wang et al., CVPR 2021 | |
Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenes, Li et al., CVPR 2021 | |
Animatable Neural Radiance Fields from Monocular RGB Videos, Chen et al., Arxiv 2021 | |
Neural Actor: Neural Free-view Synthesis of Human Actors with Pose Control, Liu et al., SIGGRAPH Asia 2021 |
TiNeuVox: Fast Dynamic Radiance Fields with Time-Aware Neural Voxels, Fang et al., SIGGRAPH Asia 2022 | |
HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Video, Weng et al., CVPR 2022 | |
AligNeRF: High-Fidelity Neural Radiance Fields via Alignment-Aware Training, Jiang et al., CVPR 2023 |
DynIBaR: Neural Dynamic Image-Based Rendering, Li et al., CVPR 2023 |
BundleSDF: Neural 6-DoF Tracking and 3D Reconstruction of Unknown Objects, Wen et al., CVPR 2023 | |
Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenes, Li et al., CVPR 2021 | |
Space-time Neural Irradiance Fields for Free-Viewpoint Video, Xian et al., CVPR 2021 |
Neural Radiance Flow for 4D View Synthesis and Video Processing, Du et al., Arxiv 2020 |
Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humans, Peng et al., CVPR 2021 | |
UV Volumes for Real-time Rendering of Editable Free-view Human Performance, Chen et al., CVPR 2023 | |
Neural 3D Video Synthesis from Multi-view Video, Li et al., CVPR 2022 |
Dynamic View Synthesis from Dynamic Monocular Video, Gao et al., ICCV 2021 |
Streaming Radiance Fields for 3D Video SynthesisLi et al. NeurIPS 2022 | |
GRAF: Generative Radiance Fields for 3D-Aware Image Synthesis, Schwarz et al., NeurIPS 2020 | |
GRF: Learning a General Radiance Field for 3D Scene Representation and Rendering, Trevithick and Yang, Arxiv 2020 | |
pixelNeRF: Neural Radiance Fields from One or Few Images, Yu et al., CVPR 2021 | |
Learned Initializations for Optimizing Coordinate-Based Neural Representations, Tancik et al., CVPR 2021 | |
pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesis, Chan et al., CVPR 2021 |
Portrait Neural Radiance Fields from a Single Image, Gao et al., Arxiv 2020 |
ShaRF: Shape-conditioned Radiance Fields from a Single View, Rematas et al., ICML 2021 |
IBRNet: Learning Multi-View Image-Based Rendering, Wang et al., CVPR 2021 | |
CAMPARI: Camera-Aware Decomposed Generative Neural Radiance Fields, Niemeyer & Geiger, Arxiv 2021 |
NeRF-VAE: A Geometry Aware 3D Scene Generative Model, Kosiorek et al., Arxiv 2021 |
Unconstrained Scene Generation with Locally Conditioned Radiance Fields, DeVries et al., Arxiv 2021 |
MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereo, Chen et al., ICCV 2021 | |
Stereo Radiance Fields (SRF): Learning View Synthesis from Sparse Views of Novel Scenes, Chibane et al., CVPR 2021 |
Neural Rays for Occlusion-aware Image-based Rendering, Liu et al., Arxiv 2021 |
Putting NeRF on a Diet: Semantically Consistent Few-Shot View Synthesis, Matthew Tancik et al., Arxiv 2021 |
MINE: Towards Continuous Depth MPI with NeRF for Novel View Synthesis, Jiaxin Li et al., ICCV 2021 | |
TöRF: Time-of-Flight Radiance Fields for Dynamic Scene View Synthesis, Benjamin Attal et al., NeurIPS 2021 |
CodeNeRF: Disentangled Neural Radiance Fields for Object Categories, Jang et al., ICCV 2021 |
StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesis, Gu et al., Arxiv 2021 |
Generative Occupancy Fields for 3D Surface-Aware Image Synthesis, Xu et al., NeurIPS 2021 | |
NeRF in the Dark: High Dynamic Range View Synthesis from Noisy Raw Images, Ben Mildenhall et al, arXiv 2021 |
Point-NeRF: Point-based Neural Radiance Fields, Xu et al., CVPR 2022 | |
SinNeRF: Training Neural Radiance Fields on Complex Scenes from a Single Image, Xu et al., ECCV 2022 | |
Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusion, Wang et al., CVPR 2023 | |
SurfelNeRF: Neural Surfel Radiance Fields for Online Photorealistic Reconstruction of Indoor Scenes, Gao et al., CVPR 2023 | |
NeO 360: Neural Fields for Sparse View Synthesis of Outdoor Scenes, Irshad et al., ICCV 2023 | |
X-NeRF: Explicit Neural Radiance Field for Multi-Scene 360° Insufficient RGB-D Views, Zhu et al., WACV 2023 | |
UFORecon: Generalizable Sparse-View Surface Reconstruction from Arbitrary and Unfavorable Sets, Na et al., CVPR 2024 | |
🏡Know Your Neighbors: Improving Single-View Reconstruction via Spatial Vision-Language Reasoning, Li et al., CVPR 2024 | |
BundleSDF: Neural 6-DoF Tracking and 3D Reconstruction of Unknown Objects, Wen et al., CVPR 2023 | |
iNeRF: Inverting Neural Radiance Fields for Pose Estimation, Yen-Chen et al. IROS 2021 |
A-NeRF: Surface-free Human 3D Pose Refinement via Neural Rendering, Su et al. Arxiv 2021 |
NeRF--: Neural Radiance Fields Without Known Camera Parameters, Wang et al., Arxiv 2021 | |
iMAP: Implicit Mapping and Positioning in Real-Time, Sucar et al., ICCV 2021 |
NICE-SLAM: Neural Implicit Scalable Encoding for SLAM, Zhu et al., Arxiv 2021 |
GNeRF: GAN-based Neural Radiance Field without Posed Camera, Meng et al., Arxiv 2021 |
BARF: Bundle-Adjusting Neural Radiance Fields, Lin et al., ICCV 2021 |
Self-Calibrating Neural Radiance Fields, Jeong et al., ICCV 2021 | |
DFNet: Enhance Absolute Pose Regression with Direct Feature Matching, Chen et al., ECCV 2022 | |
GARF: Gaussian Activated Radiance Fields for High Fidelity Reconstruction and Pose Estimation, Chng et al., ECCV 2022 |
L2G-NeRF: Local-to-Global Registration for Bundle-Adjusting Neural Radiance Fields, Chen et al., CVPR 2023 | |
NoPe-NeRF: Optimising Neural Radiance Field with No Pose Prior, Bian et al., CVPR 2023 | |
Loc-NeRF: Monte Carlo Localization using Neural Radiance Fields, Maggio et al., ICRA 2023 | |
Robust Camera Pose Refinement for Multi-Resolution Hash Encoding, Heo et al., ICML 2023 |
CROSSFIRE: Camera Relocalization On Self-Supervised Features from an Implicit Representation, Moreau et al., ICCV 2023 |
PoRF: Pose Residual Field for Accurate Neural Surface Reconstruction, Bian et al., ICLR 2024 | |
Neural Refinement for Absolute Pose Regression with Feature Synthesis, Chen et al., CVPR 2024 | |
NeRD: Neural Reflectance Decomposition from Image Collections, Boss et al., Arxiv 2020 | |
NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesis, Srinivasan et al. CVPR 2021 |
NeX: Real-time View Synthesis with Neural Basis Expansion, Wizadwongsa et al. Arxiv 2021 | |
NeRFactor: Neural Factorization of Shape and Reflectance Under an Unknown Illumination, Zhang et al. Arxiv 2021 | |
A Shading-Guided Generative Implicit Model for Shape-Accurate 3D-Aware Image Synthesis, Pan et al., NeurIPS 2021 | |
KiloNeuS: Implicit Neural Representations with Real-Time Global Illumination, Esposito et al., Arxiv 2022 |
NeRF++: Analyzing and Improving Neural Radiance Fields, Zhang et al., Arxiv 2020 | |
GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fields, Niemeyer et al., CVPR 2021,
Object-Centric Neural Scene Rendering, Guo et al., Arxiv 2020 |
Learning Compositional Radiance Fields of Dynamic Human Heads, Wang et al., Arxiv 2020 |
Neural Scene Graphs for Dynamic Scenes, Ost et al., CVPR 2021 |
Unsupervised Discovery of Object Radiance Fields, Yu et al., ICLR 2022 | |
Unsupervised Discovery and Composition of Object Light Fields, Smith et al., TMLR 2023 | |
Learning Object-centric Neural Scattering Functions for Free-viewpoint Relighting and Scene Composition, Yu et al., TMLR 2023 | |
Learning Object-Compositional Neural Radiance Field for Editable Scene Rendering, Yang et al., ICCV 2021 | |
MoFaNeRF: Morphable Facial Neural Radiance Field, Zhuang et al., Arxiv 2021 | |
In-Place Scene Labelling and Understanding with Implicit Scene Representation, Zhi et al., Arxiv 2021 |
NeRF-SOS: Any-view Self-supervised Object Segmentation on Complex Real-world Scenes, Fan et al., ICLR 2023 |
Contrastive Lift: 3D Object Instance Segmentation by Slow-Fast Contrastive Fusion, Bhalgat et al., NeurIPS 2023 ( ) |
Editing Conditional Radiance Fields, Liu et al., Arxiv 2021 | |
Editable Free-viewpoint Video Using a Layered Neural Representation, Zhang et al., SIGGRAPH 2021 | |
NeRF-In: Free-Form NeRF Inpainting with RGB-D Priors, Liu et al., Arxiv 2022 |
Unified Implicit Neural Stylization, Fan et al., ECCV 2022| |
CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fields, Wang et al., CVPR 2022| |
Local 3D Editing via 3D Distillation of CLIP Knowledge, Hyung et al., CVPR 2023| |
SINE: Semantic-driven Image-based NeRF Editing with Prior-guided Editing Field, Bao et al., CVPR 2023| |
General Neural Gauge Fields, Zhan et al., ICLR 2023| |
FiG-NeRF: Figure Ground Neural Radiance Fields for 3D Object Category Modelling, Xie et al., Arxiv 2021 |
NeRF-Tex: Neural Reflectance Field Textures, Baatz et al., EGSR 2021 |
Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fields, Barron et al., Arxiv 2021 | |
Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fields, Barron et al., Arxiv 2022 |
UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstruction, Oechsle et al., ICCV 2021 |
NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstruction, Wang et al., NeurIPS 2021 | |
Volume Rendering of Neural Implicit Surfaces, Yariv et al., NeurIPS 2021 | |
NeAT: Learning Neural Implicit Surfaces with Arbitrary Topologies from Multi-view Images, Meng et al., CVPR 2023 | |
NerfingMVS: Guided Optimization of Neural Radiance Fields for Indoor Multi-view Stereo, Wei et al., ICCV 2021 |
3D Neural Scene Representations for Visuomotor Control, Li et al., CoRL 2021 Oral |
Vision-Only Robot Navigation in a Neural Radiance World, Adamkiewicz et al., RA-L 2022 Vol.7 No.2 |
Differentiable Physics Simulation of Dynamics-Augmented Neural Objects, Le Cleac'h et al., RA-L 2023 |
Customizable Perturbation Synthesis for Robust SLAM Benchmarking, Xu et al., ArXiv 2024 |
Switch-NeRF: Learning Scene Decomposition with Mixture of Experts for Large-scale Neural Radiance Fields, Mi et al., ICLR 2023 | |
Block-NeRF: Scalable Large Scene Neural View Synthesis, Tancik et al., Arxiv 2022 |
NeRF-MAE: Masked AutoEncoders for Self-Supervised 3D Representation Learning for Neural Radiance Fields, Irshad et al., ECCV 2024 |
Ponder: Point Cloud Pre-training via Neural Rendering, Huang et al., ICCV 2023 |
PonderV2: Pave the Way for 3D Foundation Model with A Universal Pre-training Paradigm, Zhu et al., Arxiv 2023 | |
UniPAD: A Universal Pre-training Paradigm for Autonomous Driving, Yang et al., Arxiv 2023 | |

Awesome Neural Radiance Fields / Talks

NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis, Ben Mildenhall
Understanding and Extending Neural Radiance Fields, Barron et al
Towards Photorealism (2nd half), Vladlen Koltun
Neural Radiance Fields for View Synthesis, Matthew Tancik

Awesome Neural Radiance Fields / Implementations

NeRF10,030about 2 years ago, Mildenhall et al., 2020 |
Nerual-Radiance-Fields, , , 2022
NeRF-PyTorch5,557about 2 years ago, Yen-Chen Lin, 2020 |
NeRF-PyTorch-Lighting2,748about 3 years ago, , 2020
NeRF-W2,748about 3 years ago, , 2021
NeRF-PyTorch3D8,889almost 2 years ago, , 2020
JaxNeRF34,478almost 2 years ago, Deng et al., 2020 |
Mip-NeRF905almost 4 years ago, , 2021 |
[Jax + Flax] Minimal Implementation of NeRF, , , 2022
Visu3d149almost 2 years ago, , 2022

Backlinks from these awesome lists:

More related projects: