Awesome Radiance Field-based 3D Editing
Curated by Weize Li ; Huan-ang Gao @AIR-DISCOVER Lab, and Tianshu Kuai @Université de Montréal & Mila
Welcome to awesome-nerf-editing🧙🏻♂️, your ultimate resource for exploring the exciting world of Radiance Fields Editing! Neural Fields is revolutionizing 3D computer vision and graphics, and this curated collection of resources is your gateway to understanding and mastering editing techniques.
🚨 Note: Please be aware that the acceptance status of papers might not be up-to-date.
💬 Feel free to open an Issue or a Pull Request if you find any missing papers!
🔥News
2024.08.05
Our survey Radiance Field-based 3D Editing: A Survey will be on arXiv soon!2024.08.01
Update acceptance status of previous arXiv papers.2023.08.21
We start to maintain this awesome list.
Table of Contents
🏆Seminal Papers
ECCV 2020 Oral
NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis | [Project Page]SIGGRAPH 2023
3D Gaussian Splatting for Real-Time Radiance Field Rendering | [Project Page]
💡Related Surveys
arXiv
3D Gaussian Splatting: Survey, Technologies, Challenges, and OpportunitiesarXiv
Recent Advances in 3D Gaussian SplattingarXiv
Advances in 3D Generation: A SurveyarXiv
A Survey on 3D Gaussian SplattingarXiv
3D Gaussian as a New Vision Era: A SurveyarXiv
Semantically-aware Neural Radiance Fields for Visual Scene Understanding: A Comprehensive ReviewEurographics 2022
Advances in Neural RenderingarXiv
Advances in 3D Neural Stylization: A SurveyEurographics 2021
Neural Fields in Visual Computing and BeyondarXiv
A Revisit of Shape Editing Techniques: from the Geometric to the Neural ViewpointarXiv
Text-guided Image-and-Shape Editing and Generation: A Short SurveyarXiv
Diffusion Model-Based Image Editing: A SurveyTPAMI 2023
Multimodal Image Synthesis and Editing: The Generative AI Era
🗃️Recent Research
[Latest Update: 2024/08/08☕]
- 2024
ECCV 2024
Watch Your Steps: Local Image and Scene Editing by Text Instructions | [Project Page]ECCV 2024
Feature Splatting: Language-Driven Physics-Based Scene Synthesis and Editing | [Project Page]ECCV 2024
Click-Gaussian: Interactive Segmentation to Any 3D Gaussians | [Project Page]ECCV 2024
3DEgo: 3D Editing on the Go! | [Project Page]ECCV 2024
Texture-GS: Disentangling the Geometry and Texture for 3D Gaussian Splatting Editing | [Project Page]ECCV 2024
Taming Latent Diffusion Model for Neural Radiance Field Inpainting | [Project Page]ECCV 2024
Freditor: High-Fidelity and Transferable NeRF Editing by Frequency Decomposition | [Project Page]ECCV 2024
GScream: Learning 3D Geometry and Feature Consistent Gaussian Splatting for Object Removal | [Project Page]ECCV 2024
Gaussian Frosting: Editable Complex Radiance Fields with Real-Time Rendering | [Project Page]ECCV 2024
DATENeRF: Depth-Aware Text-based Editing of NeRFs | [Project Page]ECCV 2024
Street Gaussians for Modeling Dynamic Urban Scenes | [Project Page]ECCV 2024
Gaussian Grouping: Segment and Edit Anything in 3D Scenes | [Project Page]ECCV 2024
View-Consistent 3D Editing with Gaussian Splatting | [Project Page]ECCV 2024
Real-time 3D-aware Portrait Editing from a Single Image | [Project Page]ECCV 2024
StyleCity: Large-Scale 3D Urban Scenes Stylization with Vision-and-Text Reference via Progressive Optimization | [Project Page]ECCV 2024
LatentEditor: Text Driven Local Editing of 3D Scenes | [Project Page]ECCV 2024
Free-Editor: Zero-shot Text-driven 3D Scene Editing | [Project Page]ECCV 2024
DatasetNeRF: Efficient 3D-aware Data Factory with Generative Radiance Fields | [Project Page]ECCV 2024
GaussCtrl: Multi-View Consistent Text-Driven 3D Gaussian Splatting Editing | [Project Page]ECCV 2024
Reconstruction and Simulation of Elastic Objects with Spring-Mass 3D Gaussians | [Project Page]ECCV 2024
Chat-Edit-3D: Interactive 3D Scene Editing via Text Prompts | [Project Page]ECCV 2024
GeometrySticker: Enabling Ownership Claim of Recolorized Neural Radiance Fields | [Project Page]CVPR 2024 Highlight
TutteNet: Injective 3D Deformations by Composition of 2D Mesh Deformations | [Project Page]CVPR 2024 Highlight
PAPR in Motion: Seamless Point-level 3D Scene Interpolation | [Project Page]CVPR 2024 Highlight
Editable Scene Simulation for Autonomous Driving via Collaborative LLM-Agents | [Project Page]CVPR 2024
GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splatting | [Project Page]CVPR 2024
GaussianEditor: Editing 3D Gaussians Delicately with Text Instructions | [Project Page]CVPR 2024
PIE-NeRF: Physics-based Interactive Elastodynamics with NeRF | [Project Page]CVPR 2024
PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamics | [Project Page]CVPR 2024
SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Rendering | [Project Page]CVPR 2024
Neural 3D Strokes: Creating Stylized 3D Scenes with Vectorized 3D Strokes | [Project Page]CVPR 2024
Posterior Distillation Sampling | [Project Page]CVPR 2024
SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenes | [Project Page]CVPR 2024
NeRFiller: Completing Scenes via Generative 3D Inpainting | [Project Page]CVPR 2024
DrivingGaussian: Composite Gaussian Splatting for Surrounding Dynamic Autonomous Driving Scenes | [Project Page]CVPR 2024
LAENeRF: Local Appearance Editing for Neural Radiance Fields | [Project Page]CVPR 2024
NeRF Analogies: Example-Based Visual Attribute Transfer for NeRFs | [Project Page]CVPR 2024
Control4D: Efficient 4D Portrait Editing with Text | [Project Page]CVPR 2024
Dynamic LiDAR Re-simulation using Compositional Neural Fields | [Project Page]CVPR 2024
SHAP-EDITOR: Instruction-guided Latent 3D Editing in Seconds | [Project Page]CVPR 2024
Customize your NeRF: Adaptive Source Driven 3D Scene Editing via Local-Global Iterative Training | [Project Page]CVPR 2024
SIGNeRF: Scene Integrated Generation for Neural Radiance Fields | [Project Page]CVPR 2024
Geometry Transfer for Stylizing Radiance Fields | [Project Page]CVPR 2024
DynVideo-E: Harnessing Dynamic NeRF for Large-Scale Motion- and View-Change Human-Centric Video Editing | [Project Page]CVPR 2024
BerfScene: Bev-conditioned Equivariant Radiance Fields for Infinite 3D Scene Generation | [Project Page]CVPR 2024
CoGS: Controllable Gaussian Splatting | [Project Page]CVPR 2024
InNeRF360: Text-Guided 3D-Consistent Object Inpainting on Unbounded Neural Radiance Fields | [Project Page]CVPR 2024
Feature 3DGS: Supercharging 3D Gaussian Splatting to Enable Distilled Feature Fields | [Project Page]- `CVPR