Skip to content

🌟 A curate list of papers, datasets, and projects for 3D Reconstruction and Generation.

Notifications You must be signed in to change notification settings

PolySummit/Awesome-3D-Reconstruction-and-Generation

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

38 Commits
Β 
Β 
Β 
Β 

Repository files navigation

Awesome 3D Reconstruction and Generation

🌟 A curate list of papers, datasets, and projects for 3D Reconstruction and Generation.

❀️ Pull requests or issues for updates are very welcome.

πŸ“– Contents

🧊 3D Reconstruction

Feedforward Recon

Title Date Link Venue
MonoSplat: Generalizable 3D Gaussian Splatting from Monocular Depth Foundation Models 05/2025 code CVPR 2025
VGGT:Visual Geometry Grounded Transformer 03/2025 code CVPR 2025
MUSt3R: Multi-view Network for Stereo 3D Reconstruction 03/2025 CVPR 2025
Pow3R: Empowering Unconstrained 3D Reconstruction with Camera and Scene Priors 03/2025 CVPR 2025
FLARE: Feed-forward Geometry, Appearance and Camera Estimation from Uncalibrated Sparse Views 02/2025 code CVPR 2025
Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Pass 01/2025 code CVPR 2025
Continuous 3D Perception Model with Persistent State 01/2025 code CVPR 2025
Reloc3r: Large-Scale Training of Relative Camera Pose Regression for Generalizable, Fast, and Accurate Visual Localization 12/2024 code CVPR 2025
MV-DUSt3R+: Single-Stage Scene Reconstruction from Sparse Views In 2 Seconds 12/2024 code CVPR 2025
3D Reconstruction with Spatial Memory 08/2024 code 3DV 2025
Grounding Image Matching in 3D with MASt3R 06/2024 code Arxiv 2024
DUSt3R: Geometric 3D Vision Made Easy 12/2023 code CVPR 2024

Few-Shot Generative Recon

Title Date Link Venue
GenFusion: Closing the Loop between Reconstruction and Generation via Videos 03/2025 code CVPR 2025
Difix3D+: Improving 3D Reconstructions with Single-Step Diffusion Models 03/2025 CVPR 2025
Free360: Layered Gaussian Splatting for Unbounded 360-Degree View Synthesis from Extremely Sparse and Unposed Views 03/2025 CVPR 2025
LiftImage3D: Lifting Any Single Image to 3D Gaussians with Video Generation Priors 12/2024 code arXiv
MVSplat360: Feed-Forward 360 Scene Synthesis from Sparse Views 11/2024 code NeurIPS 2024
3DGS-Enhancer: Enhancing Unbounded 3D Gaussian Splatting with View-consistent 2D Diffusion Priors 10/2024 NeurIPS 2024
ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesis 09/2024 code arXiv
ReconX: Reconstruct Any Scene from Sparse Views with Video Diffusion Model 08/2024 arXiv

3D Recon-based SLAM & SFM

Title Date Link Venue
MP-SfM: Monocular Surface Priors for Robust Structure-from-Motion 04/2025 code CVPR 2025
MASt3R-SLAM: Real-Time Dense SLAM with 3D Reconstruction Priors 12/2024 code CVPR 2025
SLAM3R: Real-Time Dense Scene Reconstruction from Monocular RGB Videos 12/2024 code CVPR 2025
MASt3R-SfM: a Fully-Integrated Solution for Unconstrained Structure-from-Motion 09/2024 code CVPR 2025

🧸 Physical Object Generation

Title Date Link Venue
SOPHY: Generating Simulation-Ready Objects with PHYsical Materials 04/2025 project arXiv
PhysTwin: Physics-Informed Reconstruction and Simulation of Deformable Objects from Videos 03/2025 code arXiv
DreamPhysics: Learning Physics-Based 3D Dynamics with Video Diffusion Priors 12/2024 code AAAI 2025
PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generation 10/2024 code ECCV 2024
GIC: Gaussian-Informed Continuum for Physical Property Identification and Simulation 10/2024 code NeurIPS 2024
PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generation 09/2024 code ECCV 2024
Reconstruction and Simulation of Elastic Objects with Spring-Mass 3D Gaussians 07/2024 code ECCV 2024
Sync4D: Video Guided Controllable Dynamics for Physics-Based 4D Generation 07/2024 project arXiv
Physics3D: Learning Physical Properties of 3D Gaussians via Video Diffusion 06/2024 code arXiv

πŸ€– Articulated Object Generation and Reconstruction

Title Date Link Venue
Infinite Mobility: Scalable High-Fidelity Synthesis of Articulated Objects via Procedural Generation 03/2025 code arXiv
Articulate AnyMesh: Open-Vocabulary 3D Articulated Objects Modeling 02/2025 project arXiv
Articulate-Anything: Automatic Modeling of Articulated Objects via a Vision-Language Foundation Model 10/2024 code ICLR 2025
SINGAPO: Single Image Controlled Generation of Articulated Parts in Objects 10/2024 code ICLR 2025
CAGE: Controllable Articulation GEneration 03/2024 code CVPR 2024

πŸ•Ί Human Motion Generation

Human-Scene Interaction

Title Date Link Venue
ZeroHSI: Zero-Shot 4D Human-Scene Interaction by Video Generation 12/2024 project arXiv
Autonomous Character-Scene Interaction Synthesis from Text Instruction 10/2024 code SIGGRAPH Aisa 2024
Human-Object Interaction from Human-Level Instructions 06/2024 project arXiv
Generating Human Motion in 3D Scenes from Text Descriptions 05/2024 code CVPR 2024
Generating Human Interaction Motions in Scenes with Text Control 04/2024 code ECCV 2024
Controllable Human-Object Interaction Synthesis 12/2023 code ECCV 2024 oral
HUMANISE: Language-conditioned Human Motion Generation in 3D Scenes 10/2022 project NeurIPS 2022

🏠 Indoor Scene Layout Generation

Title Date Link Venue
LLM-driven Indoor Scene Layout Generation via Scaled Human-aligned Data Synthesis and Multi-Stage Preference Optimization 06/2025 project arXiv
LAYOUTVLM: Differentiable Optimization of 3D Layout via Vision-Language Models 12/2024 project CVPR 2025
LLplace: The 3D Indoor Scene Layout Generation and Editing via Large Language Model 06/2024 project arXiv
EchoScene: Indoor Scene Generation via Information Echo over Scene Graph Diffusion 05/2024 code ECCV 2024
I-Design: Personalized LLM Interior Designer 04/2024 code arXiv
InstructScene: Instruction-Driven 3D Indoor Scene Synthesis with Semantic Graph Prior 02/2024 code ICLR 2024
Holodeck: Language Guided Generation of 3D Embodied AI Environments 12/2023 code CVPR 2024
LayoutGPT: Compositional Visual Planning and Generation with Large Language Models 05/2023 code arXiv
DiffuScene: Denoising Diffusion Models for Generative Indoor Scene Synthesis 03/2023 code CVPR 2024
ATISS: Autoregressive Transformers for Indoor Scene Synthesis 10/2021 code NeurIPS 2021

🏠 Any-to-3D Scene

Title Date Link Venue
CAST: Component-Aligned 3D Scene Reconstruction from an RGB Image 06/2025 - SIGGRAPH (Best paper)

🌟 Star History

Star History Chart

About

🌟 A curate list of papers, datasets, and projects for 3D Reconstruction and Generation.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 8