Skip to content

BaiShuanghao/Awesome-Robotics-Manipulation

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

76 Commits
 
 
 
 
 
 

Repository files navigation

Awesome-Robotics-Manipulation

✨ About

This repository curates research papers on robot manipulation, featuring a smaller collection of non-learning control methods and a larger body of learning-based approaches.

This repository will be continuously updated, and we warmly welcome contributions from the community. If you have papers, projects, or resources that are not yet included, please feel free to submit them via a pull request, open an issue for discussion or email us to add papers!

📢 News

Our comprehensive survey is in progress—stay tuned for updates!

  • [2025/08] Major revision of the classification system with a more refined taxonomy; substantial improvements across all sections.
  • [2025/07] Expanded coverage of Dexterous, Soft Robotic, Mobile, Quadrupedal, and Humanoid Manipulation; refined the categorization and content for Awesome Simulators, Benchmarks, and Datasets,added non-learning-based control methods.
  • [2025/06] Introduced new sections on Grasp in Cluttered Scenes, Quadrupedal and Humanoid Manipulation, and Learning from Human Demonstrations. Also improved the classification of the Applications section and added a subsection on Embodied QA Datasets.
  • [2025/02] Added a new section on Bimanual Grasp.
  • [2024/12] Introduced coverage of Dexterous Grasp.
  • [2024/10] Repository is now public!

🏠 Table of Contents

📝 Awesome Papers

📄 Survey

Title Venue Date Code Notes
VLA Models
Large VLM-based Vision-Language-Action Models for Robotic Manipulation: A Survey arXiv 2025-08-23 Star Github VLA Models
Survey of Vision-Language-Action Models for Embodied Manipulation arXiv 2025-08-21 - VLA Models
Vision Language Action Models in Robotic Manipulation: A Systematic Review arXiv 2025-07-14 - VLA Models
A Survey on Vision-Language-Action Models: An Action Tokenization Perspective arXiv 2025-07-02 - VLA Models
Parallels Between VLA Model Post-Training and Human Motor Learning: Progress, Challenges, and Trends arXiv 2025-05-26 Star Github VLA Models
Vision-Language-Action Models: Concepts, Progress, Applications and Challenges arXiv 2025-05-07 - VLA Models
A Survey on Vision-Language-Action Models for Embodied AI arXiv 2024-05-23 - VLA Models
Dexterous Manipulation
The Developments and Challenges towards Dexterous and Embodied Robotic Manipulation: A Survey arXiv 2025-07-16 - Dexterous Manipulation
Interactive Imitation Learning for Dexterous Robotic Manipulation: Challenges and Perspectives -- A Survey arXiv 2025-06-30 - Dexterous Manipulation
Dexterous Manipulation through Imitation Learning: A Survey arXiv 2025-04-04 - Dexterous Manipulation
Deformable Object Manipulation (DOM)
T-DOM: A Taxonomy for Robotic Manipulation of Deformable Objects arXiv 2024-12-30 Project DOM
A Survey on Robotic Manipulation of Deformable Objects: Recent Advances, Open Challenges and New Frontiers arXiv 2023-12-16 - DOM
Robotic manipulation and sensing of deformable objects in domestic and industrial applications: a survey IJRR 2018 2018-06-13 - DOM
Humanoid Manipulation
Humanoid Locomotion and Manipulation: Current Progress and Challenges in Control, Planning, and Learning arXiv 2025-01-03 - Humanoid Manipulation
Teleoperation of Humanoid Robots: A Survey T-RO 2024 2023-01-11 Project Humanoid
Others
A Survey of Robotic Navigation and Manipulation with Physics Simulators in the Era of Embodied AI arXiv 2025-05-01 - Navigation and Manipulation
Diffusion Models for Robotic Manipulation: A Survey arXiv 2025-04-11 - Manipulation + DP
Multimodal Fusion and Vision-Language Models: A Survey for Robot Vision arXiv 2025-04-03 Star Github Robot Vision
Generative Artificial Intelligence in Robotic Manipulation: A Survey arXiv 2025-03-05 Star Github Manipulation + Generative Models
A Survey of Embodied Learning for Object-Centric Robotic Manipulation MIR 2025 2024-08-21 Star Github Manipulation + Object-Centric
Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AI arXiv 2024-07-09 Star Github Embodied Agent
Survey of Learning-based Approaches for Robotic In-Hand Manipulation arXiv 2024-01-15 - In-hand Manipulation
Language-conditioned Learning for Robotic Manipulation: A Survey arXiv 2023-12-17 Star Github Manipulation
Deep Learning Approaches to Grasp Synthesis: A Review T-RO 2023 2023-07-06 Project Grasp
A Survey of Wheeled Mobile Manipulation: A Decision Making Perspective J. Mech. Robot. 2023 2023-04 - Mobile Manipulation
A Review of Soft Manipulator Research, Applications, and Opportunities J Field Robot. 2023 2023-04 - Soft Manipulator

(back to top)

Note: Other papers are summarized in the Contents.

📊 Awesome Simulators, Benchmarks and Dataset

Grasp Datasets

Title Venue Date Code
Rectangle-based Grasp
Grasp-Anything-6D: Language-Driven 6-DoF Grasp Detection Using Negative Prompt Guidance ECCV 2024 2024-07-18 Star Github
Grasp-Anything++: Language-driven Grasp Detection CVPR 2024 2024-06-13 Star Github
Grasp-Anything: Large-scale Grasp Dataset from Foundation Models ICRA 2024 2023-09-18 Star Github
REGRAD: A Large-Scale Relational Grasp Dataset for Safe and Object-Specific Robotic Grasping in Clutter ICRA 2021 2021-04-29 Star Github
Jacquard: A Large Scale Dataset for Robotic Grasp Detection IROS 2018 2018-03-30 Project
Cornell: Efficient Grasping from RGBD Images: Learning Using a New Rectangle Representation ICRA 2011 2011-08 -
6-DoF Grasp
MapleGrasp: Mask-guided Feature Pooling for Language-driven Efficient Robotic Grasping arXiv 2025-06-06 -
GraspClutter6D: A Large-scale Real-world Dataset for Robust Perception and Grasping in Cluttered Scenes arXiv 2025-04-09 Project
QDGset: A Large Scale Grasping Dataset Generated with Quality-Diversity arXiv 2024-10-03 Project
Real-to-Sim Grasp: Rethinking the Gap between Simulation and Real World in Grasp Detection CoRL 2024 2024-10-09 Project
MetaGraspNetV2: All-in-One Dataset Enabling Fast and Reliable Robotic Bin Picking via Object Relationship Reasoning and Dexterous Grasping TASE 2023 2023-11-06 Star Github
MetaGraspNet: A Large-Scale Benchmark Dataset for Scene-Aware Ambidextrous Bin Picking via Physics-based Metaverse Synthesis CASE 2022 2022-08-08 Star Github
ACRONYM: A Large-Scale Grasp Dataset Based on Simulation ICRA 2021 2020-11-18 Star Github
GraspNet-1Billion: A Large-Scale Benchmark for General Object Grasping CVPR 2020 2020-08-05 Star Github
Dexterous Grasp
Dex1B: Learning with 1B Demonstrations for Dexterous Manipulation RSS 2025 2025-06-20 Project
DexGraspNet 2.0: Learning Generative Dexterous Grasping in Large-scale Synthetic Cluttered Scenes CoRL 2024 2024 Star Github
UniFucGrasp: Human-Hand-Inspired Unified Functional Grasp Annotation Strategy and Dataset for Diverse Dexterous Hands arXiv 2025-08-05 Star Github
DexGraspNet: A Large-Scale Robotic Dexterous Grasp Dataset for General Objects Based on Simulation ICRA 2023 2022-10-06 Star Github

(back to top)

Single-Embodiment Manipulation Simulators and Benchmarks

Title Venue Date Code
Basic Manipulation with a Single Arm
LADEV: A Language-Driven Testing and Evaluation Platform for Vision-Language-Action Models in Robotic Manipulation arXiv 2024-10-07 -
RoboCAS: A Benchmark for Robotic Manipulation in Complex Object Arrangement Scenarios arXiv 2024-07-09 Star Github
GenSim2: Scaling Robot Data Generation with Multi-modal and Reasoning LLMs CoRL 2024 2024-10-04 Star Github
FetchBench: A Simulation Benchmark for Robot Fetching CoRL 2024 2024-06-17 Star Github
SIMPLER: Evaluating Real-World Robot Manipulation Policies in Simulation CoRL 2024 2024-05-09 Star Github
Towards Diverse Behaviors: A Benchmark for Imitation Learning with Human Demonstrations ICLR 2024 2024-02-22 Star Github
LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learning NeurIPS 2023 2023-06-05 Star Github
ARNOLD: A Benchmark for Language-Grounded Task Learning With Continuous States in Realistic 3D Scenes ICCV 2023 2023-04-09 Star Github
VIMA: General Robot Manipulation with Multimodal Prompts ICML 2023 2022-10-06 Star Github
ManiSkill2: A Unified Benchmark for Generalizable Manipulation Skills ICLR 2023 2023-02-09 Star Github
Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulation CoRL 2022 2022-11-11 Star Github
VLMbench: A Compositional Benchmark for Vision-and-Language Manipulation NeurIPS 2022 2022-06-17 Star Github
ManiSkill: Generalizable Manipulation Skill Benchmark with Large-Scale Demonstrations NeurIPS D&B 2021 2021-07-30 Star Github
Robomimic: What Matters in Learning from Offline Human Demonstrations for Robot Manipulation CoRL 2021 2021-08-06 Star Github
RLBench: The Robot Learning Benchmark & Learning Environment RA-L 2020 2019-09-26 Star Github
Franka-Kitchen: Relay Policy Learning: Solving Long-Horizon Tasks via Imitation and Reinforcement Learning CoRL 2019 2019-10-25 Project
Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learning CoRL 2019 2019-10-24 Star Github
Basic Manipulation with Bimanual Arms
RoboEval: Where Robotic Manipulation Meets Structured and Scalable Evaluation arXiv 2025-07-01 Star Github
RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulation arXiv 2025-06-22 Star Github
RoboTwin: Dual-Arm Robot Benchmark with Generative Digital Twins CVPR 2025 2025-04-17 Star Github
PerAct2: Benchmarking and Learning for Robotic Bimanual Manipulation Tasks CoRLW 2024 2024-07-29 Star Github
Basic Manipulation with Long-horizon Tasks
RoboCerebra: A Large-scale Benchmark for Long-horizon Robotic Manipulation Evaluation arXiv 2025-06-07 Project
MuBlE: MuJoCo and Blender simulation Environment and Benchmark for Task Planning in Robot Manipulation arXiv 2025-03-03 Star Github
VLABench: A Large-Scale Benchmark for Language-Conditioned Robotics Manipulation with Long-Horizon Reasoning Tasks arXiv 2024-12-24 Star Github
FurnitureBench: Reproducible Real-World Benchmark for Long-Horizon Complex Manipulation RSS 2023 2023-05-22 Star Github
CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Tasks RA-L 2022 2021-12-06 Star Github
Panda-gym: Open-source Goal-conditioned Environments for Robotic Learning NeurIPSW 2021 2021-06-25 Star Github
IKEA Furniture Assembly Environment for Long-Horizon Complex Manipulation Tasks ICRA 2021 2019-11-17 Star Github
Basic Manipulation with Generalization Tasks
INT-ACT: From Intention to Execution: Probing the Generalization Boundaries of Vision-Language-Action Models arXiv 2025-06-11 Star Github
AGNOSTOS: Exploring the Limits of Vision-Language-Action Manipulations in Cross-task Generalization arXiv 2025-05-21 Star Github
Gembench: Towards Generalizable Vision-Language Robotic Manipulation: A Benchmark and LLM-guided 3D Policy ICRA 2025 2024-10-02 Star Github
THE COLOSSEUM: A Benchmark for Evaluating Generalization for Robotic Manipulation RSSW 2024 2024-02-13 Star Github
KitchenShift: Evaluating Zero-Shot Generalization of Imitation-Based Policy Learning Under Domain Shifts NeurIPSW 2021 2021 Star Github
Basic Manipulation in Real World
AutoEval: Autonomous Evaluation of Generalist Robot Manipulation Policies in the Real World arXiv 2025-03-31 Star Github
Basic Manipulation with High-level Planner
GENMANIP: LLM-driven Simulation for Generalizable Instruction-Following Manipulation CVPR 2025 2025-06-12 Star Github
ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Tasks CVPR 2020 2019-12-03 Star Github
Basic Manipulation with Tactile Representations
ManiFeel: Benchmarking and Understanding Visuotactile Manipulation Policy Learning arXiv 2025-05-24 Project
TacCompress: A Benchmark for Multi-Point Tactile Data Compression in Dexterous Manipulation arXiv 2025-05-22 -
TacSL: A Library for Visuotactile Sensor Simulation and Learning T-RO 2025 2024-08-12 Star Github
Efficient Tactile Simulation with Differentiability for Robotic Manipulation CoRL 2022 2022-09-10 Star Github
Dexterous Manipulation
TriFinger: An Open-Source Robot for Learning Dexterity CoRL 2021 2020-08-08 Star Github
Learning Complex Dexterous Manipulation with Deep Reinforcement Learning and Demonstrations RSS 2018 2017-09-28 Star Github
Deformable Object Manipulation
MoDeSuite: Robot Learning Task Suite for Benchmarking Mobile Manipulation with Deformable Objects arXiv 2025-07-29 Project
DaXBench: Benchmarking Deformable Object Manipulation with Differentiable Physics ICLR 2023 2022-10-24 Star Github
PlasticineLab: A Soft-Body Manipulation Benchmark with Differentiable Physics ICLR 2021 2021-04-07 Star Github
SoftGym: Benchmarking Deep Reinforcement Learning for Deformable Object Manipulation CoRL 2020 2020-11-14 Star Github
Mobile Manipulation
Mind and Motion Aligned: A Joint Evaluation IsaacSim Benchmark for Task Planning and Low-Level Policies in Mobile Manipulation arXiv 2023-08-21 -
CleanUpBench: Embodied Sweeping and Grasping Benchmark arXiv 2023-08-07 -
HomeRobot: Open-Vocabulary Mobile Manipulation CoRL 2023 2023-06-20 Star Github
BEHAVIOR-1K: A Human-Centered, Embodied AI Benchmark with 1,000 Everyday Activities and Realistic Simulation CoRL 2022 2024-03-14 Project
ManipulaTHOR: A Framework for Visual Object Manipulation CVPR 2021 2021-04-22 Star Github
Quadrupedal Manipulation
ODYSSEY: Open-World Quadrupeds Exploration and Manipulation for Long-Horizon Tasks arXiv 2024-08-11 Project
Humanoid Manipulation
HumanoidGen: Data Generation for Bimanual Dexterous Manipulation via LLM Reasoning arXiv 2025-07-01 Star Github
BiGym: A Demo-Driven Mobile Bi-Manual Manipulation Benchmark arXiv 2024-07-10 Star Github
HumanoidBench: Simulated Humanoid Benchmark for Whole-Body Locomotion and Manipulation arXiv 2024-03-15 Star Github

(back to top)

Cross-Embodiment Simulators and Benchmarks

Title Venue Date Code
AgentWorld: An Interactive Simulation Platform for Scene Construction and Mobile Robotic Manipulation CoRL 2025 2025-08-11 Star Github
VIKI-R: Coordinating Embodied Multi-Agent Cooperation via Reinforcement Learning arXiv 2025-06-10 Star Github
ImagineBench: Evaluating Reinforcement Learning with Large Language Model Rollouts arXiv 2025-05-15 Star Github
RoboVerse: Towards a Unified Platform, Dataset and Benchmark for Scalable and Generalizable Robot Learning RSS 2025 2025-04-26 Star Github
ManiSkill3: GPU Parallelized Robotics Simulation and Rendering for Generalizable Embodied AI RSS 2025 2024-10-01 Star Github
GENESIS: A generative world for general-purpose robotics & embodied AI learning - 2024-12 Star Github
RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robots RSS 2024 2024-06-04 Star Github
LocoMuJoCo: A Comprehensive Imitation Learning Benchmark for Locomotion NeurIPSW 2023 2023-11-04 Star Github
RoboHive: A Unified Framework for Robot Learning NeurIPS D&B 2023 2023-10-10 Star Github
CortexBench: Where are we in the search for an Artificial Visual Cortex for Embodied Intelligence? NeurIPS 2023 2023-03-31 Star Github
Isaac Lab: Orbit: A Unified Simulation Framework for Interactive Robot Learning Environments RA-L 2023 2023-01-10 Star Github
robosuite: A Modular Simulation Framework and Benchmark for Robot Learning arXiv 2020-09-25 Star Github

(back to top)

Other Simulators and Benchmarks

Title Venue Date Code
FLAME: A Federated Learning Benchmark for Robotic Manipulation arXiv 2025-03-03 -
Two by Two: Learning Multi-Task Pairwise Objects Assembly for Generalizable Robot Manipulation CVPR 2025 2025-04-09 Star Github
FMB: a Functional Manipulation Benchmark for Generalizable Robotic Learning IJRR 2024 2024-01-16 Star Github

(back to top)

Trajectory Datasets

Title Venue Date Code
RoboFAC: A Comprehensive Framework for Robotic Failure Analysis and Correction arXiv 2024-05-18 -
AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systems IROS 2025 2025-03-09 Star Github
RoboMIND: Benchmark on Multi-embodiment Intelligence Normative Data for Robot Manipulation arXiv 2024-12-18 Star Github
ARIO: All Robots in One: A New Standard and Unified Dataset for Versatile, General-Purpose Embodied Agents arXiv 2024-08-20 Dataset
DROID: A Large-Scale In-The-Wild Robot Manipulation Dataset RSS 2024 2024-03-19 Star Github
Open X-Embodiment: Robotic Learning Datasets and RT-X Models ICRA 2024 2023-10-13 Star Github
RoboAgent: Generalization and Efficiency in Robot Manipulation via Semantic Augmentations and Action Chunking ICRA 2024 2024-09-05 Star Github
BridgeData V2: A Dataset for Robot Learning at Scale CoRL 2023 2023-08-24 Star Github
RH20T: A Comprehensive Robotic Dataset for Learning Diverse Skills in One-Shot RSSW 2023 2023-07-02 Project
RT-1: Robotics Transformer for Real-World Control at Scale RSS 2023 2022-12-13 Dataset
BC-Z: Zero-Shot Task Generalization with Robotic Imitation Learning CoRL 2021 2022-02-04 Dataset
Bridge Data: Boosting Generalization of Robotic Skills with Cross-Domain Datasets CoRL 2018 2021-09-27 Star Github
Multiple Interactions Made Easy (MIME): Large Scale Demonstrations Data for Imitation CoRL 2018 2018-10-16 -

(back to top)

Embodied QA and Affordance Datasets

Title Venue Date Code
OmniEAR: Benchmarking Agent Reasoning in Embodied Tasks arXiv 2024-08-07 Star Github
PAC Bench: Do Foundation Models Understand Prerequisites for Executing Manipulation Policies? arXiv 2024-06-30 Project
Robo2VLM: Visual Question Answering from Large-Scale In-the-Wild Robot Manipulation Datasets arXiv 2024-05-21 Huggingface
PointArena: Probing Multimodal Grounding Through Language-Guided Pointing arXiv 2024-05-15 Star Github
ManipBench: Benchmarking Vision-Language Models for Low-Level Robot Manipulation arXiv 2024-05-14 Project
ManipVQA: Injecting Robotic Affordance and Physically Grounded Information into Multi-Modal Large Language Models IROS 2024 2024-03-17 Star Github
OpenEQA: Embodied Question Answering in the Era of Foundation Models CVPR 2024 2024 Star Github

(back to top)

🛠️ Awesome Techniques

Title Venue Date Code
Awesome-Dual-System-VLA: OpenHelix: A Short Survey, Empirical Analysis, and Open-Source Dual-System VLA Model for Robotic Manipulation - 2025-05-06 Star Github
Awesome-Implicit-NeRF-Robotics: Neural Fields in Robotics: A Survey - 2024-10-26 Star Github
Awesome-Robotics-3D - 2024-08-13 Star Github
Awesome-Video-Robotic-Papers - 2024-06-18 Star Github
awesome-humanoid-learning - 2024-01-16 Star Github
Awesome-Robotics-Foundation-Models: Foundation Models in Robotics: Applications, Challenges, and the Future - 2023-12-13 Star Github
Awesome-Generalist-Robots-via-Foundation-Models: Neural Fields in Robotics: A Survey - 2023-06-20 Star Github
Awesome-LLM-Robotics - 2022-08-12 Star Github

(back to top)

✨ Citation

This repository is developed and maintained by:

@misc{nkl-hmnei-cc-bci2024roboticsmanipulation,
    title = {Awesome-Robotics-Manipulation},
    author = {NKL-HMHEI and CC-BCI Group},
    journal = {GitHub repository},
    url = {https://github.com/BaiShuanghao/Awesome-Robotics-Manipulation},
    year = {2024},
}

About

A comprehensive list of papers about Robot Manipulation, including papers, codes, and related websites.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published