Awesome-Awesomes-and-Surveys-in-Deep-Learning

• Awesome-Awesomes-and-Surveys-in-Deep-Learning
  • Long-Tailed Learning
  • Semi-Supervised Learning
  • Active Learning
  • Noisy Label
  • Multi-Task Learning
  • Transfer Learning
    • Domain Adaptation
    • Domain Generalization
  • Open-World
    • OOD Detection
  • Continual Learning
  • Safety
  • Unlearning
  • VLM
  • LLM
  • MLLM
  • Diffusion
  • MISC
  • Tutorials

Long-Tailed Learning

Paper	Venue	Repo
Deep Long-Tailed Learning: A Survey	TPAMI 2023	Awesome-LongTailed-Learning
		awesome-long-tail-learning

Semi-Supervised Learning

Paper	Venue	Repo
An Overview of Deep Semi-Supervised Learning		awesome-semi-supervised-learning
A Survey on Deep Semi-Supervised Learning	TKDE 2023

Active Learning

Paper	Venue	Repo
		awesome-active-learning

Noisy Label

Paper	Venue	Repo
		Advances-in-Label-Noise-Learning

Multi-Task Learning

Paper	Venue	Repo
		awesome-multi-task-learning
		Awesome-Multi-Task-Learning
A Survey on Multi-Task Learning	TKDE 2021

Transfer Learning

Paper	Venue	Repo
		transferlearning
Transferability in Deep Learning: A Survey		Transfer-Learning-Library
Which Model to Transfer? A Survey on Transferability Estimation		awesome-model-transferability-estimation
A Survey on Negative Transfer	IEEE/CAA Journal of Automatica Sinica 2022
Scaling Down to Scale Up: A Guide to Parameter-Efficient Fine-Tuning
Parameter-efficient fine-tuning of large-scale pre-trained language models	Nature Machine Intelligence 2023
Parameter-Efficient Fine-Tuning for Pre-Trained Vision Models: A Survey		Awesome-Parameter-Efficient-Transfer-Learning
		Awesome-Parameter-Efficient-Transfer-Learning
Parameter-Efficient Fine-Tuning for Foundation Models		Awesome-Parameter-Efficient-Fine-Tuning-for-Foundation-Models
Low-Rank Adaptation for Foundation Models: A Comprehensive Review		awesome-lora-adapter
Prompt-based Adaptation in Large-scale Vision Models: A Survey		Awesome-Visual-Prompt-Tuning

Domain Adaptation

Paper	Venue	Repo
		awesome-domain-adaptation
Deep Visual Domain Adaptation: A Survey	Neurocomputing 2018
A Comprehensive Survey on Test-Time Adaptation under Distribution Shifts	IJCV 2024	awesome-test-time-adaptation
In Search of Lost Online Test-time Adaptation: A Survey	IJCV 2024	OTTA_ViT_survey
Beyond Model Adaptation at Test Time: A Survey		Beyond-model-adaptation-at-test-time-Papers

Domain Generalization

Paper	Venue	Repo
Domain Generalization: A Survey	TPAMI 2022
		Generalization-Causality
		OOD-Generalization-Paper-Reading-Notes
		Awesome-Domain-Generalization

Open-World

Paper	Venue	Repo
Open-world Machine Learning: A Review and New Outlooks
		Awesome-Novel-Class-Discovery

OOD Detection

Paper	Venue	Repo
		Awesome-Out-Of-Distribution-Detection
Generalized Out-of-Distribution Detection: A Survey	IJCV 2024	OODSurvey
Generalized Out-of-Distribution Detection and Beyond in Vision Language Model Era: A Survey	TMLR 2025	Awesome-OOD-VLM
Out-of-Distribution Detection: A Task-Oriented Survey of Recent Advances	ACM Computing Surveys 2025	Awesome-Out-Of-Distribution-Detection

Continual Learning

Paper	Venue	Repo
Three types of incremental learning	Nature Machine Intelligence 2022	continual-learning
		Awesome-Incremental-Learning
A Comprehensive Survey of Continual Learning: Theory, Method and Application	TPAMI 2024
Class-Incremental Learning: A Survey	TPAMI 2024	CIL_Survey
Continual Learning with Pre-Trained Models: A Survey	IJCAI 2024	LAMDA-PILOT
Recent Advances of Multimodal Continual Learning: A Comprehensive Survey		Awesome-Multimodal-Continual-Learning
Continual Learning for VLMs: A Survey and Taxonomy Beyond Forgetting		Awesome-Continual-learning-of-Vision-Language-Models
Recent Advances of Foundation Language Models-based Continual Learning: A Survey	ACM Computing Surveys 2025	Foundation-LMs-based-Continual-Learning

Safety

Paper	Venue	Repo
		awesome-trustworthy-deep-learning
Adversarial Attacks of Vision Tasks in the Past 10 Years: A Survey	ACM Computing Surveys 2025
A Survey on Transferability of Adversarial Examples Across Deep Neural Networks	TMLR 2024	Awesome_Adversarial_Transferability
A Survey on Unlearnable Data		Awesome-UnLearnable-Data
Dataset Security for Machine Learning: Data Poisoning, Backdoor Attacks, and Defenses	TPAMI 2022
Backdoor Learning: A Survey	TNNLS 2022	backdoor-learning-resources
Attacks in Adversarial Machine Learning: A Systematic Survey from the Life-cycle Perspective	IJCV 2025	Adversarial Machine Learning
Defenses in Adversarial Machine Learning: A Systematic Survey From the Lifecycle Perspective	TPAMI 2025
		awesome-ml-privacy-attacks
Membership Inference Attacks on Machine Learning: A Survey	ACM Computing Surveys 2022	membership-inference-machine-learning-literature
Model Inversion Attacks: A Survey of Approaches and Countermeasures		Awesome-model-inversion-attack
Exploring the Vulnerabilities of Federated Learning: A Deep Dive into Gradient Inversion Attacks	TPAMI 2025	Awesome-Gradient-Inversion-Attacks
Safety at Scale: A Comprehensive Survey of Large Model Safety		Awesome-Large-Model-Safety

Unlearning

Paper	Venue	Repo
		machine_unlearning
A Survey of Machine Unlearning	TIST 2025	awesome-machine-unlearning
Threats, Attacks, and Defenses in Machine Unlearning: A Survey	OJCS 2025
Machine Unlearning in Generative AI: A Survey		Awesome-GenAI-Unlearning

VLM

Paper	Venue	Repo
Vision-Language Models for Vision Tasks: A Survey	TPAMI 2024	VLM_survey
Towards Open Vocabulary Learning: A Survey	TPAMI 2024	Awesome-Open-Vocabulary
		Awesome-Prompt-Adapter-Learning-for-VLMs
Visual Tuning	ACM Computing Surveys 2024
A Systematic Survey of Prompt Engineering on Vision-Language Foundation Models		Awesome-Prompting-on-Vision-Language-Model
Advances in Multimodal Adaptation and Generalization: From Traditional Approaches to Foundation Models		Awesome-Multimodal-Adaptation
Adapting Vision-Language Models Without Labels: A Comprehensive Survey		Awesome-LabelFree-VLMs

LLM

Paper	Venue	Repo
		Awesome-LLM
A Survey of Large Language Models		LLMSurvey
An Overview of Large Language Models for Statisticians
Foundational Challenges in Assuring Alignment and Safety of Large Language Models	TMLR 2024
AI Alignment: A Comprehensive Survey	ACM Computing Surveys 2025
		awesome-llm-understanding-mechanism
		Awesome-LLM-Interpretability
A Survey on In-context Learning	EMNLP 2024	ICL_PaperList
		Awesome-Transformer-Attention
		Efficient_Attention_Survey
Speed Always Wins: A Survey on Efficient Architectures for Large Language Models		Awesome-Efficient-Arch
		Awesome-LLM-Long-Context-Modeling
Attention Heads of Large Language Models: A Survey	Patterns 2025	Awesome-Attention-Heads
		awesome-activation-engineering
		awesome-llm-steering
		Awesome-Interpretability-in-Large-Language-Models
A Practical Review of Mechanistic Interpretability for Transformer-Based Language Models		awesome-mechanistic-interpretability-lm-papers
Locate, Steer, and Improve: A Survey of Actionable Mechanistic Interpretability in Large Language Models		Actionable-MI
Mechanistic Interpretability for AI Safety -- A Review	TMLR 2024
A Survey on Sparse Autoencoders: Interpreting the Internal Mechanisms of Large Language Models	EMNLP 2025 Findings
A Primer on the Inner Workings of Transformer-based Language Models
		Awesome-Parametric-Knowledge-in-LLMs
LLM Post-Training: A Deep Dive into Reasoning Large Language Models		Awesome-LLM-Post-training
A Survey on Post-training of Large Language Models		LLM-Post-Training
A Survey on Efficient Large Language Model Training: From Data-centric Perspectives	ACL 2025	Awesome-Data-Efficient-LLM
Continual Learning of Large Language Models: A Comprehensive Survey	ACM Computing Surveys 2025	llm-continual-learning-survey
Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Survey
A Survey on LoRA of Large Language Models	FCS 2024	Awesome-LoRAs
Merge, Ensemble, and Cooperate! A Survey on Collaborative Strategies in the Era of Large Language Models
		Awesome-LLM-Compression
A Survey on Evaluation of Large Language Models	TIST 2023	LLM-eval-survey
Benchmarking Large Language Models Under Data Contamination: A Survey from Static to Dynamic Evaluation	EMNLP 2025	Static-to-Dynamic-LLMEval
LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methods		Awesome-LLMs-as-Judges
From Generation to Judgment: Opportunities and Challenges of LLM-as-a-judge	EMNLP 2025	Awesome-LLM-as-a-judge
A Survey on LLM-as-a-Judge		LLM-as-a-Judge
When Text Embedding Meets Large Language Model: A Comprehensive Survey
LLMs are Also Effective Embedding Models: An In-depth Overview
Security and Privacy Challenges of Large Language Models: A Survey	ACM Computing Surveys 2025
		Awesome-LM-SSP
		Awesome-LLM-Safety
		awesome-llm-security
Harmful Fine-tuning Attacks and Defenses for Large Language Models: A Survey		awesome_LLM-harmful-fine-tuning-papers
		Awesome-Jailbreak-on-LLMs
JailbreakZoo: Survey, Landscapes, and Horizons in Jailbreaking Large Language and Vision-Language Models		JailbreakZoo
Safety in Large Reasoning Models: A Survey	EMNLP 2025 Findings	Awesome-LRMs-Safety
Copyright Protection for Large Language Models: A Survey of Methods, Challenges, and Trends		awesome-llm-copyright-protection
Towards Reverse Engineering of Language Models: A Survey	EMNLP 2025 Findings	llm-privacy
SoK: Large Language Model Copyright Auditing via Fingerprinting		Awesome-LLM-Fingerprinting
Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Models	Computational Linguistics 2025	llm-hallucination-survey
A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questions	TOIS 2024	Awesome-LLM-hallucination
		awesome-hallucination-detection
		Reliable-LLM
A Survey on the Honesty of Large Language Models	TMLR 2025	LLM-Honesty-Survey
Conformal Prediction for Natural Language Processing: A Survey	TACL 2024
A Survey on LLM-Generated Text Detection: Necessity, Methods, and Future Directions	Computational Linguistics 2025	LLM-generated-Text-Detection
Editing Large Language Models: Problems, Methods, and Opportunities	EMNLP 2023	KnowledgeEditingPapers
A Comprehensive Study of Knowledge Editing for Large Language Models
Knowledge Editing for Large Language Models: A Survey	ACM Computing Surveys 2024
		awesome-llm-unlearning
Rethinking Machine Unlearning for Large Language Models	Nature Machine Intelligence 2024
A Comprehensive Survey of Machine Unlearning Techniques for Large Language Models
Towards Lifelong Learning of Large Language Models: A Survey	ACM Computing Surveys 2025	awesome-lifelong-learning-methods-for-llm
A Survey on Data Selection for Language Models	TMLR 2024	data-selection-survey
Unleashing the Power of Data Tsunami: A Comprehensive Survey on Data Assessment and Selection for Instruction Tuning of Language Models	TMLR 2024	fantastic-data-engineering
A Survey on Knowledge Distillation of Large Language Models		Awesome-Knowledge-Distillation-of-LLMs
A Survey on Mixture of Experts in Large Language Models	TKDE 2025	A-Survey-on-Mixture-of-Experts-in-LLMs
Harnessing Multiple Large Language Models: A Survey on LLM Ensemble		Awesome-LLM-Ensemble
Knowledge Conflicts for LLMs: A Survey	EMNLP 2024	Knowledge-Conflicts-Survey
		Awesome-LLM-Uncertainty-Reliability-Robustness
A Survey of Uncertainty Estimation Methods on Large Language Models	ACL 2025 Findings
Uncertainty Quantification and Confidence Calibration in Large Language Models: A Survey	KDD 2025
A Survey on Uncertainty Quantification of Large Language Models: Taxonomy, Open Research Challenges, and Future Directions	ACM Computing Surveys 2025
Representation Engineering for Large-Language Models: Survey and Research Challenges
Taxonomy, Opportunities, and Challenges of Representation Engineering for Large Language Models	TMLR 2025
Interpretation Meets Safety: A Survey on Interpretation Methods and Tools for Improving LLM Safety	EMNLP 2025
		Awesome-Personalized-LLMs
A Survey on Personalized Alignment -- The Missing Piece for Large Language Models in Real-World Applications
Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Models		Awesome-Long-Chain-of-Thought-Reasoning
A Survey of Reinforcement Learning for Large Reasoning Models		Awesome-RL-for-LRMs
From System 1 to System 2: A Survey of Reasoning Large Language Models	TPAMI 2025	Awesome-System2-Reasoning-LLM
A Comprehensive Survey on Trustworthiness in Reasoning with Large Language Models		Awesome-reasoning-safety
A Survey of Test-Time Compute: From Intuitive Inference to Deliberate Reasoning		Awesome_Test_Time_LLMs
A Survey on Test-Time Scaling in Large Language Models: What, How, Where, and How Well?		Awesome Test-time-Scaling in LLMs
Reasoning Beyond Language: A Comprehensive Survey on Latent Chain-of-Thought Reasoning		Awesome-Latent-CoT
A Survey on Latent Reasoning		LatentCoT-Horizon
		Awesome-Latent-Space
		Awesome-Efficient-Reasoning
Stop Overthinking: A Survey on Efficient Reasoning for Large Language Models	TMLR 2025	Awesome-Efficient-Reasoning-LLMs
		Awesome-LLM-Decoding
From Decoding to Meta-Generation: Inference-time Algorithms for Large Language Models	TMLR 2024
A Survey on Training-free Alignment of Large Language Models	EMNLP 2025 Findings
Unlocking Efficiency in Large Language Model Inference: A Comprehensive Survey of Speculative Decoding	ACL 2024	SpeculativeDecodingPapers
What is the Role of Small Models in the LLM Era: A Survey		awesome_role_of_small_models
		Awesome-Routing-LLMs
Memory in the Age of AI Agents		Agent-Memory-Paper-List

MLLM

Paper	Venue	Repo
		Awesome-Multimodal-Large-Language-Models
		Awesome-Multimodal-Large-Language-Models
Keeping Yourself is Important in Downstream Tuning Multimodal Large Language Model		Awesome-MLLM-Tuning
Safety of Multimodal Large Language Models on Images and Texts	IJCAI 2024	Awesome-MLLM-Safety
A Survey of Attacks on Large Vision-Language Models: Resources, Advances, and Future Trends	TNNLS 2025	Awesome-LVLM-Attack
From LLMs to MLLMs: Exploring the Landscape of Multimodal Jailbreaking	EMNLP 2024
Jailbreak Attacks and Defenses against Multimodal Generative Models: A Survey		Awesome-Multimodal-Jailbreak
A Survey of Safety on Large Vision-Language Models: Attacks, Defenses and Evaluations		Awesome-LVLM-Safety
		Awesome-LVLM-Hallucination
		Awesome-LVLM-Hallucination
		Awesome-MLLM-Hallucination
Hallucination of Multimodal Large Language Models: A Survey		Awesome-MLLM-Hallucination
		Awesome-MLLM-Uncertainty
		Awesome-Modality-Priors-in-MLLMs
		Awesome-LMMs-Mechanistic-Interpretability
Shifting AI Efficiency From Model-Centric to Data-Centric Compression		Awesome-Token-level-Model-Compression
When Tokens Talk Too Much: A Survey of Multimodal Long-Context Token Compression across Images, Videos, and Audios		Awesome-Multimodal-Token-Compression
		MLLM-Token-Compression
Perception, Reason, Think, and Plan: A Survey on Large Multimodal Reasoning Models		Awesome-Large-Multimodal-Reasoning-Models

Diffusion

Paper	Venue	Repo
		awesome-text-to-image-studies
		Awesome-Text-to-Image
Controllable Generation with Text-to-Image Diffusion Models: A Survey		Awesome-Controllable-T2I-Diffusion-Models
		Awesome-Personalized-Image-Generation
		Awesome-Evaluation-of-Visual-Generation
Trustworthy Text-to-Image Diffusion Models: A Timely and Focused Survey		Trustworthy_T2I_DMs
Adversarial Attacks and Defenses on Text-to-Image Diffusion Models: A Survey	Information Fusion 2024	Awesome-AD-on-T2IDM
Replication in Visual Diffusion Models: A Survey and Outlook		Awesome-Diffusion-Replication

MISC

Paper	Venue	Repo
	IJCAI 2025	Awesome-Model-Reuse
Deep Model Fusion: A Survey
Modular Deep Learning	TMLR 2023
Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunities	ACM Computing Surveys 2025	Awesome-Model-Merging-Methods-Theories-Applications
		Awesome-Model-Merging
		Awesome-Model-Merging
A Survey on Model MoErging: Recycling and Routing Among Specialized Experts for Collaborative Learning	TMLR 2025
Learn From Model Beyond Fine-Tuning: A Survey	Nature Machine Intelligence 2024	Awesome-Learn-from-Model
Model Reprogramming: Resource-Efficient Cross-Domain Machine Learning	AAAI 2024	model-reprogramming
		Awesome-Weight-Space-Learning
A Brief Review of Hypernetworks in Deep Learning	Artificial Intelligence Review 2024
A Comprehensive Survey of Forgetting in Deep Learning Beyond Continual Learning	TPAMI 2024	Awesome-Forgetting-in-Deep-Learning
		awesome-mm-chat
		LLM-MLLM-paper-list
Knowledge Distillation: A Survey	IJCV 2021
A Survey on Deep Neural Network Pruning-Taxonomy, Comparison, Analysis, and Recommendations	TPAMI 2024	awesome-pruning
		Awesome-Dataset-Distillation
		awesome-deep-phenomena
Neural Collapse: A Review on Modelling Principles and Generalization	TMLR 2023
An overview of condensation phenomenon in deep learning
		awesome-uncertainty-deeplearning
A Survey on Uncertainty Quantification Methods for Deep Learning	ACM Computing Surveys 2025
A Survey on Mixup Augmentations and Beyond		Awesome-Mixup
Similarity of Neural Network Models: A Survey of Functional and Representational Measures	ACM Computing Surveys 2025
Representation Potentials of Foundation Models for Multimodal Alignment: A Survey	EMNLP 2025	Representation-Alignment-Survey
		awesome-balanced-multimodal-learning
		awesome-ml4co
		COPZoo
Collective Intelligence for Deep Learning: A Survey of Recent Developments	Collective Intelligence 2022
Evolutionary Computation in the Era of Large Language Model: Survey and Roadmap	TEVC 2024	LLM4EC
Investigating Bi-Level Optimization for Learning and Vision From a Unified Perspective: A Survey and Beyond	TPAMI 2022	BLO
Advances and Challenges in Meta-Learning: A Technical Review	TPMAI 2024
Fast weight programming and linear transformers: from machine learning to neurobiology	TMLR 2025
		Awesome-Optimal-Transport-in-Deep-Learning
Training Data Influence Analysis and Estimation: A Survey	Machine Learning 2024	influence_analysis_papers
A Survey of Data Attribution: Methods, Applications, and Evaluation in the Era of Generative AI
Towards Unified Attribution in Explainable AI, Data-Centric AI, and Mechanistic Interpretability

Tutorials

A Tutorial Introduction to the Lambda Calculus

Topological Methods in Machine Learning: A Tutorial for Practitioners

Determinantal point processes for machine learning Advances in Temporal Point Processes: Bayesian, Neural, and LLM Approaches

Kernel Mean Embedding of Distributions: A Review and Beyond

The Frank-Wolfe algorithm: a short introduction

The CMA Evolution Strategy: A Tutorial

A Primer on Zeroth-Order Optimization in Signal Processing and Machine Learning

A Gentle and Incomplete Introduction to Bilevel Optimization A Brief Introduction to Robust Bilevel Optimization An Introduction to Bi-level Optimization: Foundations and Applications in Signal Processing and Machine Learning

A Tutorial on Spectral Clustering

A Tutorial on Principal Component Analysis

An Introduction to Variational Autoencoders

Computational Optimal Transport

Tutorial on Diffusion Models for Imaging and Vision Step-by-Step Diffusion: An Elementary Tutorial The Principles of Diffusion Models

A tutorial on conformal prediction A Gentle Introduction to Conformal Prediction and Distribution-Free Uncertainty Quantification Theoretical Foundations of Conformal Prediction

Reinforcement Learning: An Overview

A Modern Introduction to Online Learning Introduction to Online Convex Optimization