图像融合(Image Fusion)

News

🔥 了解完整的论文列表和最新科研动态，请访问我的个人主页：linfeng-tang.github.io

[2025-11-26] 我们的综述《基于深度学习的图像融合方法综述》荣获中国图象图形学报 2020-2024 优秀论文！

[2025-9-18] 我们的论文 "ControlFusion: A Controllable Image Fusion Framework with Language-Vision Degradation Prompts" 被 Advances in Neural Information Processing Systems (NeurIPS) 正式接收! [论文下载] [Code]

[2025-9-10] 我们的论文 Mask-DiFuser: A Masked Diffusion Model for Unified Unsupervised Image Fusion 被 IEEE Transactions on Pattern Analysis and Machine Intelligence (IEEE TPAMI) 正式接收! [论文下载] [Code]

[2025-3-15] 我们的论文《C2RF: Bridging Multi-modal Image Registration and Fusion via Commonality Mining and Contrastive Learning)》被《International Journal of Computer Vision》(IJCV)正式接收！[论文下载] [Code]

[2025-02-11] 我们发布了一个用于红外和可见光视频融合的大规模数据集：M3SVD: Multi-Modal Multi-Scene Video Dataset.

[2024-12-26] 我们的综述《基于深度学习的图像融合方法综述》荣获中国图象图形学报2024优秀论文！[《中国图象图形学报》2024年优秀论文公布！][论文下载] [Code]

[2024-11-28] 我们的论文(SeAFusion)《Image fusion in the loop of high-level vision tasks: A semantic-aware real-time infrared and visible image fusion network》荣获 Information Fusion Best Paper Award 2024 (最佳论文奖)！[论文下载] [Code]

[2024-09] 我们的综述《基于深度学习的图像融合方法综述》入选空天信息科技期刊高影响力论文 (全国共14篇)！[论文下载] [Code]

[2024-07-16] 我们的论文《DRMF: Degradation-Robust Multi-Modal Image Fusion via Composable Diffusion Prior》被《ACM MM 2024》正式接收！[论文下载] [Code]

[2023-06-05] 我们的论文《Rethinking the necessity of image fusion in high-level vision tasks: A practical infrared and visible image fusion network based on progressive semantic injection and scene fidelity》被《Information Fusion》正式接收！[论文下载] [Code]

[2022-07-29] 我们的综述论文《基于深度学习的图像融合方法综述》被《中国图象图形学报》正式接收！[论文下载]

Citation
多模图像融合(Multi-Modal Image Fusion)
- 红外和可见光图像融合(Infrared and visible image fusion)
- 医学图像融合(Medical image fusion)
数字摄影图像融合(Digital Photography Image Fusion)
- 多曝光图像融合(Multi-exposure image fusion)
- 多聚焦图像融合(Multi-focus image fusion)
遥感影像融合(Remote Sensing Image Fusion)
- 全色图像锐化(Pansharpening)
通用图像融合框架(General Image Fusion Framerwork)
综述(Survey)
数据集(Dataset)
评估指标(Evaluation Metric)
- 通用评估指标(General evaluation metric)
- 遥感影像融合评估指标

Citation

如果我们的总结对你有所帮助, 请引用以下论文：

@article{Tang2024Mask-DiFuser,
  author={Tang, Linfeng and Li, Chunyu and Ma, Jiayi},
  journal={IEEE Transactions on Pattern Analysis and Machine Intelligence}, 
  title={Mask-DiFuser: A Masked Diffusion Model for Unified Unsupervised Image Fusion}, 
  year={2025},
  volume={},
  number={},
  pages={1-18},
 }

@article{Tang2025ControlFusion,
  title={ControlFusion: A Controllable Image Fusion Framework with Language-Vision Degradation Prompts},
  author={Tang, Linfeng and Wang, Yeda and Cai, Zhanchuan and Jiang, Junjun and Ma, Jiayi},
  journal={Advances in Neural Information Processing Systems},
  year={2025}
}

@article{Tang2024C2RF,
	title={C2RF: Bridging Multi-modal Image Registration and Fusion via Commonality Mining and Contrastive Learning}, 
	author={Tang, Linfeng and Yan, Qinglong and Xiang, Xinyu and Fang, Leyuan and Ma, Jiayi},
	journal={International Journal of Computer Vision}, 
	pages={5262--5280},
	volume={133},
	year={2025},
}

@article{Tang2022Survey,
  title={Deep learning-based image fusion: A survey},
  author={Tang, Linfeng and Zhang, Hao and Xu, Han and Ma, Jiayi},  
  journal={Journal of Image and Graphics}
  volume={28},
  number={1},
  pages={3--36},
  year={2023}
}

@inproceedings{Tang2024DRMF,
    title={DRMF: Degradation-Robust Multi-Modal Image Fusion via Composable Diffusion Prior},
    author={Tang, Linfeng and Deng, Yuxin and Yi, Xunpeng and Yan, Qinglong and Yuan, Yixuan and Ma, Jiayi},
    booktitle={Proceedings of the ACM International Conference on Multimedia},
    pages={8546--8555},
    year={2024}
}

1. 红外和可见光图像融合 (Infrared & Visible Image Fusion)

这一部分聚焦于 IVIF，从早期的卷积自编码器和 GAN，到近年来的 Vision-Language、Diffusion 与可控融合框架。

分类说明：
- 面向视觉融合：侧重低层次视觉质量（细节、对比度、纹理）；
- 语义驱动融合：引入检测/分割/文本等高层任务或语义先验；
- 联合配准融合：同时学习配准与融合，解决对齐问题；
- 退化鲁棒融合：针对噪声、模糊、低照度等场景。

方法	论文标题	分类	基础框架	监督范式	发表期刊或会议	年份	论文	代码
ControlFusion	ControlFusion: A Controllable Image Fusion Network with Language-Vision Degradation Prompts	语义驱动融合	Transformer	无监督	NeurIPS	2025	Paper	Code
CDTFusion	CDTFusion: Crossing Domain and Task for Infrared and Visible Image Fusion	面向视觉融合	CNN	无监督	TPAMI	2025	Paper	Code
DCEvo	DCEvo: Discriminative Cross-Dimensional Evolutionary Learning for Infrared and Visible Image Fusion	语义驱动融合	CNN	无监督	CVPR	2025	Paper	Code
Dream-IF	Dream-IF: Dynamic Relative EnhAnceMent for Image Fusion	退化鲁棒融合	CNN& Transformer	有监督	arXiv	2025	Paper	Code
SAGE	Every SAMDrop Counts: Embracing Semantic Priors for Multi-Modality Image Fusion and Beyond	语义驱动融合	CNN	无监督	CVPR	2025	Paper	Code
FreeFusion	FreeFusion: Infrared and Visible Image Fusion via Cross Reconstruction Learning	退化鲁棒融合	CNN	有监督	TPAMI	2025	Paper	Code
FusionBooster	FusionBooster: A Unified Image Fusion Boosting Paradigm	语义驱动融合	AE	有监督	IJCV	2025	Paper	Code
MulFS-CAP	MulFS-CAP: Multimodal Fusion-Supervised Cross-Modality Alignment Perception for Unregistered Infrared-Visible Image Fusion	语义驱动融合	CNN	有监督	TPAMI	2025	Paper	Code
OCCO	OCCO: LVM-Guided Infrared and Visible Image Fusion Framework Based on Object-Aware and Contextual Contrastive Learning	联合配准融合	CNN	有监督	IJCV	2025	Paper	Code
OmniFuse	OmniFuse: Composite Degradation-Robust Image Fusion With Language-Driven Semantics	联合配准融合	Diffusion Model	有监督	TPAMI	2025	Paper	Code
TDFusion	Task-driven Image Fusion with Learnable Fusion Loss	语义驱动融合	CNN& Transformer	无监督	CVPR	2025	Paper	Code
MRFS	MRFS: Mutually Reinforcing Image Fusion and Segmentation	语义驱动融合	CNN& Transformer	无监督	CVPR	2024	Paper	Code
FILM	Image Fusion via Vision-Language Model	语义驱动融合	CNN& Transformer	无监督	ICML	2024	Paper	Code
TC-MoA	Task-Customized Mixture of Adapters for General Image Fusion	面向视觉融合	Transformer	无监督	CVPR	2024	Paper	Code
Text-IF	Text-IF: Leveraging Semantic Text Guidance for Degradation-Aware and Interactive Image Fusion	语义驱动融合	Transformer	无监督	CVPR	2024	Paper	Code
PSFusion	Rethinking the necessity of image fusion in high-level vision tasks...	语义驱动融合	CNN	无监督	InfFus	2023	Paper	Code
LRRNet	LRRNet: A Novel Representation Learning Guided Fusion Network for Infrared and Visible Images	面向视觉融合	CNN	有监督	TPAMI	2023	Paper	Code
MURF	MURF: Mutually Reinforcing Multi-Modal Image Registration and Fusion	联合配准融合	CNN	无监督	TPAMI	2023	Paper	Code
SegMiF	Multi-interactive Feature Learning and a Full-time Multi-modality Benchmark for Image Fusion and Segmentation	语义驱动融合	CNN& Transformer	有监督	ICCV	2023	Paper	Code
CAMF	AMF: An interpretable infrared and visible image fusion network based on class activation mapping	面向视觉融合	AE	自监督	TMM	2023	Paper	Code
PAIF	PAIF: Perception-Aware Infrared-Visible Image Fusion for Attack-Tolerant Semantic Segmentation	语义驱动融合	CNN	无监督	ACM MM	2023	Paper	Code
SeAFusion	Image fusion in the loop of high-level vision tasks: A semantic-aware real-time infrared and visible image fusion network	语义驱动融合	CNN	无监督	InfFus	2022	Paper	Code
TarDAL	Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark...	语义驱动融合	GAN	无监督	CVPR	2022	Paper	Code
PIAFusion	PIAFusion: A progressive infrared and visible image fusion network based on illumination aware	面向视觉融合	CNN	无监督	InfFus	2022	Paper	Code
CSF	Classification Saliency-Based Rule for Visible and Infrared Image Fusion	面向视觉融合	AE	无监督	TCI	2021	Paper	Code
RFN-Nest	RFN-Nest: An end-to-end residual fusion network for infrared and visible images	面向视觉融合	AE	无监督	InfFus	2021	Paper	Code
FusionGAN	FusionGAN: A generative adversarial network for infrared and visible image fusion	面向视觉融合	GAN	无监督	InfFus	2019	Paper	Code
DenseFuse	DenseFuse: A Fusion Approach to Infrared and Visible Images	面向视觉融合	AE	无监督	TIP	2019	Paper	Code

多模图像融合(Multi-Modal Image Fusion)方法汇总

方法	论文标题	分类	基础框架	监督范式	发表期刊或会议	年份	论文	代码
C2RF	C2RF: Bridging Multi-modal Image Registration and Fusion via Commonality Mining and Contrastive Learning	联合配准融合	CNN	无监督	IJCV	2025	Paper	Code
MTG‑Fusion	Multi-Text Guidance Is Important: Multi-Modality Image Fusion via Large Generative Vision-Language Model	语义驱动融合	Diffusion Model	有监督	IJCV	2025	Paper	Code
DRMF	DRMF: Degradation-Robust Multi-Modal Image Fusion via Composable Diffusion Prior	面向视觉融合	Diffusion Model	无监督	ACM MM	2024	Paper	Code
IVF-WoReg	A Deep Learning Framework for Infrared and Visible Image Fusion Without Strict Registration	联合配准融合	CNN	有监督	IJCV	2024	Paper	Code
CoCoNet	CoCoNet: Coupled Contrastive Learning Network with Multi-level Feature Ensemble for Multi-modality Image Fusion	面向视觉融合	CNN	无监督	IJCV	2024	Paper	Code
CCF	Conditional Controllable Image Fusion	联合配准融合	Diffusion Model	无监督	NeurIPS	2024	Paper	Code
ReFusion	ReFusion: Learning Image Fusion from Reconstruction with Learnable Loss Via Meta-Learning	面向视觉融合	CNN	无监督	IJCV	2024	Paper	Code
TTD	Test-Time Dynamic Image Fusion	面向视觉融合	CNN	无监督	NeurIPS	2024	Paper	Code
CDDFuse	CDDFuse: Correlation-Driven Dual-Branch Feature Decomposition for Multi-Modality Image Fusion	语义驱动融合	CNN& Transformer	无监督	CVPR	2023	Paper	Code
DDFM	DDFM: Denoising Diffusion Model for Multi-Modality Image Fusion	面向视觉融合	Diffusion Model	无监督	CVPR	2023	Paper	Code
DDcGAN	Learning a Generative Model for Fusing Infrared and Visible Images via Conditional Generative Adversarial Network with Dual Discriminators	面向视觉融合	GAN	无监督	IJCAI	2019	Paper	Code

通用图像融合(General Image Fusion)方法汇总

方法	论文标题	场景	基础框架	监督范式	发表期刊或会议	年份	论文	代码
Mask-DiFuser	Mask-DiFuser: A Masked Diffusion Model for Unified Unsupervised Image Fusion	通用图像融合	Diffusion Model	无监督	TPAMI	2025	Paper	Code
GIFNet	One Model for ALL: Low-Level Task Interaction Is a Key to Task-Agnostic Image Fusion	通用图像融合	Transformer	有监督	CVPR	2025	Paper	Code
SwinFusion	SwinFusion: Cross-domain Long-range Learning for General Image Fusion via Swin Transformer	通用图像融合	Transformer	无监督	IEEE/CAA JAS	2022	Paper	Code
U2Fusion	U2Fusion: A Unified Unsupervised Image Fusion Network	通用图像融合	CNN	无监督	TPAMI	2022	Paper	Code
DeFusion	Fusion from Decomposition: A Self-Supervised Decomposition Approach for Image Fusion	通用图像融合	CNN	无监督	ECCV	2022	Paper	Code
SDNet	SDNet: A Versatile Squeeze-and-Decomposition Network for Real-Time Image Fusion	通用图像融合	CNN	无监督	IJCV	2021	Paper	Code
PMGI	Rethinking the Image Fusion: A Fast Unified Image Fusion Network based on Proportional Maintenance of Gradient and Intensity	通用图像融合	CNN	无监督	AAAI	2020	Paper	Code
IFCNN	IFCNN: A general image fusion framework based on convolutional neural network	通用图像融合	CNN	有监督	InfFus	2020	Paper	Code

多模图像融合(Multi-Modal Image Fusion)

红外和可见光图像融合(Infrared and visible image fusion)

方法	标题	论文	代码	发表期刊或会议	基础框架	监督范式	发表年份
DenseFuse	DenseFuse: A Fusion Approach to Infrared and Visible Images	Paper	Code	TIP	AE	自监督	2019
FusionGAN	FusionGAN: A generative adversarial network for infrared and visible image fusion	Paper	Code	InfFus	GAN	无监督	2019
DDcGAN	Learning a Generative Model for Fusing Infrared and Visible Images via Conditional Generative Adversarial Network with Dual Discriminators	Paper	Code	IJCAI	GAN	无监督	2019
NestFuse	NestFuse: An Infrared and Visible Image Fusion Architecture Based on Nest Connection and Spatial/Channel Attention Models	Paper	Code	TIM	AE	自监督	2020
DDcGAN	DDcGAN: A dual-discriminator conditional generative adversarial network for multi-resolution image fusion	Paper	Code	TIP	GAN	无监督	2020
DIDFuse	DIDFuse: Deep Image Decomposition for Infrared and Visible Image Fusion	Paper	Code	IJCAI	AE	自监督	2020
RFN-Nest	RFN-Nest: An end-to-end residual fusion network for infrared and visible images	Paper	Code	InfFus	AE	自监督	2021
CSF	Classification Saliency-Based Rule for Visible and Infrared Image Fusion	Paper	Code	TCI	AE	自监督	2021
DRF	DRF: Disentangled Representation for Visible and Infrared Image Fusion	Paper	Code	TIM	AE	自监督	2021
SEDRFuse	SEDRFuse: A Symmetric Encoder–Decoder With Residual Block Network for Infrared and Visible Image Fusion	Paper	Code	TIM	AE	自监督	2021
MFEIF	Learning a Deep Multi-Scale Feature Ensemble and an Edge-Attention Guidance for Image Fusion	Paper		TCSVT	AE	自监督	2021
Meta-Learning	Different Input Resolutions and Arbitrary Output Resolution: A Meta Learning-Based Deep Framework for Infrared and Visible Image Fusion	Paper		TIP	CNN	无监督	2021
RXDNFuse	RXDNFuse: A aggregated residual dense network for infrared and visible image fusion	Paper	Code	InfFus	CNN	无监督	2021
STDFusionNet	STDFusionNet: An Infrared and Visible Image Fusion Network Based on Salient Target Detection	Paper	Code	TIM	CNN	无监督	2021
D2LE	A Bilevel Integrated Model With Data-Driven Layer Ensemble for Multi-Modality Image Fusion	Paper		TIP	CNN	无监督	2021
HAF	Searching a Hierarchically Aggregated Fusion Architecture for Fast Multi-Modality Image Fusion	Paper	Code	ACM MM	CNN	无监督	2021
SDDGAN	Semantic-supervised Infrared and Visible Image Fusion via a Dual-discriminator Generative Adversarial Network	Paper	Code	TMM	GAN	无监督	2021
Detail-GAN	Infrared and visible image fusion via detail preserving adversarial learning	Paper	Code	InfFus	GAN	无监督	2021
Perception-GAN	Image fusion based on generative adversarial network consistent with perception	Paper	Code	InfFus	GAN	无监督	2021
GAN-FM	GAN-FM: Infrared and Visible Image Fusion Using GAN With Full-Scale Skip Connection and Dual Markovian Discriminators	Paper	Code	TCI	GAN	无监督	2021
AttentionFGAN	AttentionFGAN: Infrared and Visible Image Fusion Using Attention-Based Generative Adversarial Networks	Paper		TMM	GAN	无监督	2021
GANMcC	GANMcC: A Generative Adversarial Network With Multiclassification Constraints for Infrared and Visible Image Fusion	Paper	Code	TIM	GAN	无监督	2021
MgAN-Fuse	Multigrained Attention Network for Infrared and Visible Image Fusion	Paper		TIM	GAN	无监督	2021
TC-GAN	Infrared and Visible Image Fusion via Texture Conditional Generative Adversarial Network	Paper		TCSVT	GAN	无监督	2021
AUIF	Efficient and model-based infrared and visible image fusion via algorithm unrolling	Paper	Code	TCSVT	AE	自监督	2021
TarDAL	Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detection	Paper	Code	CVPR	GAN	无监督	2022
RFNet	RFNet: Unsupervised Network for Mutually Reinforcing Multi-modal Image Registration and Fusion	Paper	Code	CVPR	CNN	无监督	2022
SeAFusion	Image fusion in the loop of high-level vision tasks: A semantic-aware real-time infrared and visible image fusion network	Paper	Code	InfFus	CNN	无监督	2022
PIAFusion	PIAFusion: A progressive infrared and visible image fusion network based on illumination aware	Paper	Code	InfFus	CNN	无监督	2022
UMF-CMGR	Unsupervised Misaligned Infrared and Visible Image Fusion via Cross-Modality Image Generation and Registration	Paper	Code	IJCAI	CNN	无监督	2022
DetFusion	DetFusion: A Detection-driven Infrared and Visible Image Fusion Network	Paper	Code	ACM MM	CNN	无监督	2022
DIVFusion	DIVFusion: Darkness-free infrared and visible image fusion	Paper	Code	InfFus	CNN	无监督	2023
PSFusion	Rethinking the necessity of image fusion in high-level vision tasks: A practical infrared and visible image fusion network based on progressive semantic injection and scene fidelity	Paper	Code	InfFus	CNN	无监督	2023

医学图像融合(Medical image fusion)

方法	标题	论文	代码	发表期刊或会议	基础框架	监督范式	年份
CNN	A medical image fusion method based on convolutional neural networks	Paper		ICIF	CNN	无监督	2017
Zero-LMF	Zero-Learning Fast Medical Image Fusion	Paper	Code	ICIF	CNN	无监督	2019
DDcGAN	Learning a Generative Model for Fusing Infrared and Visible Images via Conditional Generative Adversarial Network with Dual Discriminators	Paper	Code	IJCAI	GAN	无监督	2019
GFPPC-GAN	Green Fluorescent Protein and Phase-Contrast Image Fusion via Generative Adversarial Networks	Paper		CMMM	GAN	无监督	2019
CCN-CP	Multi-modality medical image fusion using convolutional neural network and contrast pyramid	Paper		Sensors	CNN	无监督	2020
DDcGAN	DDcGAN: A Dual-Discriminator Conditional Generative Adversarial Network for Multi-Resolution Image Fusion	Paper	Code	TIP	GAN	无监督	2020
MGMDcGAN	Medical Image Fusion Using Multi-Generator Multi-Discriminator Conditional Generative Adversarial Network	Paper	Code	Access	GAN	无监督	2020
D2LE	A Bilevel Integrated Model With Data-Driven Layer Ensemble for Multi-Modality Image Fusion	Paper		TIP	CNN	无监督	2021
HAF	Searching a Hierarchically Aggregated Fusion Architecture for Fast Multi-Modality Image Fusion	Paper	Code	ACM MM	CNN	无监督	2021
EMFusion	EMFusion: An unsupervised enhanced medical image fusion network	Paper	Code	InfFus	CNN	无监督	2021
DPCN-Fusion	Green Fluorescent Protein and Phase Contrast Image Fusion Via Detail Preserving Cross Network	Paper	Code	TCI	CNN	无监督	2021
MSPRN	A multiscale residual pyramid attention network for medical image fusion	Paper	Code	BSPC	CNN	无监督	2021
DCGAN	Medical image fusion method based on dense block and deep convolutional generative adversarial network	Paper		NCA	GAN	无监督	2021

数字摄影图像融合(Digital Photography Image Fusion)

多曝光图像融合(Multi-exposure image fusion)

方法	标题	论文	代码	发表期刊或会议	基础框架	监督范式	年份
DeepFuse	DeepFuse: A Deep Unsupervised Approach for Exposure Fusion with Extreme Exposure Image Pairs	Paper	Code	ICCV	CNN	无监督	2017
CNN	Multi-exposure fusion with CNN features	Paper	Code	ICIP	CNN	无监督	2018
MEF-Net	Deep guided learning for fast multi-exposure image fusion	Paper	Code	TIP	CNN	无监督	2020
ICEN	Multi-exposure high dynamic range imaging with informative content enhanced network	Paper		NC	CNN	无监督	2020
MEF-GAN	MEF-GAN: Multi-Exposure Image Fusion via Generative Adversarial Networks	Paper	Code	TIP	GAN	无监督	2020
CF-Net	Deep coupled feedback network for joint exposure fusion and image super-resolutions	Paper	Code	TIP	CNN	无监督	2021
UMEF	Deep unsupervised learning based on color un-referenced loss functions for multi-exposure image fusion	Paper	Code	InFus	CNN	无监督	2021
PA-AGN	Two exposure fusion using prior-aware generative adversarial network	Paper		TMM	GAN	无监督	2021
AGAL	Attention-guided Global-local Adversarial Learning for Detail-preserving Multi-exposure Image Fusion	Paper	Code	TCSVT	GAN	无监督	2022
GANFuse	GANFuse: a novel multi-exposure image fusion method based on generative adversarial networks	Paper		NCAA	GAN	无监督	2021
DRLF	Automatic Intermediate Generation With Deep Reinforcement Learning for Robust Two-Exposure Image Fusion	Paper		TNNLS	CNN	无监督	2021
Trans-MEF	TransMEF: A Transformer-Based Multi-Exposure Image Fusion Framework using Self-Supervised Multi-Task Learning	Paper	Code	AAAI	AE	自监督	2022
DPE-MEF	Multi-exposure image fusion via deep perceptual enhancement	Paper	Code	InFus	CNN	无监督	2022

多聚焦图像融合(Multi-focus image fusion)

方法	标题	论文	代码	发表期刊或会议	基础框架	监督范式	年份
CNN	Multi-focus image fusion with a deep convolutional neural network	Paper	Code	InFus	CNN	有监督	2017
ECNN	Ensemble of CNN for multi-focus image fusion	Paper	Code	InFus	CNN	有监督	2019
MLFCNN	Multilevel features convolutional neural network for multifocus image fusion	Paper		TCI	CNN	有监督	2019
DRPL	DRPL: Deep Regression Pair Learning for Multi-Focus Image Fusion	Paper	Code	TIP	CNN	有监督	2020
MMF-Net	An α-Matte Boundary Defocus Model-Based Cascaded Network for Multi-Focus Image Fusion	Paper	Code	TCI	CNN	有监督	2020
MFF-SSIM	Towards Reducing Severe Defocus Spread Effects for Multi-Focus Image Fusion via an Optimization Based Strategy	Paper	Code	Sensors	CNN	无监督	2020
MFNet	Structural Similarity Loss for Learning to Fuse Multi-Focus Images	Paper		TIP	CNN	有监督	2021
GEU-Net	Global-Feature Encoding U-Net (GEU-Net) for Multi-Focus Image Fusion [GEU-Net	Paper	Code	TCI	CNN	自监督	2021
DTMNet	DTMNet: A Discrete Tchebichef Moments-Based Deep Neural Network for Multi-Focus Image Fusion	Paper		TMM	CNN	无监督	2021
SMFuse	SMFuse: Multi-Focus Image Fusion Via Self-Supervised Mask-Optimization	Paper	Code	NCA	CNN	无监督	2021
ACGAN	A generative adversarial network with adaptive constraints for multi-focus image fusion	Paper	Code	ICCV	GAN	有监督	2021
FuseGAN	Learning to fuse multi-focus image via conditional generative adversarial network	Paper		TIP	GAN	有监督	2020
D2FMIF	Depth-Distilled Multi-focus Image Fusion	Paper		TMM	CNN	有监督	2019
SESF-Fuse	SESF-Fuse: an unsupervised deep model for multi-focus image fusion	Paper	Code	NCAA	CNN	有监督	2020
MFF-GAN	MFF-GAN: An unsupervised generative adversarial network with adaptive and gradient joint constraints for multi-focus image fusion	Paper	Code	InFus	GAN	无监督	2021
MFIF-GAN	MFIF-GAN: A new generative adversarial network for multi-focus image fusion	Paper	Code	SPIC	GAN	有监督	2021

遥感影像融合(Remote Sensing Image Fusion)

全色图像锐化(Pansharpening)

方法	标题	论文	代码	发表期刊或会议	基础框架	监督范式	年份
PNN	Pansharpening by Convolutional Neural Networks	Paper	Code	RS	CNN	有监督	2016
PanNet	PanNet: A deep network architecture for pan-sharpening	Paper	Code	PanNet	CNN	有监督	2017
TFNet	Remote sensing image fusion based on two-stream fusion network	Paper	Code	TFNet	CNN	有监督	2020
BKL	Unsupervised Blur Kernel Learning for Pansharpening	Paper		IGARSS	CNN	无监督	2020
Pan-GAN	Pan-GAN: An unsupervised pan-sharpening method for remote sensing image fusion	Paper	Code	InFus	GAN	无监督	2020
UCNN	Pansharpening via Unsupervised Convolutional Neural Networks	Paper		JSTARS	CNN	无监督	2020
UPSNet	UPSNet: Unsupervised Pan-Sharpening Network With Registration Learning Between Panchromatic and Multi-Spectral Images	Paper		ACCESS	CNN	无监督	2020
GPPNN	Deep Gradient Projection Networks for Pan-sharpening	Paper	Code	CVPR	CNN	有监督	2021
GTP-PNet	GTP-PNet: A residual learning network based on gradient transformation prior for pansharpening	Paper	Code	ISPRS	CNN	有监督	2021
HMCNN	Pan-Sharpening Via High-Pass Modification Convolutional Neural Network	Paper	Code	ICIP	CNN	有监督	2021
SDPNet	SDPNet: A Deep Network for Pan-Sharpening With Enhanced Information Representation	Paper	Code	TGRS	CNN	有监督	2021
SIPSA-Net	SIPSA-Net: Shift-Invariant Pan Sharpening with Moving Object Alignment for Satellite Imagery	Paper	Code	CVPR	CNN	有监督	2021
SRPPNN	Super-resolution-guided progressive pansharpening based on a deep convolutional neural network	Paper	Code	TGRS	CNN	有监督	2021
PSGAN	PSGAN: A generative adversarial network for remote sensing image pan-sharpening	Paper	Code	TGRS	GAN	有监督	2021
MDCNN	MDCNN: multispectral pansharpening based on a multiscale dilated convolutional neural network	Paper		JRS	CNN	有监督	2021
LDP-Net	LDP-Net: An Unsupervised Pansharpening Network Based on Learnable Degradation Processes	Paper	Code	Arxiv	CNN	无监督	2021
DIGAN	Pansharpening approach via two-stream detail injection based on relativistic generative adversarial networks	Paper		ESA	GAN	有监督	2022
DPFN	A Dual-Path Fusion Network for Pan-Sharpening	Paper	Code	TGRS	CNN	有监督	2022
MSGAN	An Unsupervised Multi-scale Generative Adversarial Network for Remote Sensing Image Pan-Sharpening	Paper		ICMM	GAN	无监督	2022
UCGAN	Unsupervised Cycle-Consistent Generative Adversarial Networks for Pan Sharpening	Paper	Code	TGRS	GAN	无监督	2022
D2TNet	A ConvLSTM Network with Dual-direction Transfer for Pan-sharpening	Paper	Code	TGRS	CNN	有监督	2022
P2Sharpen	P2Sharpen: A progressive pansharpening network with deep spectral transformation	Paper	Code	INFFus	CNN	有监督	2023

通用图像融合框架(General Image Fusion Framerwork)

方法	标题	论文	代码	发表期刊或会议	基础框架	监督范式	年份
IFCNN	IFCNN: A general image fusion framework based on convolutional neural network	Paper	Code	InFus	CNN	有监督	2020
FusionDN	FusionDN: A Unified Densely Connected Network for Image Fusion	Paper	Code	AAAI	CNN	无监督	2020
PMGI	Rethinking the Image Fusion: A Fast Unified Image Fusion Network based on Proportional Maintenance of Gradient and Intensity	Paper	Code	AAAI	CNN	无监督	2020
CU-Net	Deep Convolutional Neural Network for Multi-Modal Image Restoration and Fusion	Paper	Code	TPAMI	CNN	有监督	2021
SDNet	SDNet: A Versatile Squeeze-and-Decomposition Network for Real-Time Image Fusion	Paper	Code	IJCV	CNN	无监督	2021
DIF-Net	Unsupervised Deep Image Fusion With Structure Tensor Representations	Paper	Code	TIP	CNN	无监督	2021
IFSepR	IFSepR: A general framework for image fusion based on separate representation learning	Paper		TMM	AE	自监督	2021
MTOE	Multiple Task-Oriented Encoders for Unified Image Fusion	Paper		ICME	CNN	无监督	2021
U2Fusion	U2Fusion: A Unified Unsupervised Image Fusion Network	Paper	Code	TPAMI	CNN	无监督	2022
SwinFusion	SwinFusion: Cross-domain Long-range Learning for General Image Fusion via Swin Transformer	Paper	Code	JAS	Transformer	无监督	2022
DeFusion	Fusion from Decomposition: A Self-Supervised Decomposition Approach for Image Fusion	Paper	Code	ECCV	CNN	无监督	2022
UIFGAN	UIFGAN: An unsupervised continual-learning generative adversarial network for unified image fusion	Paper	Code	INFFus	GAN	无监督	2023

综述(Survey)

标题	论文	代码	发表期刊或会议	年份
A review of remote sensing image fusion methods	Paper		InFus	2016
Pixel-level image fusion: A survey of the state of the art	Paper		InFus	2017
Deep learning for pixel-level image fusion: Recent advances and future prospects	Paper		InFus	2018
Infrared and visible image fusion methods and applications: A survey	Paper		InFus	2019
Multi-focu image fusion: A Survey of the state of the art	Paper		InFus	2020
Image fusion meets deep learning: A survey and perspective	Paper		InFus	2021
Deep Learning-based Multi-focus Image Fusion: A Survey and A Comparative Study	Paper	Code	TPAMI	2021
Benchmarking and comparing multi-exposure image fusion algorithms	Paper	Code	InFus	2021
Current advances and future perspectives of image fusion: A comprehensive review	Paper	Code	InFus	2023

数据集(Dataset)

融合场景	数据集	下载链接
红外和可见光图像融合	TNO	https://figshare.com/articles/dataset/TNO_Image_Fusion_Dataset/1008029
	INO	https://www.ino.ca/en/technologies/video-analytics-dataset/videos/
	RoadScene	https://github.com/hanna-xu/RoadScene
	MSRS	https://github.com/Linfeng-Tang/MSRS
	LLVIP	https://bupt-ai-cz.github.io/LLVIP/
	M3FD	https://github.com/JinyuanLiu-CV/TarDAL

医学图像融合	Harvard	http://www.med.harvard.edu/AANLIB/home.html

多曝光图像融合	MEF	https://github.com/csjcai/SICE
多曝光图像融合	MEFB	https://github.com/xingchenzhang/MEFB

多聚焦图像融合	Lytro	https://mansournejati.ece.iut.ac.ir/content/lytro-multi-focus-dataset
	MFI-WHU	https://github.com/HaoZhang1018/MFI-WHU
	MFFW	https://www.semanticscholar.org/paper/MFFW%3A-A-new-dataset-for-multi-focus-image-fusion-Xu-Wei/4c0658f338849284ee4251a69b3c323908e62b45

全色图像锐化	GaoFen	https://directory.eoportal.org/web/eoportal/satellite-missions/g
	WorldView	https://worldview.earthdata.nasa.gov/
	GeoEye	https://earth.esa.int/eogateway/missions/geoeye-1
	QuickBird	https://www.satimagingcorp.com/satellite-sensors/quickbird/

评估指标(Evaluation Metric)

通用评估指标(General evaluation metric)

通用评估指标位于：https://github.com/Linfeng-Tang/Image-Fusion/tree/main/General%20Evaluation%20Metric or https://github.com/Linfeng-Tang/Evaluation-for-Image-Fusion

遥感影像融合评估指标(Evaluation metric for pansharpening)

Citation

如果我们的总结对你有所帮助, 请引用以下论文：

@article{Tang2022Survey,
  title={Deep learning-based image fusion: A survey},
  author={Tang, Linfeng and Zhang, Hao and Xu, Han and Ma, Jiayi},  
  journal={Journal of Image and Graphics}
}

@article{Ma2022SwinFusion,
  title={SwinFusion: Cross-domain Long-range Learning for General Image Fusion via Swin Transformer},
  author={Ma, Jiayi and Tang, Linfeng and Fan, Fan and Huang, Jun and Mei, Xiaoguang and Ma, Yong},
  journal={IEEE/CAA Journal of Automatica Sinica},
  volume={9},
  number={7},
  pages={1200--1217},
  year={2022},
  publisher={IEEE}
}

@article{TANG2022SeAFusion,
title = {Image fusion in the loop of high-level vision tasks: A semantic-aware real-time infrared and visible image fusion network},
author = {Linfeng Tang and Jiteng Yuan and Jiayi Ma},
journal = {Information Fusion},
volume = {82},
pages = {28-42},
year = {2022},
issn = {1566-2535},
publisher={Elsevier}
}

@article{Tang2022PIAFusion,
  title={PIAFusion: A progressive infrared and visible image fusion network based on illumination aware},
  author={Tang, Linfeng and Yuan, Jiteng and Zhang, Hao and Jiang, Xingyu and Ma, Jiayi},
  journal={Information Fusion},
  volume = {83-84},
  pages = {79-92},
  year = {2022},
  issn = {1566-2535},
  publisher={Elsevier}
}

@article{Tang2022DIVFusion,
  title={DIVFusion: Darkness-free infrared and visible image fusion},
  author={Tang, Linfeng and Xiang, Xinyu and Zhang, Hao and Gong, Meiqi and Ma, Jiayi},
  journal={Information Fusion},
  volume = {91},
  pages = {477-493},
  year = {2023},
  publisher={Elsevier}
}

@article{ma2021STDFusionNet,
  title={STDFusionNet: An Infrared and Visible Image Fusion Network Based on Salient Target Detection},
  author={Jiayi Ma, Linfeng Tang, Meilong Xu, Hao Zhang, and Guobao Xiao},
  journal={IEEE Transactions on Instrumentation and Measurement},
  year={2021},
  volume={70},
  number={},
  pages={1-13},
  doi={10.1109/TIM.2021.3075747}，
  publisher={IEEE}
}

如果有任何问题请联系：linfeng0419@gmail.com

Name		Name	Last commit message	Last commit date
Latest commit History 98 Commits
General Evaluation Metric		General Evaluation Metric
README.md		README.md

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Repository files navigation

图像融合(Image Fusion)

News

Citation

1. 红外和可见光图像融合 (Infrared & Visible Image Fusion)

多模图像融合(Multi-Modal Image Fusion)方法汇总

通用图像融合(General Image Fusion)方法汇总

多模图像融合(Multi-Modal Image Fusion)

红外和可见光图像融合(Infrared and visible image fusion)

医学图像融合(Medical image fusion)

数字摄影图像融合(Digital Photography Image Fusion)

多曝光图像融合(Multi-exposure image fusion)

多聚焦图像融合(Multi-focus image fusion)

遥感影像融合(Remote Sensing Image Fusion)

全色图像锐化(Pansharpening)

通用图像融合框架(General Image Fusion Framerwork)

综述(Survey)

数据集(Dataset)

评估指标(Evaluation Metric)

通用评估指标(General evaluation metric)

遥感影像融合评估指标(Evaluation metric for pansharpening)

Citation

About

Uh oh!

Releases

Packages

Contributors 2

Languages

Linfeng-Tang/Image-Fusion

Folders and files

Latest commit

History

Repository files navigation

图像融合(Image Fusion)

News

Citation

1. 红外和可见光图像融合 (Infrared & Visible Image Fusion)

多模图像融合(Multi-Modal Image Fusion)方法汇总

通用图像融合(General Image Fusion)方法汇总

多模图像融合(Multi-Modal Image Fusion)

红外和可见光图像融合(Infrared and visible image fusion)

医学图像融合(Medical image fusion)

数字摄影图像融合(Digital Photography Image Fusion)

多曝光图像融合(Multi-exposure image fusion)

多聚焦图像融合(Multi-focus image fusion)

遥感影像融合(Remote Sensing Image Fusion)

全色图像锐化(Pansharpening)

通用图像融合框架(General Image Fusion Framerwork)

综述(Survey)

数据集(Dataset)

评估指标(Evaluation Metric)

通用评估指标(General evaluation metric)

遥感影像融合评估指标(Evaluation metric for pansharpening)

Citation

About

Resources

Uh oh!

Stars

Watchers

Forks

Releases

Packages 0

Contributors 2

Languages

Packages