图像融合论文及代码整理最全大合集

Posted 2022-05-11 Timer-419

最全图像融合论文及代码整理

Github项目地址：https://github.com/Linfeng-Tang/Image-Fusion （欢迎大家Start、 Fork、 Fellow一键三连哦~）

图像融合(Image Fusion)

• 多模图像融合(Multi-Modal Image Fusion)
  • 红外和可见光图像融合(Infrared and visible image fusion)
  • 医学图像融合(Medical image fusion)
• 数字摄影图像融合(Digital Photography Image Fusion)
  • 多曝光图像融合(Multi-exposure image fusion)
  • 多聚焦图像融合(Multi-focus image fusion)
• 遥感影像融合(Remote Sensing Image Fusion)
  • 全色图像锐化(Pansharpening)
• 通用图像融合框架(General Image Fusion Framerwork)
• 综述(Survey)
• 数据集(Dataset)
• 评估指标(Evaluation Metric)
  • 通用评估指标(General evaluation metric)
  • 遥感影像融合评估指标
• Citation

图像融合系列博客还有：

1. 图像融合综述论文整理参见：图像融合综述论文整理
2. 图像融合评估指标参见：红外和可见光图像融合评估指标
3. 图像融合常用数据集整理参见：图像融合常用数据集整理
4. 通用图像融合框架论文及代码整理参见：通用图像融合框架论文及代码整理
5. 基于深度学习的红外和可见光图像融合论文及代码整理参见:基于深度学习的红外和可见光图像融合论文及代码整理
6. 更加详细的红外和可见光图像融合代码参见：红外和可见光图像融合论文及代码整理
7. 基于深度学习的多曝光图像融合论文及代码整理参见：基于深度学习的多曝光图像融合论文及代码整理
8. 基于深度学习的多聚焦图像融合论文及代码整理参见：基于深度学习的多聚焦图像融合(Multi-focus Image Fusion)论文及代码整理
9. 基于深度学习的全色图像锐化论文及代码整理参见：基于深度学习的全色图像锐化(Pansharpening)论文及代码整理
10. 基于深度学习的医学图像融合论文及代码整理参见：基于深度学习的医学图像融合(Medical image fusion)论文及代码整理
11. 彩色图像融合程序参见：彩色图像融合
12. SeAFusion:首个结合高级视觉任务的图像融合框架参见：SeAFusion:首个结合高级视觉任务的图像融合框架

多模图像融合(Multi-Modal Image Fusion)

红外和可见光图像融合(Infrared and visible image fusion)

方法	标题	论文	代码	发表期刊或会议	基础框架	监督范式	发表年份
DenseFuse	DenseFuse: A Fusion Approach to Infrared and Visible Images	Paper	Code	TIP	AE	自监督	2019
FusionGAN	FusionGAN: A generative adversarial network for infrared and   visible image fusion	Paper	Code	InfFus	GAN	无监督	2019
DDcGAN	Learning a Generative Model for Fusing Infrared and Visible   Images via Conditional Generative Adversarial Network with Dual   Discriminators	Paper	Code	IJCAI	GAN	无监督	2019
NestFuse	NestFuse: An Infrared and Visible Image Fusion Architecture   Based on Nest Connection and Spatial/Channel Attention Models	Paper	Code	TIM	AE	自监督	2020
DDcGAN	DDcGAN: A dual-discriminator conditional generative   adversarial network for multi-resolution image fusion	Paper	Code	TIP	GAN	无监督	2020
RFN-Nest	RFN-Nest: An end-to-end residual fusion network for infrared   and visible images	Paper	Code	InfFus	AE	自监督	2021
CSF	Classification Saliency-Based Rule for Visible and Infrared   Image Fusion	Paper	Code	TCI	AE	自监督	2021
DRF	DRF: Disentangled Representation for Visible and Infrared   Image Fusion	Paper	Code	TIM	AE	自监督	2021
SEDRFuse	SEDRFuse: A Symmetric Encoder–Decoder With Residual Block   Network for Infrared and Visible Image Fusion	Paper	Code	TIM	AE	自监督	2021
EAGIF	Learning a Deep Multi-Scale Feature Ensemble and an   Edge-Attention Guidance for Image Fusion	Paper		TCSVT	AE	自监督	2021
Meta-Learning	Different Input Resolutions and Arbitrary Output Resolution: A   Meta Learning-Based Deep Framework for Infrared and Visible Image Fusion	Paper		TIP	CNN	无监督	2021
RXDNFuse	RXDNFuse: A aggregated residual dense network for infrared and   visible image fusion	Paper		InfFus	CNN	无监督	2021
STDFusionNet	STDFusionNet: An Infrared and Visible Image Fusion Network   Based on Salient Target Detection	Paper	Code	TIM	CNN	无监督	2021
D2LE	A Bilevel Integrated Model With Data-Driven Layer Ensemble for   Multi-Modality Image Fusion	Paper		TIP	CNN	无监督	2021
HAF	Searching a Hierarchically Aggregated Fusion Architecture for   Fast Multi-Modality Image Fusion	Paper	Code	ACM MM	CNN	无监督	2021
SDDGAN	Semantic-supervised Infrared and Visible Image Fusion via a   Dual-discriminator Generative Adversarial Network	Paper	Code	TMM	GAN	无监督	2021
Detail-GAN	Infrared and visible image fusion via detail preserving   adversarial learning	Paper	Code	InfFus	GAN	无监督	2021
Perception-GAN	Image fusion based on   generative adversarial network consistent with perception	Paper	Code	InfFus	GAN	无监督	2021
GAN-FM	GAN-FM: Infrared and Visible   Image Fusion Using GAN With Full-Scale Skip Connection and Dual Markovian   Discriminators	Paper	Code	TCI	GAN	无监督	2021
AttentionFGAN	AttentionFGAN: Infrared and Visible Image Fusion Using   Attention-Based Generative Adversarial Networks	Paper		TMM	GAN	无监督	2021
GANMcC	GANMcC: A Generative   Adversarial Network With Multiclassification Constraints for Infrared and   Visible Image Fusion	Paper	Code	TIM	GAN	无监督	2021
MgAN-Fuse	Multigrained Attention Network for Infrared and Visible Image   Fusion	Paper		TIM	GAN	无监督	2021
TC-GAN	Infrared and Visible Image   Fusion via Texture Conditional Generative Adversarial Network	Paper		TCSVT	GAN	无监督	2021
SeAFusion	Image fusion in the loop of   high-level vision tasks: A semantic-aware real-time infrared and visible   image fusion network	Paper	Code	InfFus	CNN	无监督	2022
PIAFusion	PIAFusion: A progressive infrared and visible image fusion   network based on illumination aware	Paper	Code	InfFus	CNN	无监督	2022

医学图像融合(Medical image fusion)

方法	标题	论文	代码	发表期刊或会议	基础框架	监督范式	年份
CNN	A medical image fusion method based on   convolutional neural networks	Paper		ICIF	CNN	无监督	2017
Zero-LMF	Zero-Learning Fast Medical Image Fusion	Paper	Code	ICIF	CNN	无监督	2019
DDcGAN	Learning a Generative Model for Fusing Infrared and Visible   Images via Conditional Generative Adversarial Network with Dual   Discriminators	Paper	Code	IJCAI	GAN	无监督	2019
GFPPC-GAN	Green Fluorescent Protein and Phase-Contrast   Image Fusion via Generative Adversarial Networks	Paper		CMMM	GAN	无监督	2019
CCN-CP	Multi-modality medical image fusion using convolutional neural   network and contrast pyramid	Paper		Sensors	CNN	无监督	2020
DDcGAN	DDcGAN: A Dual-Discriminator Conditional   Generative Adversarial Network for Multi-Resolution Image Fusion	Paper	Code	TIP	GAN	无监督	2020
MGMDcGAN	Medical Image Fusion Using Multi-Generator   Multi-Discriminator Conditional Generative Adversarial Network	Paper	Code	Access	GAN	无监督	2020
D2LE	A Bilevel Integrated Model With Data-Driven Layer Ensemble for   Multi-Modality Image Fusion	Paper		TIP	CNN	无监督	2021
HAF	Searching a Hierarchically Aggregated Fusion   Architecture for Fast Multi-Modality Image Fusion	Paper	Code	ACM MM	CNN	无监督	2021
EMFusion	EMFusion: An unsupervised enhanced medical   image fusion network	Paper	Code	InfFus	CNN	无监督	2021
DPCN-Fusion	Green Fluorescent Protein and Phase Contrast   Image Fusion Via Detail Preserving Cross Network	Paper	Code	TCI	CNN	无监督	2021
MSPRN	A multiscale residual pyramid attention   network for medical image fusion	Paper	Code	BSPC	CNN	无监督	2021
DCGAN	Medical image fusion method based on dense   block and deep convolutional generative adversarial network	Paper		NCA	GAN	无监督	2021

数字摄影图像融合(Digital Photography Image Fusion)

多曝光图像融合(Multi-exposure image fusion)

方法	标题	论文	代码	发表期刊或会议	基础框架	监督范式	年份
DeepFuse	DeepFuse: A Deep Unsupervised Approach for Exposure Fusion   with Extreme Exposure Image Pairs	Paper	Code	ICCV	CNN	无监督	2017
CNN	Multi-exposure fusion with CNN features	Paper	Code	ICIP	CNN	无监督	2018
MEF-Net	Deep guided learning for fast multi-exposure image fusion	Paper	Code	TIP	CNN	无监督	2020
ICEN	Multi-exposure high dynamic range imaging with informative   content enhanced network	Paper		NC	CNN	无监督	2020
MEF-GAN	MEF-GAN: Multi-Exposure Image Fusion via Generative   Adversarial Networks	Paper	Code	TIP	GAN	无监督	2020
CF-Net	Deep coupled feedback network for joint exposure fusion and   image super-resolutions	Paper	Code	TIP	CNN	无监督	2021
UMEF	Deep unsupervised learning based on color un-referenced loss   functions for multi-exposure image fusion	Paper	Code	InFus	CNN	无监督	2021
PA-AGN	Two exposure fusion using prior-aware generative adversarial   network	Paper		TMM	GAN	无监督	2021
AGAL	Attention-guided Global-local Adversarial Learning for   Detail-preserving Multi-exposure Image Fusion	Paper	Code	TCSVT	GAN	无监督	2021
GANFuse	GANFuse: a novel multi-exposure image fusion method based on   generative adversarial networks	Paper		NCAA	GAN	无监督	2021
DRLF	Automatic Intermediate Generation With Deep Reinforcement   Learning for Robust Two-Exposure Image Fusion	Paper		TNNLS	CNN	无监督	2021
Trans-MEF	TransMEF: A Transformer-Based Multi-Exposure Image Fusion   Framework using Self-Supervised Multi-Task Learning	Paper	Code	AAAI	AE	自监督	2022
DPE-MEF	Multi-exposure image fusion via deep perceptual enhancement	Paper	Code	InFus	CNN	无监督	2022

多聚焦图像融合(Multi-focus image fusion)

方法	标题	论文	代码	发表期刊或会议	基础框架	监督范式	年份
CNN	Multi-focus image fusion with a deep convolutional neural   network	Paper	Code	InFus	CNN	有监督	2017
ECNN	Ensemble of CNN for multi-focus image fusion	Paper	Code	InFus	CNN	有监督	2019
MLFCNN	Multilevel features convolutional neural network for   multifocus image fusion	Paper		TCI	CNN	有监督	2019
DRPL	DRPL: Deep Regression Pair Learning for Multi-Focus Image   Fusion	Paper	Code	TIP	CNN	有监督	2020
MMF-Net	An α-Matte Boundary Defocus Model-Based Cascaded Network for   Multi-Focus Image Fusion	Paper	Code	TIP	CNN	有监督	2020
MFF-SSIM	Towards Reducing Severe Defocus Spread Effects for Multi-Focus   Image Fusion via an Optimization Based Strategy	Paper	Code	Sensors	CNN	无监督	2020
MFNet	Structural Similarity Loss for Learning to Fuse Multi-Focus   Images	Paper		TIP	CNN	有监督	2021
GEU-Net	Global-Feature Encoding U-Net (GEU-Net) for Multi-Focus Image   Fusion [GEU-Net	Paper	Code	TCI	CNN	自监督	2021
DTMNet	DTMNet: A Discrete Tchebichef Moments-Based Deep Neural   Network for Multi-Focus Image Fusion	Paper		TMM	CNN	无监督	2021
SMFuse	SMFuse: Multi-Focus   Image Fusion Via Self-Supervised Mask-Optimization	Paper	Code	NCA	CNN	无监督	2021
ACGAN	A generative adversarial network with adaptive constraints for   multi-focus image fusion	Paper	Code	ICCV	GAN	有监督	2021
FuseGAN	Learning to fuse multi-focus image via conditional generative   adversarial network	Paper		TIP	GAN	有监督	2020
D2FMIF	Depth-Distilled Multi-focus Image Fusion	Paper		TMM	CNN	有监督	2019
SESF-Fuse	SESF-Fuse: an unsupervised deep model for multi-focus image   fusion	Paper	Code	NCAA	CNN	有监督	2020
MFF-GAN	MFF-GAN: An unsupervised generative adversarial network with   adaptive and gradient joint constraints for multi-focus image fusion	Paper	Code	InFus	GAN	无监督	2021
MFIF-GAN	MFIF-GAN: A new generative adversarial network for multi-focus   image fusion	Paper	Code	SPIC	GAN	有监督	2021

遥感影像融合(Remote Sensing Image Fusion)

全色图像锐化(Pansharpening)

方法	标题	论文	代码	发表期刊或会议	基础框架	监督范式	年份
PNN	Pansharpening by Convolutional Neural   Networks	Paper	Code	RS	CNN	有监督	2016
PanNet	PanNet: A deep network architecture for   pan-sharpening	Paper	Code	PanNet	CNN	有监督	2017
TFNet	Remote sensing image fusion based on   two-stream fusion network	Paper	Code	TFNet	CNN	有监督	2020
BKL	Unsupervised Blur Kernel Learning for   Pansharpening	Paper		IGARSS	CNN	无监督	2020
Pan-GAN	Pan-GAN: An unsupervised pan-sharpening   method for remote sensing image fusion	Paper	Code	InFus	GAN	无监督	2020
UCNN	Pansharpening via Unsupervised Convolutional   Neural Networks	Paper		JSTARS	CNN	无监督	2020
UPSNet	UPSNet: Unsupervised Pan-Sharpening Network   With Registration Learning Between Panchromatic and Multi-Spectral Images	Paper		ACCESS	CNN	无监督	2020
GPPNN	Deep Gradient Projection Networks for   Pan-sharpening	Paper	Code	CVPR	CNN	有监督	2021
GTP-PNet	GTP-PNet: A residual learning network based   on gradient transformation prior for pansharpening	Paper	Code	ISPRS	CNN	有监督	2021
HMCNN	Pan-Sharpening Via High-Pass Modification   Convolutional Neural Network	Paper	Code	ICIP	CNN	有监督	2021
SDPNet	SDPNet: A Deep Network for Pan-Sharpening   With Enhanced Information Representation	Paper	Code	TGRS	CNN	有监督	2021
SIPSA-Net	SIPSA-Net: Shift-Invariant Pan Sharpening   with Moving Object Alignment for Satellite Imagery	Paper	Code	CVPR	CNN	有监督	2021
SRPPNN	Super-resolution-guided progressive   pansharpening based on a deep convolutional neural network	Paper	Code	TGRS	CNN	有监督	2021
PSGAN	PSGAN: A generative adversarial network for   remote sensing image pan-sharpening	Paper	Code	TGRS	GAN	有监督	2021
MDCNN	MDCNN: multispectral pansharpening based on a   multiscale dilated convolutional neural network	Paper		JRS	CNN	有监督	2021
LDP-Net	LDP-Net: An Unsupervised Pansharpening   Network Based on Learnable Degradation Processes	Paper	Code	Arxiv	CNN	无监督	2021
DIGAN	Pansharpening approach via two-stream detail   injection based on relativistic generative adversarial networks	Paper		ESA	GAN	有监督	2022
DPFN	A Dual-Path Fusion Network for Pan-Sharpening	Paper	Code	TGRS	CNN	有监督	2022
MSGAN	An Unsupervised Multi-scale Generative   Adversarial Network for Remote Sensing Image Pan-Sharpening	Paper		ICMM	GAN	无监督	2022
UCGAN	Unsupervised Cycle-Consistent Generative   Adversarial Networks for Pan Sharpening	Paper	Code	TGRS	GAN	无监督	2022

通用图像融合框架(General Image Fusion Framerwork)

方法	标题	论文	代码	发表期刊或会议	基础框架	监督范式	年份
IFCNN	IFCNN: A general image fusion framework based on convolutional   neural network	Paper	Code	InFus	CNN	有监督	2020
FusionDN	FusionDN: A Unified Densely Connected Network for Image   Fusion	Paper	Code	AAAI	CNN	无监督	2020
PMGI	Rethinking the Image Fusion: A Fast Unified Image Fusion   Network based on Proportional Maintenance of Gradient and Intensity	Paper	Code	AAAI	CNN	无监督	2020
CU-Net	Deep Convolutional Neural Network for Multi-Modal Image   Restoration and Fusion	Paper		TPAMI	CNN	有监督	2021
SDNet	SDNet: A Versatile Squeeze-and-Decomposition Network for   Real-Time Image Fusion	Paper	Code	IJCV	CNN	无监督	2021
DIF-Net	Unsupervised Deep Image Fusion With Structure Tensor   Representations	Paper	Code	TIP	CNN	无监督	2021
IFSepR	IFSepR: A general framework for image fusion based on separate   representation learning	Paper		TMM	AE	自监督	2021
MTOE	Multiple Task-Oriented Encoders for Unified Image Fusion	Paper		ICME	CNN	无监督	2021
U2Fusion	U2Fusion: A Unified Unsupervised Image Fusion Network	Paper	Code	TPAMI	CNN	无监督	2022

综述(Survey)

标题	论文	代码	发表期刊或会议	年份
A review of   remote sensing image fusion methods	Paper		InFus	2016
Pixel-level   image fusion: A survey of the state of the art	Paper		InFus	2017
Deep learning for pixel-level image fusion: Recent advances and future prospects	Paper		InFus	2018
Infrared and visible image fusion methods and applications: A survey	Paper		InFus	2019
Multi-focu image fusion: A Survey of the state of the art	Paper		InFus	2020
Image fusion meets deep learning: A survey and perspective	Paper		InFus	2021
Deep Learning-based Multi-focus Image Fusion: A Survey and A Comparative   Study	Paper	Code	TPAMI	2021
Benchmarking and comparing multi-exposure image fusion algorithms	Paper	Code	InFus	2021

数据集(Dataset)

融合场景	数据集	下载链接
红外和可见光图像融合	TNO	https://figshare.com/articles/dataset/TNO_Image_Fusion_Dataset/1008029
	INO	https://www.ino.ca/en/technologies/video-analytics-dataset/videos/
	RoadScene	https://github.com/hanna-xu/RoadScene
	MSRS	https://github.com/Linfeng-Tang/MSRS
	LLVIP	https://bupt-ai-cz.github.io/LLVIP/
	M3FD	https://github.com/JinyuanLiu-CV/TarDAL
医学图像融合	Harvard	http://www.med.harvard.edu/AANLIB/home.html
多曝光图像融合	MEF	https://github.com/csjcai/SICE
	MEFB	https://github.com/xingchenzhang/MEFB
多聚焦图像融合	Lytro	https://mansournejati.ece.iut.ac.ir/content/lytro-multi-focus-dataset
	MFI-WHU	https://github.com/HaoZhang1018/MFI-WHU
	MFFW	https://www.semanticscholar.org/paper/MFFW%3A-A-new-dataset-for-multi-focus-image-fusion-Xu-Wei/4c0658f338849284ee4251a69b3c323908e62b45
全色图像锐化	GaoFen	https://directory.eoportal.org/web/eoportal/satellite-missions/g
	WorldView	https://worldview.earthdata.nasa.gov/
	GeoEye	https://earth.esa.int/eogateway/missions/geoeye-1
	QuickBird	https://www.satimagingcorp.com/satellite-sensors/quickbird/

评估指标(Evaluation Metric)

通用评估指标(General evaluation metric)

通用评估指标位于：https://github.com/Linfeng-Tang/Image-Fusion/tree/main/General%20Evaluation%20Metric
or
https://github.com/Linfeng-Tang/Evaluation-for-Image-Fusion

遥感影像融合评估指标(Evaluation metric for pansharpening)

如果有任何问题请联系：2458707749