Hyperdimensional Multimedia Perception and Frontier Security

Faculty of Applied Sciences, Macao Polytechnic University

Image Manipulation Localization Using Dual-Shallow Feature Pyramid Fusion and Boundary Contextual Incoherence Enhancement


Journal article


Yan Xiang, Xiaochen Yuan, Kaiqi Zhao, Tong Liu, Zhiyao Xie, Guoheng Huang, Jianqing Li
IEEE Transactions on Emerging Topics in Computational Intelligence, vol. 9, 2025, pp. 2858-2868


Link
Cite

Cite

APA   Click to copy
Xiang, Y., Yuan, X., Zhao, K., Liu, T., Xie, Z., Huang, G., & Li, J. (2025). Image Manipulation Localization Using Dual-Shallow Feature Pyramid Fusion and Boundary Contextual Incoherence Enhancement. IEEE Transactions on Emerging Topics in Computational Intelligence, 9, 2858–2868. https://doi.org/10.1109/TETCI.2024.3500025


Chicago/Turabian   Click to copy
Xiang, Yan, Xiaochen Yuan, Kaiqi Zhao, Tong Liu, Zhiyao Xie, Guoheng Huang, and Jianqing Li. “Image Manipulation Localization Using Dual-Shallow Feature Pyramid Fusion and Boundary Contextual Incoherence Enhancement.” IEEE Transactions on Emerging Topics in Computational Intelligence 9 (2025): 2858–2868.


MLA   Click to copy
Xiang, Yan, et al. “Image Manipulation Localization Using Dual-Shallow Feature Pyramid Fusion and Boundary Contextual Incoherence Enhancement.” IEEE Transactions on Emerging Topics in Computational Intelligence, vol. 9, 2025, pp. 2858–68, doi:10.1109/TETCI.2024.3500025.


BibTeX   Click to copy

@article{xiang2025a,
  title = {Image Manipulation Localization Using Dual-Shallow Feature Pyramid Fusion and Boundary Contextual Incoherence Enhancement},
  year = {2025},
  journal = {IEEE Transactions on Emerging Topics in Computational Intelligence},
  pages = {2858-2868},
  volume = {9},
  doi = {10.1109/TETCI.2024.3500025},
  author = {Xiang, Yan and Yuan, Xiaochen and Zhao, Kaiqi and Liu, Tong and Xie, Zhiyao and Huang, Guoheng and Li, Jianqing}
}

Abstract: This paper proposes a novel end-to-end network for Image Manipulation Localization (IML) comprising three modules: feature fusion, encoder, and decoder. To address the limitations of current DNN-based IML algorithms in accessing global features and segmenting tampered edges, we propose a Dual-shallow Feature Pyramid Fusion (DFPF) module. The DFPF module integrates semantic and texture features through a bidirectional pathway, forming RGB Feature Pyramids (RGBFP) and Local Textual Feature Pyramids (LTFP) using dual Hybrid ResNet50s in a ’Siamese' configuration. These feature pyramids are merged via multi-scale fusion to enhance global pyramid features for decoding. The LTFP branch includes a Pre-processing Block, Parallel Multi-Scale Convolution (PMSC), or Channel Split High-frequency Convolution (CSHC) to capture local textual features and subtle manipulation traces. The Encoder employs Transformer layers for robust global representations. At the same time, the Decoder uses Cascaded Boundary Context Inconsistent Enhancement (BCIE) Blocks to reconstruct a coarse-to-fine binary mask, enhancing texture inconsistencies at manipulated region boundaries. Additionally, we introduce an automated method for generating a large-scale forgery dataset via Photoshop Scripting, reducing labor costs. Our model effectively locates tampered regions of various shapes and sizes, improving boundary anomaly detection. Extensive experimental results demonstrate that our method significantly outperforms existing state-of-the-art models.