» Articles » PMID: 30703026

Hybrid LSTM and Encoder-Decoder Architecture for Detection of Image Forgeries

Overview
Date 2019 Feb 1
PMID 30703026
Citations 15
Authors
Affiliations
Soon will be listed here.
Abstract

With advanced image journaling tools, one can easily alter the semantic meaning of an image by exploiting certain manipulation techniques such as copy clone, object splicing, and removal, which mislead the viewers. In contrast, the identification of these manipulations becomes a very challenging task as manipulated regions are not visually apparent. This paper proposes a high-confidence manipulation localization architecture that utilizes resampling features, long short-term memory (LSTM) cells, and an encoder-decoder network to segment out manipulated regions from non-manipulated ones. Resampling features are used to capture artifacts, such as JPEG quality loss, upsampling, downsampling, rotation, and shearing. The proposed network exploits larger receptive fields (spatial maps) and frequency-domain correlation to analyze the discriminative characteristics between the manipulated and non-manipulated regions by incorporating the encoder and LSTM network. Finally, the decoder network learns the mapping from low-resolution feature maps to pixel-wise predictions for image tamper localization. With the predicted mask provided by the final layer (softmax) of the proposed architecture, end-to-end training is performed to learn the network parameters through back-propagation using the ground-truth masks. Furthermore, a large image splicing dataset is introduced to guide the training process. The proposed method is capable of localizing image manipulations at the pixel level with high precision, which is demonstrated through rigorous experimentation on three diverse datasets.

Citing Articles

Examination of customized questioned digital documents.

Adedayo O, Olivier M J Forensic Sci. 2025; 70(2):550-565.

PMID: 39918028 PMC: 11874256. DOI: 10.1111/1556-4029.15703.


Ensemble and Pre-Training Approach for Echo State Network and Extreme Learning Machine Models.

Tang L, Wang J, Wang M, Zhao C Entropy (Basel). 2024; 26(3).

PMID: 38539726 PMC: 10968746. DOI: 10.3390/e26030215.


Block mapping and dual-matrix-based watermarking for image authentication with self-recovery capability.

Li X, Chen Q, Chu R, Wang W PLoS One. 2024; 19(2):e0297632.

PMID: 38306338 PMC: 10836676. DOI: 10.1371/journal.pone.0297632.


Detection of AI-Created Images Using Pixel-Wise Feature Extraction and Convolutional Neural Networks.

Martin-Rodriguez F, Garcia-Mojon R, Fernandez-Barciela M Sensors (Basel). 2023; 23(22).

PMID: 38005425 PMC: 10674908. DOI: 10.3390/s23229037.


Multi-Attention Segmentation Networks Combined with the Sobel Operator for Medical Images.

Lu F, Tang C, Liu T, Zhang Z, Li L Sensors (Basel). 2023; 23(5).

PMID: 36904754 PMC: 10007317. DOI: 10.3390/s23052546.