Cited time in webofscience Cited time in scopus

Privacy-Preserving Image Captioning with Deep Learning and Double Random Phase Encoding

Title
Privacy-Preserving Image Captioning with Deep Learning and Double Random Phase Encoding
Author(s)
Martin, Antoinette DeborahAhmadzadeh, EzatMoon, Inkyu
Issued Date
2022-08
Citation
Mathematics, v.10, no.16
Type
Article
Author Keywords
image captioningdeep learningprivacy preservingdouble random phase encodingdeep neural networks
Keywords
NEURAL-NETWORKENCRYPTIONTRANSFORMCLASSIFICATIONATTACK
ISSN
2227-7390
Abstract
Cloud storage has become eminent, with an increasing amount of data being produced daily; this has led to substantial concerns related to privacy and unauthorized access. To secure privacy, users can protect their private data by uploading encrypted data to the cloud. Data encryption allows computations to be performed on encrypted data without the data being decrypted in the cloud, which requires enormous computation resources and prevents unauthorized access to private data. Data analysis such as classification, and image query and retrieval can preserve data privacy if the analysis is performed using encrypted data. This paper proposes an image-captioning method that generates captions over encrypted images using an encoder–decoder framework with attention and a double random phase encoding (DRPE) encryption scheme. The images are encrypted with DRPE to protect them and then fed to an encoder that adopts the ResNet architectures to generate a fixed-length vector of representations or features. The decoder is designed with long short-term memory to process the features and embeddings to generate descriptive captions for the images. We evaluate the predicted captions with BLEU, METEOR, ROUGE, and CIDEr metrics. The experimental results demonstrate the feasibility of our privacy-preserving image captioning on the popular benchmark Flickr8k dataset. © 2022 by the authors.
URI
http://hdl.handle.net/20.500.11750/17017
DOI
10.3390/math10162859
Publisher
MDPI AG
Related Researcher
  • 문인규 Moon, Inkyu
  • Research Interests 지능형 영상시스템; AI기반 영상분석; AI기반 암호시스템; Intelligent Imaging Systems; AI-based Image Analysis; AI-based Cryptosystems & Cryptanalysis
Files in This Item:

There are no files associated with this item.

Appears in Collections:
Department of Robotics and Mechatronics Engineering Intelligent Imaging and Vision Systems Laboratory 1. Journal Articles

qrcode

  • twitter
  • facebook
  • mendeley

Items in Repository are protected by copyright, with all rights reserved, unless otherwise indicated.

BROWSE