An Encrypted Speech Retrieval Method Based on Deep Perceptual Hashing and CNN-BiLSTM

• Published in: IEEE access 2020-01, Vol.8, p.1-1
• Main Authors: Zhang, Qiuyu, Li, Yuzhou, Hu, Yinjie, Zhao, Xuejiao
• Format: Article
• Language: English
• Subjects: 4D hyperchaotic system; Algorithms; Artificial neural networks; CNN-BiLSTM; Deep perceptual hashing; Encrypted speech retrieval; Encryption; Feature extraction; Filter banks; Hidden Markov models; Machine learning; Mel frequency cepstral coefficient; Neural networks; Retrieval; Short term; Spectrogram; Speech; Speech feature extraction
• ISSN: 2169-3536; 2169-3536
• DOI: 10.1109/ACCESS.2020.3015876

Since convolutional neural network (CNN) can only extract local features, and long shortterm memory (LSTM) neural network model has a large number of learning calculations, a long processing time and an obvious degree of information loss as the length of speech increases. Utilizing the characteristics of autonomous feature extraction in deep learning, CNN and bidirectional long short-term memory (BiLSTM) network are combined to present an encrypted speech retrieval method based on deep perceptual hashing and CNN-BiLSTM. Firstly, the proposed method extracts the Log-Mel Spectrogram/MFCC features of the original speech and enters the CNN and BiLSTM networks in turn for model training. Secondly, we use the trained fusion network model to learn the deep perceptual feature and generate deep perceptual hashing sequences. Finally, the normalized Hamming distance algorithm is used for matching retrieval. In order to protect the speech security in the cloud, a speech encryption algorithm based on a 4D hyperchaotic system is proposed. The experimental results show that the proposed method has good discrimination, robustness, recall and precision compared with the existing methods, and it has good retrieval efficiency and retrieval accuracy for longer speech. Meanwhile, the proposed speech encryption algorithm has a high key space to resist exhaustive attacks.