A Mobile Image Aesthetics Processing System with Intelligent Scene Perception

Image aesthetics processing (IAP) is used primarily to enhance the aesthetic quality of images. However, IAP faces several issues, including its failure to analyze the influence of visual scene information and the difficulty of deploying IAP capabilities to mobile devices. This study proposes an aut...

Full description

Saved in:
Bibliographic Details
Published in:Applied sciences 2024-01, Vol.14 (2), p.822
Main Authors: Zhao, Xiaoyan, Shi, Ling, Han, Zhao, Yuan, Peiyan
Format: Article
Language:English
Subjects:
aesthetic evaluation
Aesthetics
Algorithms
Architecture
Automation
Collaboration
Energy consumption
Equipment and supplies
image aesthetics processing
image attributes
Image processing
Machine learning
Mobile devices
Neural networks
scene recognition
Smartphones
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Image aesthetics processing (IAP) is used primarily to enhance the aesthetic quality of images. However, IAP faces several issues, including its failure to analyze the influence of visual scene information and the difficulty of deploying IAP capabilities to mobile devices. This study proposes an automatic IAP system (IAPS) for mobile devices that integrates machine learning and traditional image-processing methods. First, we employ an extremely computation-efficient deep learning model, ShuffleNet, designed for mobile devices as our scene recognition model. Then, to enable computational inferencing on resource-constrained edge devices, we use a modern mobile machine-learning library, TensorFlow Lite, to convert the model type to TFLite format. Subsequently, we adjust the image contrast and color saturation using group filtering, respectively. These methods enable us to achieve maximal aesthetic enhancement of images with minimal parameter adjustments. Finally, we use the InceptionResNet-v2 aesthetic evaluation model to rate the images. Even when employing the benchmark model with an accuracy of 70%, the score of the IAPS processing image is verified to be higher and more effective compared with a state-of-the-art smartphone’s beautification function. Additionally, an anonymous questionnaire survey with 100 participants is conducted, and the result shows that IAPS enhances the aesthetic appeal of images based on the public’s preferences.
ISSN:2076-3417
2076-3417
DOI:10.3390/app14020822