A Manually Captured and Modified Phone Screen Image Dataset for Widget Classification on CNNs

The applications and user interfaces (UIs) of smart mobile devices are constantly diversifying. For example,deep learning can be an innovative solution to classify widgets in screen images for increasing convenience. To this end, the present research leverages captured images and the ReDraw dataset...

Full description

Saved in:
Bibliographic Details
Published in:Journal of information processing systems 2022, 18(2), 74, pp.197-207
Main Authors: 변성철, 한성수, 정창성
Format: Article
Language:English
Subjects:
컴퓨터학
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:The applications and user interfaces (UIs) of smart mobile devices are constantly diversifying. For example,deep learning can be an innovative solution to classify widgets in screen images for increasing convenience. To this end, the present research leverages captured images and the ReDraw dataset to write deep learningdatasets for image classification purposes. First, as the validation for datasets using ResNet50 and EfficientNet,the experiments show that the dataset composed in this study is helpful for classification according to a widget'sfunctionality. An implementation for widget detection and classification on RetinaNet and EfficientNet is thenexecuted. Finally, the research suggests the Widg-C and Widg-D datasets—a deep learning dataset for identifyingthe widgets of smart devices—and implementing them for use with representative convolutional neuralnetwork models. KCI Citation Count: 0
ISSN:1976-913X
2092-805X
DOI:10.3745/JIPS.02.0169