Loading…

Unsupervised Image Classification for Deep Representation Learning

Deep clustering against self-supervised learning is a very important and promising direction for unsupervised visual representation learning since it requires little domain knowledge to design pretext tasks. However, the key component, embedding clustering, limits its extension to the extremely larg...

Full description

Saved in:
Bibliographic Details
Published in:arXiv.org 2020-08
Main Authors: Chen, Weijie, Pu, Shiliang, Xie, Di, Yang, Shicai, Guo, Yilu, Lin, Luojun
Format: Article
Language:English
Subjects:
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by
cites
container_end_page
container_issue
container_start_page
container_title arXiv.org
container_volume
creator Chen, Weijie
Pu, Shiliang
Xie, Di
Yang, Shicai
Guo, Yilu
Lin, Luojun
description Deep clustering against self-supervised learning is a very important and promising direction for unsupervised visual representation learning since it requires little domain knowledge to design pretext tasks. However, the key component, embedding clustering, limits its extension to the extremely large-scale dataset due to its prerequisite to save the global latent embedding of the entire dataset. In this work, we aim to make this framework more simple and elegant without performance decline. We propose an unsupervised image classification framework without using embedding clustering, which is very similar to standard supervised training manner. For detailed interpretation, we further analyze its relation with deep clustering and contrastive learning. Extensive experiments on ImageNet dataset have been conducted to prove the effectiveness of our method. Furthermore, the experiments on transfer learning benchmarks have verified its generalization to other downstream tasks, including multi-label image classification, object detection, semantic segmentation and few-shot image classification.
format article
fullrecord <record><control><sourceid>proquest</sourceid><recordid>TN_cdi_proquest_journals_2416047444</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2416047444</sourcerecordid><originalsourceid>FETCH-proquest_journals_24160474443</originalsourceid><addsrcrecordid>eNqNitEKwiAUQCUIGrV_EHoeOHVbz62ioKeo5yHrOhxLzat9f0F9QE8HzjkzknEhymIjOV-QHHFkjPG64VUlMrK9WUwewssg3OnpoQag7aQQjTa9isZZql2gOwBPL-ADINj49WdQwRo7rMhcqwkh_3FJ1of9tT0WPrhnAozd6FKwn9RxWdZMNlJK8d_1BvKTOjM</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2416047444</pqid></control><display><type>article</type><title>Unsupervised Image Classification for Deep Representation Learning</title><source>Publicly Available Content (ProQuest)</source><creator>Chen, Weijie ; Pu, Shiliang ; Xie, Di ; Yang, Shicai ; Guo, Yilu ; Lin, Luojun</creator><creatorcontrib>Chen, Weijie ; Pu, Shiliang ; Xie, Di ; Yang, Shicai ; Guo, Yilu ; Lin, Luojun</creatorcontrib><description>Deep clustering against self-supervised learning is a very important and promising direction for unsupervised visual representation learning since it requires little domain knowledge to design pretext tasks. However, the key component, embedding clustering, limits its extension to the extremely large-scale dataset due to its prerequisite to save the global latent embedding of the entire dataset. In this work, we aim to make this framework more simple and elegant without performance decline. We propose an unsupervised image classification framework without using embedding clustering, which is very similar to standard supervised training manner. For detailed interpretation, we further analyze its relation with deep clustering and contrastive learning. Extensive experiments on ImageNet dataset have been conducted to prove the effectiveness of our method. Furthermore, the experiments on transfer learning benchmarks have verified its generalization to other downstream tasks, including multi-label image classification, object detection, semantic segmentation and few-shot image classification.</description><identifier>EISSN: 2331-8422</identifier><language>eng</language><publisher>Ithaca: Cornell University Library, arXiv.org</publisher><subject>Classification ; Clustering ; Datasets ; Embedding ; Image classification ; Image detection ; Image segmentation ; Object recognition ; Representations ; Supervised learning</subject><ispartof>arXiv.org, 2020-08</ispartof><rights>2020. This work is published under http://arxiv.org/licenses/nonexclusive-distrib/1.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://www.proquest.com/docview/2416047444?pq-origsite=primo$$EHTML$$P50$$Gproquest$$Hfree_for_read</linktohtml><link.rule.ids>780,784,25753,37012,44590</link.rule.ids></links><search><creatorcontrib>Chen, Weijie</creatorcontrib><creatorcontrib>Pu, Shiliang</creatorcontrib><creatorcontrib>Xie, Di</creatorcontrib><creatorcontrib>Yang, Shicai</creatorcontrib><creatorcontrib>Guo, Yilu</creatorcontrib><creatorcontrib>Lin, Luojun</creatorcontrib><title>Unsupervised Image Classification for Deep Representation Learning</title><title>arXiv.org</title><description>Deep clustering against self-supervised learning is a very important and promising direction for unsupervised visual representation learning since it requires little domain knowledge to design pretext tasks. However, the key component, embedding clustering, limits its extension to the extremely large-scale dataset due to its prerequisite to save the global latent embedding of the entire dataset. In this work, we aim to make this framework more simple and elegant without performance decline. We propose an unsupervised image classification framework without using embedding clustering, which is very similar to standard supervised training manner. For detailed interpretation, we further analyze its relation with deep clustering and contrastive learning. Extensive experiments on ImageNet dataset have been conducted to prove the effectiveness of our method. Furthermore, the experiments on transfer learning benchmarks have verified its generalization to other downstream tasks, including multi-label image classification, object detection, semantic segmentation and few-shot image classification.</description><subject>Classification</subject><subject>Clustering</subject><subject>Datasets</subject><subject>Embedding</subject><subject>Image classification</subject><subject>Image detection</subject><subject>Image segmentation</subject><subject>Object recognition</subject><subject>Representations</subject><subject>Supervised learning</subject><issn>2331-8422</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2020</creationdate><recordtype>article</recordtype><sourceid>PIMPY</sourceid><recordid>eNqNitEKwiAUQCUIGrV_EHoeOHVbz62ioKeo5yHrOhxLzat9f0F9QE8HzjkzknEhymIjOV-QHHFkjPG64VUlMrK9WUwewssg3OnpoQag7aQQjTa9isZZql2gOwBPL-ADINj49WdQwRo7rMhcqwkh_3FJ1of9tT0WPrhnAozd6FKwn9RxWdZMNlJK8d_1BvKTOjM</recordid><startdate>20200820</startdate><enddate>20200820</enddate><creator>Chen, Weijie</creator><creator>Pu, Shiliang</creator><creator>Xie, Di</creator><creator>Yang, Shicai</creator><creator>Guo, Yilu</creator><creator>Lin, Luojun</creator><general>Cornell University Library, arXiv.org</general><scope>8FE</scope><scope>8FG</scope><scope>ABJCF</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>HCIFZ</scope><scope>L6V</scope><scope>M7S</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>PTHSS</scope></search><sort><creationdate>20200820</creationdate><title>Unsupervised Image Classification for Deep Representation Learning</title><author>Chen, Weijie ; Pu, Shiliang ; Xie, Di ; Yang, Shicai ; Guo, Yilu ; Lin, Luojun</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-proquest_journals_24160474443</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2020</creationdate><topic>Classification</topic><topic>Clustering</topic><topic>Datasets</topic><topic>Embedding</topic><topic>Image classification</topic><topic>Image detection</topic><topic>Image segmentation</topic><topic>Object recognition</topic><topic>Representations</topic><topic>Supervised learning</topic><toplevel>online_resources</toplevel><creatorcontrib>Chen, Weijie</creatorcontrib><creatorcontrib>Pu, Shiliang</creatorcontrib><creatorcontrib>Xie, Di</creatorcontrib><creatorcontrib>Yang, Shicai</creatorcontrib><creatorcontrib>Guo, Yilu</creatorcontrib><creatorcontrib>Lin, Luojun</creatorcontrib><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>Materials Science &amp; Engineering Collection</collection><collection>ProQuest Central (Alumni)</collection><collection>ProQuest Central</collection><collection>ProQuest Central Essentials</collection><collection>AUTh Library subscriptions: ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Engineering Collection</collection><collection>Engineering Database</collection><collection>Publicly Available Content (ProQuest)</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>Engineering Collection</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Chen, Weijie</au><au>Pu, Shiliang</au><au>Xie, Di</au><au>Yang, Shicai</au><au>Guo, Yilu</au><au>Lin, Luojun</au><format>book</format><genre>document</genre><ristype>GEN</ristype><atitle>Unsupervised Image Classification for Deep Representation Learning</atitle><jtitle>arXiv.org</jtitle><date>2020-08-20</date><risdate>2020</risdate><eissn>2331-8422</eissn><abstract>Deep clustering against self-supervised learning is a very important and promising direction for unsupervised visual representation learning since it requires little domain knowledge to design pretext tasks. However, the key component, embedding clustering, limits its extension to the extremely large-scale dataset due to its prerequisite to save the global latent embedding of the entire dataset. In this work, we aim to make this framework more simple and elegant without performance decline. We propose an unsupervised image classification framework without using embedding clustering, which is very similar to standard supervised training manner. For detailed interpretation, we further analyze its relation with deep clustering and contrastive learning. Extensive experiments on ImageNet dataset have been conducted to prove the effectiveness of our method. Furthermore, the experiments on transfer learning benchmarks have verified its generalization to other downstream tasks, including multi-label image classification, object detection, semantic segmentation and few-shot image classification.</abstract><cop>Ithaca</cop><pub>Cornell University Library, arXiv.org</pub><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier EISSN: 2331-8422
ispartof arXiv.org, 2020-08
issn 2331-8422
language eng
recordid cdi_proquest_journals_2416047444
source Publicly Available Content (ProQuest)
subjects Classification
Clustering
Datasets
Embedding
Image classification
Image detection
Image segmentation
Object recognition
Representations
Supervised learning
title Unsupervised Image Classification for Deep Representation Learning
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-02T00%3A44%3A17IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest&rft_val_fmt=info:ofi/fmt:kev:mtx:book&rft.genre=document&rft.atitle=Unsupervised%20Image%20Classification%20for%20Deep%20Representation%20Learning&rft.jtitle=arXiv.org&rft.au=Chen,%20Weijie&rft.date=2020-08-20&rft.eissn=2331-8422&rft_id=info:doi/&rft_dat=%3Cproquest%3E2416047444%3C/proquest%3E%3Cgrp_id%3Ecdi_FETCH-proquest_journals_24160474443%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=2416047444&rft_id=info:pmid/&rfr_iscdi=true