Loading…
Unsupervised Image Classification for Deep Representation Learning
Deep clustering against self-supervised learning is a very important and promising direction for unsupervised visual representation learning since it requires little domain knowledge to design pretext tasks. However, the key component, embedding clustering, limits its extension to the extremely larg...
Saved in:
Published in: | arXiv.org 2020-08 |
---|---|
Main Authors: | , , , , , |
Format: | Article |
Language: | English |
Subjects: | |
Online Access: | Get full text |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
cited_by | |
---|---|
cites | |
container_end_page | |
container_issue | |
container_start_page | |
container_title | arXiv.org |
container_volume | |
creator | Chen, Weijie Pu, Shiliang Xie, Di Yang, Shicai Guo, Yilu Lin, Luojun |
description | Deep clustering against self-supervised learning is a very important and promising direction for unsupervised visual representation learning since it requires little domain knowledge to design pretext tasks. However, the key component, embedding clustering, limits its extension to the extremely large-scale dataset due to its prerequisite to save the global latent embedding of the entire dataset. In this work, we aim to make this framework more simple and elegant without performance decline. We propose an unsupervised image classification framework without using embedding clustering, which is very similar to standard supervised training manner. For detailed interpretation, we further analyze its relation with deep clustering and contrastive learning. Extensive experiments on ImageNet dataset have been conducted to prove the effectiveness of our method. Furthermore, the experiments on transfer learning benchmarks have verified its generalization to other downstream tasks, including multi-label image classification, object detection, semantic segmentation and few-shot image classification. |
format | article |
fullrecord | <record><control><sourceid>proquest</sourceid><recordid>TN_cdi_proquest_journals_2416047444</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2416047444</sourcerecordid><originalsourceid>FETCH-proquest_journals_24160474443</originalsourceid><addsrcrecordid>eNqNitEKwiAUQCUIGrV_EHoeOHVbz62ioKeo5yHrOhxLzat9f0F9QE8HzjkzknEhymIjOV-QHHFkjPG64VUlMrK9WUwewssg3OnpoQag7aQQjTa9isZZql2gOwBPL-ADINj49WdQwRo7rMhcqwkh_3FJ1of9tT0WPrhnAozd6FKwn9RxWdZMNlJK8d_1BvKTOjM</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2416047444</pqid></control><display><type>article</type><title>Unsupervised Image Classification for Deep Representation Learning</title><source>Publicly Available Content (ProQuest)</source><creator>Chen, Weijie ; Pu, Shiliang ; Xie, Di ; Yang, Shicai ; Guo, Yilu ; Lin, Luojun</creator><creatorcontrib>Chen, Weijie ; Pu, Shiliang ; Xie, Di ; Yang, Shicai ; Guo, Yilu ; Lin, Luojun</creatorcontrib><description>Deep clustering against self-supervised learning is a very important and promising direction for unsupervised visual representation learning since it requires little domain knowledge to design pretext tasks. However, the key component, embedding clustering, limits its extension to the extremely large-scale dataset due to its prerequisite to save the global latent embedding of the entire dataset. In this work, we aim to make this framework more simple and elegant without performance decline. We propose an unsupervised image classification framework without using embedding clustering, which is very similar to standard supervised training manner. For detailed interpretation, we further analyze its relation with deep clustering and contrastive learning. Extensive experiments on ImageNet dataset have been conducted to prove the effectiveness of our method. Furthermore, the experiments on transfer learning benchmarks have verified its generalization to other downstream tasks, including multi-label image classification, object detection, semantic segmentation and few-shot image classification.</description><identifier>EISSN: 2331-8422</identifier><language>eng</language><publisher>Ithaca: Cornell University Library, arXiv.org</publisher><subject>Classification ; Clustering ; Datasets ; Embedding ; Image classification ; Image detection ; Image segmentation ; Object recognition ; Representations ; Supervised learning</subject><ispartof>arXiv.org, 2020-08</ispartof><rights>2020. This work is published under http://arxiv.org/licenses/nonexclusive-distrib/1.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://www.proquest.com/docview/2416047444?pq-origsite=primo$$EHTML$$P50$$Gproquest$$Hfree_for_read</linktohtml><link.rule.ids>780,784,25753,37012,44590</link.rule.ids></links><search><creatorcontrib>Chen, Weijie</creatorcontrib><creatorcontrib>Pu, Shiliang</creatorcontrib><creatorcontrib>Xie, Di</creatorcontrib><creatorcontrib>Yang, Shicai</creatorcontrib><creatorcontrib>Guo, Yilu</creatorcontrib><creatorcontrib>Lin, Luojun</creatorcontrib><title>Unsupervised Image Classification for Deep Representation Learning</title><title>arXiv.org</title><description>Deep clustering against self-supervised learning is a very important and promising direction for unsupervised visual representation learning since it requires little domain knowledge to design pretext tasks. However, the key component, embedding clustering, limits its extension to the extremely large-scale dataset due to its prerequisite to save the global latent embedding of the entire dataset. In this work, we aim to make this framework more simple and elegant without performance decline. We propose an unsupervised image classification framework without using embedding clustering, which is very similar to standard supervised training manner. For detailed interpretation, we further analyze its relation with deep clustering and contrastive learning. Extensive experiments on ImageNet dataset have been conducted to prove the effectiveness of our method. Furthermore, the experiments on transfer learning benchmarks have verified its generalization to other downstream tasks, including multi-label image classification, object detection, semantic segmentation and few-shot image classification.</description><subject>Classification</subject><subject>Clustering</subject><subject>Datasets</subject><subject>Embedding</subject><subject>Image classification</subject><subject>Image detection</subject><subject>Image segmentation</subject><subject>Object recognition</subject><subject>Representations</subject><subject>Supervised learning</subject><issn>2331-8422</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2020</creationdate><recordtype>article</recordtype><sourceid>PIMPY</sourceid><recordid>eNqNitEKwiAUQCUIGrV_EHoeOHVbz62ioKeo5yHrOhxLzat9f0F9QE8HzjkzknEhymIjOV-QHHFkjPG64VUlMrK9WUwewssg3OnpoQag7aQQjTa9isZZql2gOwBPL-ADINj49WdQwRo7rMhcqwkh_3FJ1of9tT0WPrhnAozd6FKwn9RxWdZMNlJK8d_1BvKTOjM</recordid><startdate>20200820</startdate><enddate>20200820</enddate><creator>Chen, Weijie</creator><creator>Pu, Shiliang</creator><creator>Xie, Di</creator><creator>Yang, Shicai</creator><creator>Guo, Yilu</creator><creator>Lin, Luojun</creator><general>Cornell University Library, arXiv.org</general><scope>8FE</scope><scope>8FG</scope><scope>ABJCF</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>HCIFZ</scope><scope>L6V</scope><scope>M7S</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>PTHSS</scope></search><sort><creationdate>20200820</creationdate><title>Unsupervised Image Classification for Deep Representation Learning</title><author>Chen, Weijie ; Pu, Shiliang ; Xie, Di ; Yang, Shicai ; Guo, Yilu ; Lin, Luojun</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-proquest_journals_24160474443</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2020</creationdate><topic>Classification</topic><topic>Clustering</topic><topic>Datasets</topic><topic>Embedding</topic><topic>Image classification</topic><topic>Image detection</topic><topic>Image segmentation</topic><topic>Object recognition</topic><topic>Representations</topic><topic>Supervised learning</topic><toplevel>online_resources</toplevel><creatorcontrib>Chen, Weijie</creatorcontrib><creatorcontrib>Pu, Shiliang</creatorcontrib><creatorcontrib>Xie, Di</creatorcontrib><creatorcontrib>Yang, Shicai</creatorcontrib><creatorcontrib>Guo, Yilu</creatorcontrib><creatorcontrib>Lin, Luojun</creatorcontrib><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>Materials Science & Engineering Collection</collection><collection>ProQuest Central (Alumni)</collection><collection>ProQuest Central</collection><collection>ProQuest Central Essentials</collection><collection>AUTh Library subscriptions: ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Engineering Collection</collection><collection>Engineering Database</collection><collection>Publicly Available Content (ProQuest)</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>Engineering Collection</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Chen, Weijie</au><au>Pu, Shiliang</au><au>Xie, Di</au><au>Yang, Shicai</au><au>Guo, Yilu</au><au>Lin, Luojun</au><format>book</format><genre>document</genre><ristype>GEN</ristype><atitle>Unsupervised Image Classification for Deep Representation Learning</atitle><jtitle>arXiv.org</jtitle><date>2020-08-20</date><risdate>2020</risdate><eissn>2331-8422</eissn><abstract>Deep clustering against self-supervised learning is a very important and promising direction for unsupervised visual representation learning since it requires little domain knowledge to design pretext tasks. However, the key component, embedding clustering, limits its extension to the extremely large-scale dataset due to its prerequisite to save the global latent embedding of the entire dataset. In this work, we aim to make this framework more simple and elegant without performance decline. We propose an unsupervised image classification framework without using embedding clustering, which is very similar to standard supervised training manner. For detailed interpretation, we further analyze its relation with deep clustering and contrastive learning. Extensive experiments on ImageNet dataset have been conducted to prove the effectiveness of our method. Furthermore, the experiments on transfer learning benchmarks have verified its generalization to other downstream tasks, including multi-label image classification, object detection, semantic segmentation and few-shot image classification.</abstract><cop>Ithaca</cop><pub>Cornell University Library, arXiv.org</pub><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | EISSN: 2331-8422 |
ispartof | arXiv.org, 2020-08 |
issn | 2331-8422 |
language | eng |
recordid | cdi_proquest_journals_2416047444 |
source | Publicly Available Content (ProQuest) |
subjects | Classification Clustering Datasets Embedding Image classification Image detection Image segmentation Object recognition Representations Supervised learning |
title | Unsupervised Image Classification for Deep Representation Learning |
url | http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-02T00%3A44%3A17IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest&rft_val_fmt=info:ofi/fmt:kev:mtx:book&rft.genre=document&rft.atitle=Unsupervised%20Image%20Classification%20for%20Deep%20Representation%20Learning&rft.jtitle=arXiv.org&rft.au=Chen,%20Weijie&rft.date=2020-08-20&rft.eissn=2331-8422&rft_id=info:doi/&rft_dat=%3Cproquest%3E2416047444%3C/proquest%3E%3Cgrp_id%3Ecdi_FETCH-proquest_journals_24160474443%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=2416047444&rft_id=info:pmid/&rfr_iscdi=true |