From image descriptions to visual denotations: New similarity metrics for semantic inference over event descriptions

We propose to use the of linguistic expressions (i.e. the set of images they describe) to define novel , which we show to be at least as beneficial as distributional similarities for two tasks that require semantic inference. To compute these denotational similarities, we construct a , i.e. a subsum...

Full description

Saved in:
Bibliographic Details
Published in:Transactions of the Association for Computational Linguistics 2014-12, Vol.2, p.67-78
Main Authors: Young, Peter, Lai, Alice, Hodosh, Micah, Hockenmaier, Julia
Format: Article
Language:English
Subjects:
Computational linguistics
Descriptions
Event semantics
Inference
Meaning
Semantics
Similarity
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by cdi_FETCH-LOGICAL-c3656-d84bf23b2814ce4c799e2c2edd5168742beb64994c2c10aa3d72593c6ae6eeb53
cites cdi_FETCH-LOGICAL-c3656-d84bf23b2814ce4c799e2c2edd5168742beb64994c2c10aa3d72593c6ae6eeb53
container_end_page 78
container_issue
container_start_page 67
container_title Transactions of the Association for Computational Linguistics
container_volume 2
creator Young, Peter
Lai, Alice
Hodosh, Micah
Hockenmaier, Julia
description We propose to use the of linguistic expressions (i.e. the set of images they describe) to define novel , which we show to be at least as beneficial as distributional similarities for two tasks that require semantic inference. To compute these denotational similarities, we construct a , i.e. a subsumption hierarchy over constituents and their denotations, based on a large corpus of 30K images and 150K descriptive captions.
doi_str_mv 10.1162/tacl_a_00166
format article
fullrecord <record><control><sourceid>proquest_mit_j</sourceid><recordid>TN_cdi_mit_journals_10_1162_tacl_a_00166</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><doaj_id>oai_doaj_org_article_351c68904b8948df9d0f0feb9463f97c</doaj_id><sourcerecordid>2893935969</sourcerecordid><originalsourceid>FETCH-LOGICAL-c3656-d84bf23b2814ce4c799e2c2edd5168742beb64994c2c10aa3d72593c6ae6eeb53</originalsourceid><addsrcrecordid>eNp1kU1LxDAQhosoKOrNHxDw4sHVfDVNBA8ifoHoRcFbSNOJZGmbNcmu6K83uiIr6GnCyzPPTJiq2iP4iBBBj7OxvTYaYyLEWrVFGW4mTDZP6yvvzWo3pSkujCQSC7pV5csYBuQH8wyog2Sjn2UfxoRyQAuf5qYv8Riy-UpP0B28ouQH35vo8xsaIEdvE3IhogSDGbO3yI8OIowWUFhARLCAMf-S71QbzvQJdr_rdvV4efFwfj25vb-6OT-7nVgmajHpJG8dZS2VhFvgtlEKqKXQdTURsuG0hVZwpbillmBjWNfQWjErDAiAtmbb1c3S2wUz1bNYvhnfdDBefwUhPmsTy8Y9aFYTK6TCvJWKy86pDjvsoFVcMKcaW1z7S9cshpc5pKynYR7Hsr6mUjHFaiVUoQ6XlI0hpQjuZyrB-vNMevVMBT9Y4oNf8f2Dnv6BfiILqhlmdaM0xZSUVo2Vfvez3_0fJ6ipzA</addsrcrecordid><sourcetype>Open Website</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2893935969</pqid></control><display><type>article</type><title>From image descriptions to visual denotations: New similarity metrics for semantic inference over event descriptions</title><source>Access via ProQuest (Open Access)</source><source>Social Science Premium Collection</source><source>Linguistics Collection</source><source>Linguistics and Language Behavior Abstracts (LLBA)</source><creator>Young, Peter ; Lai, Alice ; Hodosh, Micah ; Hockenmaier, Julia</creator><creatorcontrib>Young, Peter ; Lai, Alice ; Hodosh, Micah ; Hockenmaier, Julia</creatorcontrib><description>We propose to use the of linguistic expressions (i.e. the set of images they describe) to define novel , which we show to be at least as beneficial as distributional similarities for two tasks that require semantic inference. To compute these denotational similarities, we construct a , i.e. a subsumption hierarchy over constituents and their denotations, based on a large corpus of 30K images and 150K descriptive captions.</description><identifier>ISSN: 2307-387X</identifier><identifier>EISSN: 2307-387X</identifier><identifier>DOI: 10.1162/tacl_a_00166</identifier><language>eng</language><publisher>One Rogers Street, Cambridge, MA 02142-1209, USA: MIT Press</publisher><subject>Computational linguistics ; Descriptions ; Event semantics ; Inference ; Meaning ; Semantics ; Similarity</subject><ispartof>Transactions of the Association for Computational Linguistics, 2014-12, Vol.2, p.67-78</ispartof><rights>2014. This work is published under https://creativecommons.org/licenses/by/4.0/legalcode (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c3656-d84bf23b2814ce4c799e2c2edd5168742beb64994c2c10aa3d72593c6ae6eeb53</citedby><cites>FETCH-LOGICAL-c3656-d84bf23b2814ce4c799e2c2edd5168742beb64994c2c10aa3d72593c6ae6eeb53</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://www.proquest.com/docview/2893935969?pq-origsite=primo$$EHTML$$P50$$Gproquest$$Hfree_for_read</linktohtml><link.rule.ids>314,780,784,12851,21382,21394,25753,27924,27925,31269,33611,33911,37012,43733,43896,44590</link.rule.ids></links><search><creatorcontrib>Young, Peter</creatorcontrib><creatorcontrib>Lai, Alice</creatorcontrib><creatorcontrib>Hodosh, Micah</creatorcontrib><creatorcontrib>Hockenmaier, Julia</creatorcontrib><title>From image descriptions to visual denotations: New similarity metrics for semantic inference over event descriptions</title><title>Transactions of the Association for Computational Linguistics</title><description>We propose to use the of linguistic expressions (i.e. the set of images they describe) to define novel , which we show to be at least as beneficial as distributional similarities for two tasks that require semantic inference. To compute these denotational similarities, we construct a , i.e. a subsumption hierarchy over constituents and their denotations, based on a large corpus of 30K images and 150K descriptive captions.</description><subject>Computational linguistics</subject><subject>Descriptions</subject><subject>Event semantics</subject><subject>Inference</subject><subject>Meaning</subject><subject>Semantics</subject><subject>Similarity</subject><issn>2307-387X</issn><issn>2307-387X</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2014</creationdate><recordtype>article</recordtype><sourceid>7T9</sourceid><sourceid>ALSLI</sourceid><sourceid>CPGLG</sourceid><sourceid>PIMPY</sourceid><sourceid>DOA</sourceid><recordid>eNp1kU1LxDAQhosoKOrNHxDw4sHVfDVNBA8ifoHoRcFbSNOJZGmbNcmu6K83uiIr6GnCyzPPTJiq2iP4iBBBj7OxvTYaYyLEWrVFGW4mTDZP6yvvzWo3pSkujCQSC7pV5csYBuQH8wyog2Sjn2UfxoRyQAuf5qYv8Riy-UpP0B28ouQH35vo8xsaIEdvE3IhogSDGbO3yI8OIowWUFhARLCAMf-S71QbzvQJdr_rdvV4efFwfj25vb-6OT-7nVgmajHpJG8dZS2VhFvgtlEKqKXQdTURsuG0hVZwpbillmBjWNfQWjErDAiAtmbb1c3S2wUz1bNYvhnfdDBefwUhPmsTy8Y9aFYTK6TCvJWKy86pDjvsoFVcMKcaW1z7S9cshpc5pKynYR7Hsr6mUjHFaiVUoQ6XlI0hpQjuZyrB-vNMevVMBT9Y4oNf8f2Dnv6BfiILqhlmdaM0xZSUVo2Vfvez3_0fJ6ipzA</recordid><startdate>201412</startdate><enddate>201412</enddate><creator>Young, Peter</creator><creator>Lai, Alice</creator><creator>Hodosh, Micah</creator><creator>Hockenmaier, Julia</creator><general>MIT Press</general><general>MIT Press Journals, The</general><general>The MIT Press</general><scope>AAYXX</scope><scope>CITATION</scope><scope>7T9</scope><scope>8FE</scope><scope>8FG</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>ALSLI</scope><scope>ARAPS</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>CPGLG</scope><scope>CRLPW</scope><scope>DWQXO</scope><scope>GNUQQ</scope><scope>HCIFZ</scope><scope>JQ2</scope><scope>K7-</scope><scope>P5Z</scope><scope>P62</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>DOA</scope></search><sort><creationdate>201412</creationdate><title>From image descriptions to visual denotations: New similarity metrics for semantic inference over event descriptions</title><author>Young, Peter ; Lai, Alice ; Hodosh, Micah ; Hockenmaier, Julia</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c3656-d84bf23b2814ce4c799e2c2edd5168742beb64994c2c10aa3d72593c6ae6eeb53</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2014</creationdate><topic>Computational linguistics</topic><topic>Descriptions</topic><topic>Event semantics</topic><topic>Inference</topic><topic>Meaning</topic><topic>Semantics</topic><topic>Similarity</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Young, Peter</creatorcontrib><creatorcontrib>Lai, Alice</creatorcontrib><creatorcontrib>Hodosh, Micah</creatorcontrib><creatorcontrib>Hockenmaier, Julia</creatorcontrib><collection>CrossRef</collection><collection>Linguistics and Language Behavior Abstracts (LLBA)</collection><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>Social Science Premium Collection</collection><collection>Advanced Technologies &amp; Aerospace Collection</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>Linguistics Collection</collection><collection>Linguistics Database</collection><collection>ProQuest Central Korea</collection><collection>ProQuest Central Student</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Computer Science Collection</collection><collection>Computer Science Database</collection><collection>Advanced Technologies &amp; Aerospace Database</collection><collection>ProQuest Advanced Technologies &amp; Aerospace Collection</collection><collection>Access via ProQuest (Open Access)</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>DOAJ Directory of Open Access Journals</collection><jtitle>Transactions of the Association for Computational Linguistics</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Young, Peter</au><au>Lai, Alice</au><au>Hodosh, Micah</au><au>Hockenmaier, Julia</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>From image descriptions to visual denotations: New similarity metrics for semantic inference over event descriptions</atitle><jtitle>Transactions of the Association for Computational Linguistics</jtitle><date>2014-12</date><risdate>2014</risdate><volume>2</volume><spage>67</spage><epage>78</epage><pages>67-78</pages><issn>2307-387X</issn><eissn>2307-387X</eissn><abstract>We propose to use the of linguistic expressions (i.e. the set of images they describe) to define novel , which we show to be at least as beneficial as distributional similarities for two tasks that require semantic inference. To compute these denotational similarities, we construct a , i.e. a subsumption hierarchy over constituents and their denotations, based on a large corpus of 30K images and 150K descriptive captions.</abstract><cop>One Rogers Street, Cambridge, MA 02142-1209, USA</cop><pub>MIT Press</pub><doi>10.1162/tacl_a_00166</doi><tpages>12</tpages><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 2307-387X
ispartof Transactions of the Association for Computational Linguistics, 2014-12, Vol.2, p.67-78
issn 2307-387X
2307-387X
language eng
recordid cdi_mit_journals_10_1162_tacl_a_00166
source Access via ProQuest (Open Access); Social Science Premium Collection; Linguistics Collection; Linguistics and Language Behavior Abstracts (LLBA)
subjects Computational linguistics
Descriptions
Event semantics
Inference
Meaning
Semantics
Similarity
title From image descriptions to visual denotations: New similarity metrics for semantic inference over event descriptions
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-25T01%3A07%3A07IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_mit_j&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=From%20image%20descriptions%20to%20visual%20denotations:%20New%20similarity%20metrics%20for%20semantic%20inference%20over%20event%20descriptions&rft.jtitle=Transactions%20of%20the%20Association%20for%20Computational%20Linguistics&rft.au=Young,%20Peter&rft.date=2014-12&rft.volume=2&rft.spage=67&rft.epage=78&rft.pages=67-78&rft.issn=2307-387X&rft.eissn=2307-387X&rft_id=info:doi/10.1162/tacl_a_00166&rft_dat=%3Cproquest_mit_j%3E2893935969%3C/proquest_mit_j%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c3656-d84bf23b2814ce4c799e2c2edd5168742beb64994c2c10aa3d72593c6ae6eeb53%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=2893935969&rft_id=info:pmid/&rfr_iscdi=true