Proximity Estimation and Hardness of Short-Text Corpora

In this work, we investigate the relative hardness of short-text corpora in clustering problems and how this hardness relates to traditional similarity measures. Our approach basically attempts to establish a connection between the hardness of a corpus and the precision level exhibited by similarity...

Full description

Saved in:
Bibliographic Details
Main Authors: Errecalde, M.L., Ingaramo, D., Rosso, P.
Format: Conference Proceeding
Language:English
Subjects:
Abstracts
cluster validity measures
clustering
Clustering algorithms
Complexity theory
Indexes
Measurement uncertainty
Noise measurement
proximity estimation
short-text corpora
Vocabulary
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In this work, we investigate the relative hardness of short-text corpora in clustering problems and how this hardness relates to traditional similarity measures. Our approach basically attempts to establish a connection between the hardness of a corpus and the precision level exhibited by similarity measures, according to the results obtained with different cluster validity measures on the "ideal" clustering of each corpus. Moreover, we also propose a new validity measure, named contiguity error that allowed us to observe this connection in a consistent way in all the collections considered.
ISSN:1529-4188
2378-3915
DOI:10.1109/DEXA.2008.87