An Extension of the VSM Documents Representation

In this paper we will present a new approach regarding the documents representation in order to be used in classification and/or clustering algorithms. In our new representation we will start from the classical "bag-of-words" representation but we will augment each word with its correspond...

Full description

Saved in:
Bibliographic Details
Published in:International journal of computers, communications & control communications & control, 2017-06, Vol.12 (3)
Main Authors: Lucian Nicolae Vintan, Daniel Ionel Morariu, Radu George Cretulescu, Vintan, Maria
Format: Article
Language:English
Subjects:
Algorithms
Classification
Clustering
Representations
Speech
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In this paper we will present a new approach regarding the documents representation in order to be used in classification and/or clustering algorithms. In our new representation we will start from the classical "bag-of-words" representation but we will augment each word with its correspondent part-of-speech. Thus we will introduce a new concept called hyper-vectors where each document is represented in a hyper-space where each dimension is a different part-of-speech component. For each dimension the document is represented using the Vector Space Model (VSM). In this work we will use only five different parts of speech: noun, verb, adverb, adjective and others. In the hyper-space each dimension has a different weight. To compute the similarity between two documents we have developed a new hyper-cosine formula. Some interesting classification experiments are presented as validation cases.
ISSN:1841-9836
1841-9844
DOI:10.15837/ijccc.2017.3.2889