Lexical Semantic based Bayesian Model for Adaptive Wrapper Generation

This paper focuses on an unsupervised information extraction system. Two kinds of features related to the text fragments from the Web documents are investigated. The first type of feature is called, a site-invariant feature. The second type of feature is called a site-dependent feature. Feature sele...

Full description

Saved in:
Bibliographic Details
Published in:Procedia engineering 2012, Vol.38, p.3343-3350
Main Authors: kesavan, R. Nandhi, Latha, K.
Format: Article
Language:English
Subjects:
Bayesian learning
E-M algorithm
lexical semantics
Unsupervised information extraction
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:This paper focuses on an unsupervised information extraction system. Two kinds of features related to the text fragments from the Web documents are investigated. The first type of feature is called, a site-invariant feature. The second type of feature is called a site-dependent feature. Feature selection algorithm is used for wrapper generation from the site invariant and site-dependent information. The wrapper is generated and the new attribute is also discovered and adapted with wrapper by using the Bayesian learning method and E-M algorithm along with the lexical semantics search method. Our wrapper can be able to adapt with the new unseen sites. Our system efficiency is evaluated based on some performance measures and the effectiveness of the system is evaluated by using the performance metrics, precision, recall, f-measure, true positive and false positive in the real time web sites.
ISSN:1877-7058
1877-7058
DOI:10.1016/j.proeng.2012.06.387