Reverse engineering for Web data: from visual to semantic structures

Despite the advancement of XML, the majority of documents on the Web is still marked up with HTML for visual rendering purposes only, thus building a huge amount of legacy data. In order to facilitate querying Web based data in a way more efficient and effective than just keyword based retrieval, en...

Full description

Saved in:
Bibliographic Details
Main Authors: Chung, C.Y., Gertz, M., Sundaresan, N.
Format: Conference Proceeding
Language:English
Subjects:
Applied sciences
Computer science
Computer science
control theory
systems
Crawlers
Database languages
Exact sciences and technology
HTML
Information retrieval
Information systems. Data bases
Memory organisation. Data processing
Query processing
Reverse engineering
Semantic Web
Software
Telecommunications
Telecommunications and information theory
Teleprocessing networks. Isdn
Writing
XML
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Despite the advancement of XML, the majority of documents on the Web is still marked up with HTML for visual rendering purposes only, thus building a huge amount of legacy data. In order to facilitate querying Web based data in a way more efficient and effective than just keyword based retrieval, enriching such Web documents with both structure and semantics is necessary. We describe a novel approach to the integration of topic specific HTML documents into a repository of XML documents. In particular, we describe how topic specific HTML documents are transformed into XML documents. The proposed document transformation and semantic element tagging process utilizes document restructuring rules and minimum information about the topic in the form of concepts. For the resulting XML documents, a majority schema is derived that describes common structures among the documents in the form of a DTD. We explore and discuss different techniques, and rules for document conversion and majority schema discovery. We finally demonstrate the feasibility and effectiveness of our approach by applying it to a set of resume HTML documents gathered by a Web crawler.
ISSN:1063-6382
2375-026X
DOI:10.1109/ICDE.2002.994697