Handling distributed XML queries over large XML data based on MapReduce framework

With the increase in available extensible markup language (XML) documents, numerous approaches to querying have been proposed in the literature. XPath queries and Twig pattern queries are the two basic approaches, directly affecting the efficiency of XML operations. Distributive manipulation of mass...

Full description

Saved in:
Bibliographic Details
Published in:Information sciences 2018-07, Vol.453, p.1-20
Main Authors: Fan, Hongjie, Ma, Zhiyi, Wang, Dianhui, Liu, Junfei
Format: Article
Language:English
Subjects:
Hadoop
MapReduce
Twig query
XML
XPath query
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:With the increase in available extensible markup language (XML) documents, numerous approaches to querying have been proposed in the literature. XPath queries and Twig pattern queries are the two basic approaches, directly affecting the efficiency of XML operations. Distributive manipulation of massive XML data is challenging. This paper aims to develop an efficient distributed XML query processing method using MapReduce, which simultaneously processes several queries on large volumes of XML data. First, we split up a large-scale XML data file into file-splits and put them in a distributed storage system. Then, we present an efficient algorithm to compute different fragments of the document tree using the MapReduce framework in parallel. In order to efficiently handle a large amount of XML data, we built a partition index and used a random access mechanism for specific queries. The experiment results show that our proposed approach is efficient with good scalability.
ISSN:0020-0255
1872-6291
DOI:10.1016/j.ins.2018.04.028