Platform for General-Purpose Distributed Data-Mining on Large Dynamic Graphs

We present an approach to data mining on arbitrary graph data that uses a cloud-based distributed computing model for dynamic provisioning of computing resources as the graph model grows or shrinks. Further, we introduce the concept of logging graph changes as a basis for calculating properties of d...

Full description

Saved in:
Bibliographic Details
Main Authors: Steinbauer, Matthias, Kotsis, Gabriele
Format: Conference Proceeding
Language:English
Subjects:
Computational modeling
data mining
distributed processing
dynamic graph
Electronic mail
Fasteners
Heuristic algorithms
Load modeling
Storms
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:We present an approach to data mining on arbitrary graph data that uses a cloud-based distributed computing model for dynamic provisioning of computing resources as the graph model grows or shrinks. Further, we introduce the concept of logging graph changes as a basis for calculating properties of dynamic graphs. We briefly describe queries that leverage the dynamic graph model, for instance, by using a snapshot of the original graph while an algorithm executes or adapting query results as the graph changes. To demonstrate the feasibility of our approach, we conducted an initial evaluation, which shows that our parallel computing model can dramatically improve load times. Raw data imported into our system is processed faster on larger compute clusters.
ISSN:1524-4547
2641-8169
DOI:10.1109/WETICE.2013.54