WISE: A Visual Tool for Automatic Extraction of Objects from World Wide Web

• Main Authors: Jan, Yi-Wei, Tsay, Jyh-Jong, Wu, Bo-Liang
• Format: Conference Proceeding
• Language: English
• Subjects: Applied computing > Document management and text processing; Classification tree analysis; Computer science; Crawlers; Data mining; Education; HTML; Human-centered computing > Human computer interaction (HCI) > Interaction paradigms > Graphical user interfaces; Information systems > Information retrieval; Information systems > Information storage systems; Information systems > Information systems applications > Data mining; Search engines; Web pages; Web sites
• DOI: 10.1109/WI.2005.167

Automatic identification and extraction of interesting objects instead of just related Web pages is useful to users of the World Wide Web. For example, an instructor teaching a Data Mining course may be interested in finding all text books, lecture notes, slides, homeworks and term projects from Web pages of all Data Mining and their related courses. In this paper, we present a tool WISE for extraction of objects from web pages, which are of interest. In WISE, objects in HTML pages are defined as nodes in an extension of DOM trees. Extraction of objects is then formulated as the problem of classification of tree nodes. We develop a mechanism for object specifications, and a specific-to-general (bottom-up) search algorithm for learning object specifications. Experiment shows that WISE works well for extracting objects such as, for example, extracting items in paper lists, and extracting lists of lecture notes in Algorithms courses.