Cited 1 time in webofscience Cited 2 time in scopus

Leveraging spatial join for robust tuple extraction from web pages

Title
Leveraging spatial join for robust tuple extraction from web pages
Authors
Han, WS[Han, Wook-Shin]Kwak, W[Kwak, Wooseong]Yu, H[Yu, Hwanjo]Lee, JH[Lee, Jeong-Hoon]Kim, MS[Kim, Min-Soo]
DGIST Authors
Kim, MS[Kim, Min-Soo]
Issue Date
2014-03-10
Citation
Information Sciences, 261, 132-148
Type
Article
Article Type
Article
Keywords
Construction AlgorithmsExtractionExtraction SystemsHTMLQuery LanguagesSpatial InformationsSpatial JoinSpatial LocationSpatial RelationshipsTopological RelationshipsTrees (Mathematics)Tuple ExtractionWebsitesWrapper
ISSN
0020-0255
Abstract
Extracting tuples from HTML pages has been an important issue in various web applications. Commercial tuple extraction systems have enjoyed some success to extract tuples by regarding HTML pages as tree structures and exploiting XPath queries to find attributes of tuples in the HTML pages. However, such systems would be vulnerable to small changes on the web pages. In this paper, we propose a robust tuple extraction system which utilizes spatial relationships among elements rather than the XPath queries. Spatial information (e.g., 2-D coordinates) of elements are maintained in the DOM tree when a web page is rendered in a browser. Our system regards elements in the rendered page as spatial objects in the 2-D space and executes spatial joins to extract target elements. Since humans also identify an element in a web page by its relative spatial location, our system extracting elements by their spatial relationships could possibly be as robust as manual extraction. To specify and execute spatial joins, we propose a new query language, RAQuery, based on topological relationships between any spatial objects in the 2-D space. We then propose spatial join algorithms that efficiently process the RAQuery using novel notions of group match and prunable relation group. We next propose a tuple construction algorithm to build tuples from the extracted elements obtained by the spatial joins, which can construct tuples even when there are no boundary HTML elements specified for the tuples in the web page. Extensive experimental results using real HTML pages confirm that our solutions are far more robust than existing tuple extraction systems without sacrificing performance. © 2013 Elsevier Inc. All rights reserved.
URI
http://hdl.handle.net/20.500.11750/3109
DOI
10.1016/j.ins.2013.09.027
Publisher
Elsevier
Related Researcher
Files:
There are no files associated with this item.
Collection:
Information and Communication EngineeringETC1. Journal Articles


qrcode mendeley

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.

BROWSE