Cited time in webofscience Cited time in scopus

Leveraging spatial join for robust tuple extraction from web pages

Leveraging spatial join for robust tuple extraction from web pages
Han, WS[Han, Wook-Shin]Kwak, W[Kwak, Wooseong]Yu, H[Yu, Hwanjo]Lee, JH[Lee, Jeong-Hoon]Kim, MS[Kim, Min-Soo]
DGIST Authors
Kim, MS[Kim, Min-Soo]
Issued Date
Article Type
Construction AlgorithmsExtractionExtraction SystemsHTMLQuery LanguagesSpatial InformationsSpatial JoinSpatial LocationSpatial RelationshipsTopological RelationshipsTrees (Mathematics)Tuple ExtractionWebsitesWrapper
Extracting tuples from HTML pages has been an important issue in various web applications. Commercial tuple extraction systems have enjoyed some success to extract tuples by regarding HTML pages as tree structures and exploiting XPath queries to find attributes of tuples in the HTML pages. However, such systems would be vulnerable to small changes on the web pages. In this paper, we propose a robust tuple extraction system which utilizes spatial relationships among elements rather than the XPath queries. Spatial information (e.g., 2-D coordinates) of elements are maintained in the DOM tree when a web page is rendered in a browser. Our system regards elements in the rendered page as spatial objects in the 2-D space and executes spatial joins to extract target elements. Since humans also identify an element in a web page by its relative spatial location, our system extracting elements by their spatial relationships could possibly be as robust as manual extraction. To specify and execute spatial joins, we propose a new query language, RAQuery, based on topological relationships between any spatial objects in the 2-D space. We then propose spatial join algorithms that efficiently process the RAQuery using novel notions of group match and prunable relation group. We next propose a tuple construction algorithm to build tuples from the extracted elements obtained by the spatial joins, which can construct tuples even when there are no boundary HTML elements specified for the tuples in the web page. Extensive experimental results using real HTML pages confirm that our solutions are far more robust than existing tuple extraction systems without sacrificing performance. © 2013 Elsevier Inc. All rights reserved.
Files in This Item:

There are no files associated with this item.

Appears in Collections:
Department of Electrical Engineering and Computer Science InfoLab 1. Journal Articles


  • twitter
  • facebook
  • mendeley

Items in Repository are protected by copyright, with all rights reserved, unless otherwise indicated.