Design and Implementation of Crawler for Discovering Deep-Web Interfaces

Abstract

Abstract

Deep web is growing faster which is generally hidden. The discovery of deep web can provide more information about web applications. Due to the dynamic nature of web applications and large volume of the web resources, it is not easy to locate deep-web interfaces. In this paper we propose a crawler to discover deep web interface. We designed and implemented the crawler using a prototype application in Java platform. The crawler is responsible to obtain details of deep web interfaces. We used the concept of pre and post query forms in order to have accurate classification of forms. We proposed an algorithm to make use of pre and post query forms to discovery deep web interfaces. Our empirical results revealed that the proposed algorithm is useful to discover hidden interfaces from deep web.

Keywords: Crawler, deep-web interfaces, pre-query form, post-query form

Cite this Article

Raju Dara, Saikiran.Design and Implementation of Crawler for Discovering Deep-Web Interfaces. Journal of Web Engineering & Technology. 2016; 3(3): 8–16p.