Web Crawler

Instructions

Step 1: Input the URL link with protocol "http", the number of the page limit, the minimum support and confidence on the text field. The support number is an integer ranging from 0 to 100 (e.g.20) and the confidence is a decimal number (e.g. 0.20). Since web-pages contain various keywords and thus the variability is large. Therefore, in order to get reasonable number of association rules, the recommended support number is less than 40 and the recommended confidence is less than 0.40.

Step 2: Click the "Start" button to start loading the pages reachable from the current URL. You might want to click the "Stop" button, whenever you want to stop searching.

Step 3: The left column of the big text area displays all the links reachable of current URL while the right column of the big text area displays all the association rules from the web-pages of the left column.