Problem 2
**********
Part a.

wget info
**********

*** Log file is Run1.txt is Run1 renamed for Web view

 wget -r -l 0 http://web.njit.edu/~alexg/courses/cs345/index.html >& Run1

    find web.njit.edu/ -name -print | wc
 too many files and also directories

*** Listing in List1.txt

     cat Run1 | egrep OK | wc
     cat Run1 | egrep 404 | wc and divide by 2
     cat Run1 | egrep 401 | wc 

% du -s web.njit.edu/
3759    web.njit.edu/



 Part b.
 *******

 File Run2.txt is Run2 renamed for Web view (see solutions on how to obtain it in webcrawler)
 Run2_sorted.txt is Run2 after sort -u Run2 is applied