CS 345 section 001 (assignments, notes, exams, paper links): Fall 2013
The copyrighted material downloadable from this page is to be
used only by the students enrolled in CS 345 under Prof. Gerbessiotis.
Distribution of this material outside this group is
NOT allowed for any reason.
C1. Midterm Performance
- How am i doing in class?
Midterm class performance.
Edited on 10/25/2013 . √
Note that Exam Statistics are available in section C4.
C2. Solutions to assignments and exams
Homeworks are posted in the handouts section that is section B. Only sample solutions might be
posted in this area.
C3. Statistics.
Statistics for the class exam will be become available through
the exam
statistics link.
Edited on Oct 25, 2013 . √
C4. Exams, Statistics, and solutions to selected exams
C5. Previous Exams
Fall 2010
C6. Lecture Summaries aka Supplementary Notes and Paper links
DISCLAIMER:
The included material DOES NOT substitute the textbook
for this class. It should be used in conjunction with the textbook and the
material presented in class. If a statement in these "notes" seems to be
incorrect, report it to the instructor so that it be fixed immediately.
These "notes" are distributed to the students of CS485
offered by Dr. Gerbessiotis at the New Jersey Institute of Technology;
distribution outside this group of students is prohibited.
The material below will be uploaded in due time; an upload message will
appear as soon as the corresponding document is uploaded.
SUBJECTS
- Subject 1 (Web Search : Introduction) in
Adobe Acrobat PDF
(Based on material from Chapter 1 of the textbook plus some more)
Uploaded on 09/09 √
- Subject 2 (Web Search Engine Architecture) in
Adobe Acrobat PDF
(Based on material from Chapter 1,2, and Chapter 3 sections 3.1-3.4 of the textbook
plus some more on Google)
Uploaded on 9/20 √
- Subject 3 (Google Search Engine Architecture) in
Oct 6 version of sub3.pdf
Prior version of sub3.pdf
(Based on paper link L1 pdf and html version; typos
corrected on Oct 6)
Uploaded on 09/20 √
- Subject 4 (Hashing,DataCompression and Coding) in
Adobe Acrobat PDF
(Based on material from Chapter 3 (section 3.5,3.6, and 3.7) and Chapter 5
(5.4)). It also includes primarily CS 114 or CS 435 material which will be used as background for
Web search-related data structure description
Uploaded on 10/04 √
- Subject 5 (Google Cluster Architecture) in
Adobe Acrobat PDF
(Based on paper Link L2 below)
Uploaded on 10/17 √
- Subject 6 (Document Analysis) in
Adobe Acrobat PDF
(Based on Chapters 4 and 6 of the textbook)
Uploaded on 11/01 √
- Subject 7 (The index and the indexing process) in
Adobe Acrobat PDF
(Based on Chapter 5 of the textbook)
Uploaded on 11/11 √
- Subject 8 (Retrieval modeling and Retrieval evaluation) in
Adobe Acrobat PDF
(Chapters 1 and 8 (precision and recall),Chapter 4 (4.5), Chapter 7 (7.1,7.5) and
Chapter 8)
Uploaded on 11/11 √
- Subject 9 (Ranking: HITS and PageRank) in
Adobe Acrobat PDF
Chapter 4 (4.5)
Uploaded on 11/22 √
- Subject 10 (Google File System and BigTable) in
Adobe Acrobat PDF
Uploaded on 11/29 √
- Subject 11 (Miscellanea: material taught on last day of classes not in the exam) in
Adobe Acrobat PDF
Uploaded on 11/29 √
Paper and Code Links
- L0
- Presentation Schedule in
schedule.txt
Arthur Maciejewicz MAPREDUCE presentation's summary
Arthur Maciejewicz MAPREDUCE presentation
Last Updated on 12/06/2013 . √
- L1
- Google paper (Brin and Page) in
http://www-db.stanford.edu/~backrub/google.html
The pdf version of this paper that might included additional material is mirrored locally
in Google (Brin and Page).
- L2
- Google Cluster Architecture (Barroso et al) in
http://research.google.com/archive/googlecluster-ieee.pdf
Also mirrored locally in pdf in
Google Cluster Architecture (Barroso et al).
- L3
- Who Links to Whom (Bharat et al) in
http://theory.lcs.mit.edu/~ruhl/papers/2001-icdm.pdf
Also mirrored locally in pdf in
Who link to Whom (Bharat et al).
- L4
- WebCrawlers
- WebSphinx (CMU,USA)
CMU's WebSPHINX. A local copy is available at
this link.
- UbiCrawler (Italy)
http://ubi.imc.pi.cnr.it/projects/ubicrawler/.
- WIRE (Chile)
http://www.cwr.cl/projects/WIRE/.
- Paper: Parallel Web Crawlers
Cho and Garcia-Molina (Stanford).
- L5
- Code Links
- Recursive directory descent
recdir.c.
- L6
- Google Architecture Review (2009) in
http://research.google.com/people/jeff/WSDM09-keynote.pdf
Also mirrored locally in pdf in Google Architecture Review(Jeff Dean)).
- L7
- HW 8 papers (selection)
- Google Crawler for Deep Web
PDF.
- PageRank related paper
PDF.
- Aardvark Social Network search
PDF.
- L3 paper
PDF.
- L6 paper
PDF.
- Google File System
PDF.
- BigTable
PDF.
- Kleinberg's HITS algorithm
PDF.
- Google's MAPREDUCE
PDF.
- Web as a Graph
PDF.
- Twitter
PDF.
- Semantic Web
MS Word.
PDF.
- The Datacenter as a computer by Barroso and Holzle
PDF.
- PEW Center Survey
http://www.pewinternet.org/pdfs/PIP_Internet_and_Daily_Life.pdf (this link might not be active any more).
- Host Survey
http://news.netcraft.com/archives/web_server_survey.html.
- Web size
http://www.vldb.org/conf/2001/P069.pdf.
- Search Engines (query statistics)
http://www.webology.org/2004/v1n2/a4.html.
- Zmap
Zmap PDF.
- Internet Census 2012
Internet Census 2012.
- Designs, Lessons and Advice from Building Large
Distributed Systems
Jeff Dean 2009 LADIS (Large Scale Distributed Systems and Middleware) Keynote talk .
- L8
- Paper presentation (Dec 09, 2013) Schedule available through link L0 above.
- L9
- NSA Data Center in
Wired article on NSA's Utah Data Center (by James Bamford, 2012)
Wired article on NSA's Utah Data Center (by Klint Finley, Oct 2013)
- L10
- Some notes of the instructors in
Notes on parallel and multithreaded computing(dec 2009 print)
A more recent compilation (using a more recent version of LaTeX and pdfLaTeX) is this
one:
Notes on parallel and multithreaded computing (nov 4, 2013 print)
There should be no or minimal differences between the two versions; two different versions
of LaTeX and PdfLaTeX were used; the more recent version available for the more recent print of
the notes.
(Note the chapters on web-searching there are from 2008/2009 and obsolete; they have
been superseded by newer material including the notes of this CS345 course.)
Last modified Dec 09, 2013, 08:45