- Web Crawler (Depth map)
- Indexer
- InvertedFile
- Query Processor
- Phrase Searching
- Ranker
- Web Interface
- Bonus
- PDF file containing algorithms
- Stem the whole document or just the search query?
- When do i crawl?
- how can the crawler be interrupted
- What do you mean by the order of page visits?
- Crawler state maintenance and interruption
- Robots.txt??
- which User-agents should be considered
- How do I update the indexer?
- How do I match "travel" and "traveler"?
- TF-IDF
- tags priority in indexer
- Save CrawledNum
- Copy the contents before saving
- Remove inLinks
- include phrase searching & fix robots
- phrase searching ranking