User:Caznew277/Books/WebCrawlingProject

Web Crawling Project

 * Crawling
 * Web crawler
 * Apache Kafka
 * Robots exclusion standard
 * Sitemaps


 * Scraping
 * Web scraping


 * General Terms
 * Abstraction
 * Anonymous function
 * Data extraction
 * Delta encoding
 * Internet bot
 * Lambda architecture
 * Lambda calculus
 * Latency (engineering)
 * Serialization
 * Software agent
 * Tuple
 * User agent