Requirements of Web Crawler
Understand the requirements to design a web crawler.
Requirements
Let’s highlight the functional and non-functional requirements for a web crawler.
Functional
Below are the functionalities a user might be able to perform:
- Crawling: The system should scour the World Wide Web, spanning from a queue of seed URLs provided initially by the system administrator.
Create a free account to access the full course.
By signing up, you agree to Educative's Terms of Service and Privacy Policy