Learn to adapt the web spider application to implement limited parallel execution.
Web spider v4
Now it’s time to adapt our web spider to implement a limited parallel execution flow using the TaskQueue
class we’ve just created.
First, we need to split the spider()
function into two functions, one simply initializing a new TaskQueue
object and another actually executing the spidering task, which ...