Search in sources :

Example 1 with PriorityScheduler

use of us.codecraft.webmagic.scheduler.PriorityScheduler in project webmagic by code4craft.

the class ZipCodePageProcessor method main.

public static void main(String[] args) {
    Spider spider = Spider.create(new ZipCodePageProcessor()).scheduler(new PriorityScheduler()).addUrl("http://www.ip138.com/post/");
    spider.run();
}
Also used : Spider(us.codecraft.webmagic.Spider) PriorityScheduler(us.codecraft.webmagic.scheduler.PriorityScheduler)

Aggregations

Spider (us.codecraft.webmagic.Spider)1 PriorityScheduler (us.codecraft.webmagic.scheduler.PriorityScheduler)1