Scrapy Python 爬虫库

Scrapy - An open source and collaborative framework for extracting the data you need from websites.In a fast, simple, yet extensible way.

https://scrapy.org/