使用 Scrapy 解析站点地图
问题描述：
我希望能够使用scrapy 来抓取站点地图上的链接.我对这个应用程序了解不多，所以我会对你可以提供的任何链接/信息/文档感兴趣.
I want to be able to use scrapy to crawl links on a sitemap. I don't know much about this application, so I would be interested in any links/info/documentation you could provide.
谢谢
答
为此目的，Scrapy 主干中刚刚添加了一个新的通用蜘蛛.它将在下一个版本(Scrapy 0.14)中可用
A new generic spider has just been added to Scrapy trunk, for this purpose. It will be available on next release (Scrapy 0.14)