Item Pipeline
它负责将抓取到的数据可进行校验准确性、检测重复数据、持久化数据到数据库中。
源码解析
scrapy/core/engine.py#ExecutionEngine open_spider(self, spider: Spider, start_requests: Iterable = (), close_if_idle: bool = True)
scrapy/core/scraper.py#Scraper open_spider(self, spider: Spider)
scrapy/pipelines/init.py#ItemPipelineManager(MiddlewareManager)