scrapy 解决302重定向问题

Posted 2021-01-13 fh-fendou

def start_requests(self):
        for i in self.start_urls:
            yield Request(i, meta={
                ‘dont_redirect‘: True,
                ‘handle_httpstatus_list‘: [302]
            }, callback=self.parse)