Check out https://github.com/clemfromspace/scrapy-cloudflare-middleware. I've be... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		gg_no_re on Feb 10, 2021 \| parent \| context \| favorite \| on: Web Scraping 101 with Python Check out https://github.com/clemfromspace/scrapy-cloudflare-middlewar.... I've been running it in production for over a year without any hiccups.

FL33TW00D on Feb 11, 2021 [–]

Is this still working for you? cfscrape that it’s based off looks to be failing due to cloudflare updates

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact