Post Scraping no longer possible due to CloudFlare

[xinoehp512 he/him]

Prior to the update, I would scrape post data automatically using Python, for easier searching and organization. Because of Cloudflare, this is no longer possible. Does anybody know a workaround- some way to collect post data without having to manually copy-paste the source code for every single page in a topic?

[Chaos he/him]

Unfortunately, we do not permit this sort of scraping any longer. We changed settings to prevent the many, many AI models from scraping 17S, the Coppermind, and Arcanum, which was causing performance issues (and they certainly didn't ask for our permission). So you will not be able to do this any longer.

[xinoehp512 he/him]

Well, that's unfortunate. Thanks for letting me know.