Tools related to the following tags: Static scraper. Page 1
A collection of useful tools I've ever created. They were linked and grouped under the following tags: Static scraper. Page 1
In english/
Tools/
Page 1, Static scraper,
This is a simple parser of both static and dynamic pages from sites. For example, I decided to parse images, because they are the object of optimization for statically created sites. Uses decorators.
This tool works in command line mode. Its essence is that it can check proxies by various URLs, and assign them a certain weight. The weight depends on how often it was possible to contact the target site through the proxy. It is implemented in multithreaded mode in python.
This parser parses available content on the site in multi-threaded mode with user agent rotation. Simple example.
This parser parses all questions in the forum in multithreaded mode. Nothing special, just an example.
Feedback form
Email subscription
...
