Tools related to the following tags: On bs4, Static scraper. Page 1
A collection of useful tools I've ever created. They were linked and grouped under the following tags: On bs4, Static scraper. Page 1
In english/
Tools/
Page 1, Static scraper, On bs4,
This is a simple parser of both static and dynamic pages from sites. For example, I decided to parse images, because they are the object of optimization for statically created sites. Uses decorators.
This tool works in command line mode. Its essence is that it can check proxies by various URLs, and assign them a certain weight. The weight depends on how often it was possible to contact the target site through the proxy. It is implemented in multithreaded mode in python.
This parser, using the site's API, finds all pagination pages with cards of government members. After which, it collects the necessary information about each of its members.
Feedback form
Email subscription
...
