Tools related to the following tags: Scraper, On bs4. Page 1
A collection of useful tools I've ever created. They were linked and grouped under the following tags: Scraper, On bs4. Page 1
In english/
Tools/
Page 1, Scraper, On bs4,
This is a single-threaded parser of any filtering and pagination pages of Kinopoisk. That is, those pages in the address of which there is a list slug. Parses data through a proxy, perhaps suitable for moviegoers.
This tool works in command line mode. Its essence is that it can check proxies by various URLs, and assign them a certain weight. The weight depends on how often it was possible to contact the target site through the proxy. It is implemented in multithreaded mode in python.
Parser for a site about beer using rendering and the site's API. This parser has been split into two smaller parsers to get the most out of this site.
This parser, using the built-in HTML sitemap, parses all available products and ingredients. Output of the result in CSV and JSON formats.
Feedback form
Email subscription
...
