This is a basic example of a parser for such an online store wildberries. Which avoids detection and blocking using proxy rotation and dynamically collecting data using Selenium.
This tool works in CLI mode, made in python. It can check proxies by various URLs, and assign them a certain weight. The weight depends on how often it was possible to contact the target site through the proxy.
This is a single-threaded parser of any filtering and pagination pages of Kinopoisk. That is, those pages in the address of which there is a list slug. Parses data through a proxy, perhaps suitable for moviegoers.
This is a simple parser of both static and dynamic pages from sites. For example, I decided to parse images, because they are the object of optimization for statically created sites. Uses decorators.
Do not forget to share, like and leave a comment :)
Reviews
(0)