Wildberries scraper

Clock
16.11.2024
Clock
15.04.2025
An eye
112
Hearts
0
Connected dots
0
Connected dots
0
Connected dots
0
Terminal user interface
Terminal user interface
Scraper
Scraper

Description

This is a basic example of a parser for such an online store wildberries. Which avoids detection and blocking using proxy rotation and dynamically collecting data using Selenium.

Media files


  1. files/XX/WildBerries_-_Copy.zip

Similar tools


CLI proxy checker tool.

Terminal user interface
This tool works in command line mode. Its essence is that it can check proxies by various URLs, and assign them a certain weight. The weight depends on how often it was possible to contact the target site through the proxy. It is implemented in multithreaded mode in python.

Kinopoisk scraper

Terminal user interface
Scraper
This is a single-threaded parser of any filtering and pagination pages of Kinopoisk. That is, those pages in the address of which there is a list slug. Parses data through a proxy, perhaps suitable for moviegoers.

An example of a simple python scraper

Terminal user interface
Scraper
This is a simple parser of both static and dynamic pages from sites. For example, I decided to parse images, because they are the object of optimization for statically created sites. Uses decorators.

heart
cloud
cloud
cloud
message

Reviews

(0)

captcha
Send
It's empty now. Be the first (o゚v゚)ノ