About the links scraper
An online tool for parsing all URLs from a website. It supports parsing URLs from either a single page or a list of pages. Available as a Telegram bot, a CLI tool, and a standalone Python library on PyPI.
This tool works in 3 modes. In parsing mode from one page, from a list of pages and from the whole site. Although I can't guarantee that I will find all the links on the site, or will be able to find all the pages during crawling. Because there are many methods of hiding pages from the crawler.
This web page link parser is also a webimplementation of the link-thief python library. Which provides general functionality for working with links and extracting them from sites. There is also an implementation in the form of a command line tool, which is much easier to understand and study. Plus the @LinkThief_bot telegram bot. This library is available for installation via PiPI, or via my site.
Reviews
(0)