SearchResultParser navigation and introduction
16.07.2024
15.04.2025
2 minutes
195
0
0
0
0
Introduction
This is an introductory article and a navigator article for the SearchResultParser project/web tool. This series of articles will cover the step-by-step creation of this tool.
The main idea of the SearchResultParser project is to parse data from search results (not just Google). In general, this tool will support the following search engines and machines (not all at start, but nevertheless):
- Yahoo
- Bing
- DuckDuckGo
- Baidu
- Yandex
- Aol
- StackOverflow
- GitHub
- Ask
- YouTube
- MyAnimeList
- GoogleScholar
- GoogleNews
- Coursera
I will delegate the main parsing work to this python library - search-engine-parser. The main one, but not all. I will write the Google parser and everything that won't work via search-engine-parser by myself. All data and source code will be available on GitHub.
Projects tech stack
As a frontend, I chose ReactJS + MaterialUI library. Why them? Why not. React is considered the most popular JS framework and it would be a sin on my part not to touch it. Also, as an additional flexibility in styling and tuning the site's design, I will use TailwindCSS.
For the backend, I always have one answer - Django. I like this framework, I like its ideology and logic. Plus, it's the only one I know (^///^)
As a hosting provider, reg.ru will act as my hosting provider. I would like to study other hosting providers, except for beget.
The monetization model of the site will be based on the so-called freemium + advertising networks. I am going to make all payments through Robokassa. And the advertising network will be from Yandex, Direct.
What you can learn from it
This series of articles implies that I will write this site from scratch to the end and describe the entire process in detail. And to be more precise, in this series you will be able to learn such things as:
- How to use Django and React together
- How to combine TailwindCSS together with React
- How to publish a website on Reg.ru host provider
- How to sync changes made on the developer website to already published
- How to use proxy with parsers
- How to make user-agent swapping possible
- How to make your python scrapper in parallel manner
Navigation
- News about a new project
- Integration a React app into Django project
- Developing base websites user interface(frontend)
- Implementing interactive tutorial for the website
- Adding a user authentication on the website
- Adding support for several languages
- How to use and setup REST framework with Django
- How to publish a website on a Reg.ru host provider
Conclusions
I will write the conclusion when I finish the project. (∪.∪ )...zzz
Feedback form
Email subscription
Comments
(0)
Send
Response for
>
It's empty now. Be the first (oﾟvﾟ)ノ
Other
Similar articles
Interactive web development tutorial on website | Series SearchResultParser p. 3
29.08.2024
159
0
0
0
0
In this article you will understand how to add a web tutorial on a website for guests using React components. With the ability to define to which elements hints will …
Django + allauth on ReactJS. Authentication system p. 4
31.01.2025
175
0
0
0
1
In this article I will describe the process of connecting and configuring the allauth application to a django project, where the frontend is handled by react. This is a basic …
How to deploy a Django project on Reg.ru. Full instruction.
16.03.2025
172
0
0
0
0
In this article, I will tell and show how you can deploy a site written in Django on servers from the hosting provider Reg.ru. Also from this article, you will …
Used termins
- VPS (Virtual private server) ⟶ This is a service whose essence is that access to a dedicated server on a specific machine is provided. There can be thousands of such dedicated servers on one machine. Typically, managing such a server is no different from managing a regular, physical one.
- Django template ⟶ This is a text document marked up with a special syntax for inserting new code.
- TailwindCSS framework ⟶ It is a utility-first CSS framework that streamlines web development by providing a set of pre-designed utility classes. These classes enable rapid styling without writing custom CSS, promoting consistency and scalability. Tailwind’s approach shifts focus from traditional CSS components to functional classes, empowering developers.
- Django framework ⟶ Is a high-level, open-source web framework for building web applications using the Python programming language. It follows the model-view-template (MVT) architectural pattern and is designed to facilitate rapid development while promoting clean, pragmatic design.
- Framework ⟶ Is a predefined set of tools, libraries, and best practices that provides a structured way to build and develop applications. Frameworks aim to streamline the development process by offering a foundation upon which developers can build their software, addressing common tasks, reducing code redundancy, and promoting best practices.
Related questions
- When should I use inline-style vs. CSS? Use inline-styles for dynamic style properties. The CSS alternative provides more advantages, such as auto-prefixing, better debugging, media queries, keyframes.
- My App doesn't render correctly on the server? If it doesn't work, in 99% of cases it's a configuration issue. A missing property, a wrong call order, or a missing component – server-side rendering is strict about configuration. The best way to find out what's wrong is to compare your project to an already working setup. Check out the reference implementations, bit by bit.
- I can’t stand Django template language. Do I have to use it? I think this template engine is the best thing ever, but I know that choosing a template language runs close to religion. There’s nothing about Django that requires using the template language, so if you’re attached to Jinja2, Mako, or whatever it's ok.