Coders Packet

Quote website scrapping in Python using Selenium

By Guru prasad

This project focuses on automating browser tasks like extracting content from a website using a special module in Python called Selenium.

Before diving into the topic and looking at what exactly this project is about, we need to look into a few basic concepts which we will be using here.

What is web scraping?

Web scraping is the process of using Python scripts to extract content and data from an internet site. Unlike screen scraping, which only duplicates pixels displayed on the screen, web scraping extracts the fundamental HTML code and with it, the data stored in the database is also scraped.

What is Selenium?
Selenium is the most widely used free software and open source automation tool. The advantages of Selenium for Test Automation are very vast. Importantly, it allows recording and playback for testing web applications and can run several scripts across various browsers available.
This project "Quote website scrapping in python using selenium" will take in quotes website and analyze at the HTML element level, select the required elements, then automatically update the inputs in the dropdown that is present and extract data and display it in the command prompt.

How does this project work?
The project is divided into various components,"" is our main file. First, we start the file by implementing all the required modules, then we are providing a web driver to this file, WebDriver is a tool that we will use to give access to our Python program to work with our laptop's browser. This file also takes data from all other files we have in the project and does the main work.
We have 3 directories inside the project which consist of details related to the elements in that needs to be selected to target, etc.

Download Complete Code


No comments yet