Web Scraping on Flipkart Using Python

By Prathiksha K

This script written in Python using various libraries such as BeautifulSoup, Selenium, NumPy and Pandas. The objective of the code is to scrape mobile phone data from the Flipkart website.

The code demonstrates the concept of web scraping, where it automates the process of extracting data from a website. The objective is to collect mobile phone data from Flipkart and store it in a structured format.

A web scraping script written in Python using various libraries such as BeautifulSoup, Selenium, NumPy, Pandas, Matplotlib, and Seaborn. The objective of the code is to scrape mobile phone data from the Flipkart website.

1. It imports the necessary libraries/modules.

2. It defines the URL of the Flipkart website to scrape mobile phone data.

3. It sends a GET request to the URL and retrieves the page content.

4. It uses BeautifulSoup to parse the HTML content and extract relevant information such as product names, prices, ratings, features, and MRP prices from the website.

5. It loops through multiple pages (1 to 13) of the search results and extracts the desired information for each page.

6. It stores the extracted data into lists.

7. It creates a DataFrame using the extracted data.

8. It applies regular expressions to extract specific information such as battery capacity, display size, RAM, ROM, processor, warranty, and expandable storage from the "Features" column of the DataFrame.

9. It cleans and modifies the extracted data.

10. It saves the final DataFrame as a CSV file.