Web Scraping with Python

Web scraping is the Process of automatically extracting data from websites. It involves using software tools or scripts to retrieve information from web pages, parse the content, and save it for further analysis, manipulation, or storage.

Using Modules for Web Scraping in Python

1. install the Required module:
Use the command:

pip install beautifulsoup4

       This installs the beautiful soup library, Which is essential for parsing HTML and XML content  

       2. Web Scraping Workflow:       
Webpages:  start by identifying and accessing the web pages containing the data you want to extract.
Web Scraping:  use tools like beautifulsoup4  to scrape and process data from the web page.
Structured Data: convert the extracted data into structured formats such as XML, CSV, OR DATABASE for further use.

CODING WITH  AN EXAMPLE :  

Web Scraping with Text Content:

import requests  
from bs4 import BeautifulSoup 
import csv 
url="https://www.bikewale.com/royalenfield-bikes/" 
page=requests.get(url) 
soup=BeautifulSoup(page.text,'html.parser')  
print(soup.text)

output: 

Web Scraping with image:

images=soup.findAll('div', class_="PhYMAu")  

for i in images: 
    j=i.img['src'] 
    print(j)

 

Output: