Website Scraping using Python

By Rigved Alankar

The project involves scraping data from two websites MOHFW and Instagram using Python libraries

Web scraping, web harvesting, or web data extraction is data scraping used for extracting data from websites. Web scraping software may access the World Wide Web directly using the Hypertext Transfer Protocol, or through a web browser.The project involves two python scripts which scrapes data from two websites namely the Ministry of Health and Family Welfare to keep track of the Covid-19 situation in India while the other one involves scraping user profile stats from the social media site Instagram. The libraries involved in scraping data were BeautifulSoup and requests. Web scraping has a lot of application in various fields like Data Science, price monitoring, financial data aggregation, news tracking, monitoring consumer sentiment etc.