Abstract
Since 2019, the global pandemic caused by the SARS-CoV-2 virus has infected billions of people and has resulted in high mortality rates over the past few years. Since the start of the epidemic, efforts have been undertaken to restrict the transmission of the COVID-19 virus by administering immunizations in multiple doses to reduce the mortality rate over time. The requirement for a centralized interactive means of monitoring, assessing, and extracting insights led to the widespread use of COVID-19 dashboards.
The data utilized by these dashboards are available in various formats, including JSON, CSV, and XML. The project aims to create a single location with all of the necessary data that end users can query and acquire precise insights and statistics via a filter-enabled user-friendly dashboard. The dashboard exclusively uses COVID-19 data gathered by scraping case, death, and vaccine data from government or reputable COVID-19 sites to keep the data legitimate. As the project title suggests, the scraping is aimed at being done programmatically without using any pre-designed inbuilt scrapers. Instead of the more common document object model parsing method, the scraper uses text parsing. The scraping is done using GET requests and responses to the specific website while trying to impersonate a browser and using the response content and headers to gather further the contents of the document object model and its web pages. After scraping the website, the data is cleaned, analyzed, and displayed in dashboards that are aesthetically appealing and easy to comprehend to raise awareness, reveal the impact, and ultimately assist in prevention efforts. These dashboards can be used to perform simple analyses to understand the impact of the virus around us and the economic and business implications on a global scale.