BINARY
BRAIN.Independent thinking.
Connected systems.
/PLStart a conversation
15Project archive

COVID-19 Web Scraper

From government dashboards to structured data.

Year
2023
Discipline
Data Engineering
COVID-19 Web Scraper / SYSTEM MODEL01
Data collection model
  1. 01Government dashboards
  2. 02Puppeteer
  3. 03MongoDB

Country totals / regions / daily collection

Data collection workflow

The problem to structure.

Collecting country totals and regional COVID-19 data from Polish government dashboards required a repeatable process. This project explored scheduled collection and storage.

02Implementation

How the pieces connect.

Puppeteer collects the dashboard data. JavaScript, Mongoose and MongoDB support processing and storage of the collected records.

03Delivered

A collector designed to gather Polish COVID-19 statistics from government dashboards and store country and regional records in MongoDB. A historical data project.

Back to all work
Next / your project

A similar challenge?

An idea, a bottleneck, a system that has outgrown its tools. Tell us where you are.

Tell us about it