This repository showcases my implementation of an end-to-end ETL pipeline, leveraging Google Cloud Platform (GCP) to manage and analyze weather data. This project emphasizes my capabilities in using cloud technologies and data engineering practices to handle real-world data workflows effectively.
- API Interaction: Automated data extraction from OpenWeather API.
- Data Manipulation: Utilized Python and Pandas to clean and transform data.
- Cloud Services: Deployed automated ETL workflows to extract, process, and store data on production using GCP services like Cloud Functions, Cloud Scheduler, BigQuery, and Cloud Storage.
- Data Visualization: Created an interactive dashboard using Looker Studio.