End-To-End Data Engineering Project. Made to learn some common data engineering practices.

Automated text cleaning, translation, and TTS for WordPress posts with n8n and GCP

Build a data pipeline on Google Cloud using an event-driven architecture, leveraging GCS, Cloud Run functions, and BigQuery. Explore both VM and Composer options for Airflow management, and utilize Logging & Monitoring for pipeline health. Discover how SQL-based BigQuery ML can be used for initial ML implementation in specific scenarios.

A reusable solution to kill billing on any projects associated with a given budget and budget alert. If your budget is exceeded, the resulting budget alert will cause all projects associated with that alert to be detached from the billing account. This immediately prevents all paid resources in the project from being consumed.

Serverless loader: copy remote files directly into Google Cloud Storage by a fully automated workflow using Terraform and Cloud Run Functions.

PySpark-based ETL pipeline leveraging Dataproc, Cloud Storage, Cloud Run Functions and BigQuery, to automate Spotify "New Releases" data processing and visualization in Looker Studio.

This repo hosts a data-engineering pipeline that utilizes google cloud-storage, google pub/sub, google cloud function, airflow, ngrok, open-ai to facilitate a trigger based ELT pipeline. It also manages some vectorized data and geometric data following standard data retrieval and storage practices.

Develop and bundle your Cloud Run functions with ease

A fully automated ETL pipeline that fetches and stores real-time traffic and weather data in BigQuery, with a live Looker dashboard for visualization.

Los Mirlos Storytelling, a magical serverless backend built with Google Cloud Functions and powered by Gemini (Google's LLM)

Official LINE account for notifying garbage collection days

Cloud Run functionsとActiveReports for .NETでつくる帳票生成API

Serverless ETL pipeline on GCP using Cloud Run, Pub/Sub, BigQuery & Looker for real-time NYC Taxi ML insights.