This solution provides an automated, serverless way to redact sensitive data from PDF files using Google Cloud Services like Data Loss Prevention (DLP), Cloud Workflows, and Cloud Run.

Terraform Lab Foundation provides general building blocks for Google Cloud content authors. Samples are developed for the most common use cases when building on Google Cloud.

This is a demo project to use Terraform to manage BigQuery scheduled queries with Cloud Build CI/CD

...an automated data pipeline that retrieves cryptocurrency data from the CoinCap API, processes and transforms it for analysis, and presents key metrics on a near-real-time dashboard

Yelp Data Processing Pipeline on GCP

This project uses Terraform to deploy a BigQuery Data Clean Room on Google Cloud

Google BigQuery schemas for Braze Currents

Final project for DataTalks.Club Data Engineering bootcamp

Generates daily SBOM and vulnerability reports for container images and saves resulting files into GCS bucket and data into BigQuery tables.

Use GCP Datastream to incrementally load PostgreSQL to BigQuery

Store api response to BigQuery to analyze the data

Dataflow job subscriber to PubSub subscription. It takes message from subscription and push it into BigQuery table.

terraform-bigquery-googlesheet

A terraform module to copy BigQuery datasets across regions

Bauli repository for connection between SAP Datasphere and Google BigQuery

This repo contains the solution for an ETL pipeline on GCP, using Terraform for infrastructure and Airflow for orchestration.

Automatic Anomaly Decetor

GenAI data pipeline that performs data preparation, management and performance evaluation tasks for RAG systems using SQL as the primary development language. Please feel free to use this as a starting point for your own projects.

A IaC script to ingest and process messages containing data of trips taken by vehicles.

Terraform module for BigQuery sink connector on Aiven KafkaConnect cluster