Cloud Computing course · JKU Linz
Automated Data Pipeline
The floor of the stack: a data pipeline that provisions and validates itself, so everything above it just deploys.
cloud-computing-project · main
Down the stack
Each line sits at the layer it belongs to.
- logicPrefect flows orchestrate the pipeline on a self-hosted cluster on GKE.
- dataEnvironments and secrets separated per stage; no manual kubectl in the loop.
- infraTerraform provisions the GCP side - cluster, buckets, service accounts - reproducible from zero.
- ciGitHub Actions validates Kubernetes manifests on every push, before anything can merge.
- whyBuilt for the Cloud Computing course during my exchange semester at JKU Linz - NYC taxi data flowing from GCS through BigQuery into Looker dashboards.