Scaling Data Pipelines with Terraform

Matillion · Beginner ·☁️ DevOps & Cloud ·2mo ago

About this lesson

Learn how to use the Streaming Terraform provider to manage data pipelines at scale. This tutorial covers how to automate the lifecycle of pipelines and runners, including SQL Server, Postgres, and Snowflake integrations, moving beyond manual UI configuration to efficient Infrastructure as Code.

Original Description

Learn how to use the Streaming Terraform provider to manage data pipelines at scale. This tutorial covers how to automate the lifecycle of pipelines and runners, including SQL Server, Postgres, and Snowflake integrations, moving beyond manual UI configuration to efficient Infrastructure as Code.

Watch on YouTube ↗ (saves to browser)

Sign in to unlock AI tutor explanation · ⚡30

Related Reads

Most Developers Use the Terminal Like This — Here’s a Better Way

Improve your terminal workflow with better practices and tools

Medium · Data Science

One login for you and your AI agents. Zero long-lived keys.

Simplify cloud access for humans and AI agents with a single login and no long-lived keys

Medium · DevOps

Top 100 Docker Interview Questions & Answers

Boost your DevOps career by mastering Docker with these top 100 interview questions and answers

Medium · DevOps

Your n8n Workflow Is Green. Prove the Outcome Anyway.

Learn to validate n8n workflow outcomes despite successful executions to catch duplicate side effects and stale data

AWS, Azure, GCP: The One Thing Every Business Gets Wrong