Como criar data lakes e data warehouses no Google Cloud

External: Coursera Courses ↗ · Coursera

Open Course on External: Coursera

Free to audit · Opens on External: Coursera

Como criar data lakes e data warehouses no Google Cloud

Coursera · Intermediate ·🔄 Data Engineering ·3mo ago

Skills: Data Warehousing90%Lakehouse Architecture80%

Key Takeaways

Creates data lakes and warehouses on Google Cloud

Original Description

Os dois principais componentes de um pipeline de dados são data lakes e warehouses. Neste curso, destacamos os casos de uso para cada tipo de armazenamento e as soluções de data lake e warehouse disponíveis no Google Cloud de forma detalhada e técnica. Além disso, também descrevemos o papel de um engenheiro de dados, os benefícios de um pipeline de dados funcional para operações comerciais e analisamos por que a engenharia de dados deve ser feita em um ambiente de nuvem. Este é o primeiro curso da série ""Data Engineering on Google Cloud"". Após a conclusão, recomendamos que você comece o curso ""Building Batch Data Pipelines on Google Cloud"".

Watch on External: Coursera ↗ (saves to browser)

Sign in to unlock AI tutor explanation · ⚡30

More on: Data Warehousing

View skill →

Build A Data Warehouse in Azure

Building Data Lakes and Lakehouses with Microsoft Fabric

Building Data Lakes and Lakehouses with Microsoft Fabric

Microsoft Azure - Data Lake

Microsoft Azure - Data Lake

Star Schemas & Track Changes

Build a Data Warehouse in AWS

Build a Data Warehouse in AWS

Data Management with Databricks: Big Data with Delta Lakes

Data Management with Databricks: Big Data with Delta Lakes

Related Reads

I Built My Second ETL Pipeline. This Time, I Started Thinking Like a Data Engineer

Learn how to build a production-ready ETL pipeline with Python, Docker, PostgreSQL, and Kestra by thinking like a data engineer

Towards Data Science

JuiceFS Sync for PB-Scale Data Transfers: Resumable Sync, Encryption, and Bandwidth Control

Learn how to efficiently transfer large volumes of data using JuiceFS Sync, which offers resumable sync, encryption, and bandwidth control, ideal for PB-scale data transfers.

How Airflow is using AI to make data engineering more resilient, not more complex

Airflow uses AI to make data engineering more resilient by detecting data drift, resuming failed pipelines, and fixing issues automatically, reducing complexity and improving reliability.

What Can We Do When Memory Becomes the New Bottleneck in Data Engineering?

Learn how to overcome memory bottlenecks in data engineering using Pandas chunking, Dask, and Polars, and why it matters for processing large datasets

Towards Data Science

A Moment Frozen in Time | Arnav Iyengar | TEDxJenks Youth