Data
Data Engineering
ETL pipelines, data warehousing, streaming, orchestration and lakehouse architecture
Skills in this topic
5 skills — Sign in to track your progress
ETL Basics
beginner
Write a Python ETL pipeline with pandas
Workflow Orchestration
intermediate
Build a DAG in Airflow with sensors and operators
Streaming Data
intermediate
Produce and consume Kafka topics with Python
Data Warehousing
intermediate
Model a star schema with dbt
Lakehouse Architecture
advanced
Manage ACID transactions on a data lake with Delta Lake
The Next Web AI
🔄 Data Engineering
⚡ AI Lesson
1mo ago
Microsoft turns to Chevron’s gas to power a Texas data centre
The Chevron Microsoft gas deal hands the oil major a 20-year contract to power a giant West Texas data centre. For a company that built its AI plans on renewabl
Wired AI
🔄 Data Engineering
⚡ AI Lesson
1mo ago
China Opens World’s First Wind-Powered Underwater Data Center
With an initial capacity of 24 megawatts, the innovative data center uses seawater as a natural cooling system.
The Register
🔄 Data Engineering
⚡ AI Lesson
2mo ago
Europe told to cool its datacenter boom before water and power run short
Get the balance right, Grundfos says, and the region will be a shining example of how to do it without sacrificing the environment
The Verge
🔄 Data Engineering
⚡ AI Lesson
2mo ago
The biggest data center ever is becoming a huge problem in Utah
Utah may host one of the world's most colossal data centers, despite stark warnings from experts and fierce public backlash. Earlier this month, commissioners i
DeepCamp AI