Data Engineering Fundamentals for Analysts

codebasics · Beginner ·🔄 Data Engineering ·1mo ago

Key Takeaways

Data engineering fundamentals for analysts

Original Description

In this video, we cover the data engineering fundamentals every data analyst needs to know to start building real pipelines — not just dashboards. 🚀 Ready to go from Data Analyst to AI-Enabled Data Engineer? Our live bootcamp takes you from dashboards to production pipelines: https://codebasics.io/bootcamps/data-engineering-bootcamp-for-analysts 🎮 Want to learn by doing? Datakata is a free, super fun game where you build data pipelines hands-on: https://resources.codebasics.io/MrJey6 Databricks Videos Databricks Free Edition Tutorial with End-to-End Data + AI Project: https://www.youtube.com/watch?v=761SQ9Hxbic End to End Data Engineering Project using Databricks Free Edition | FMCG Domain: https://www.youtube.com/watch?v=U6ZUKWdfSLY End to End Data Engineering Project using Databricks Free Edition | Spark Declarative Pipelines: https://www.youtube.com/watch?v=bIIC44n2Dss ⭐️ Timestamps ⭐️ 0:00:00 Intro 0:00:32 OLAP vs OLTP vs ETL vs Data Warehouse 0:10:02 Data Lake vs Data Warehouse vs Lekehouse 0:16:53 ETL vs ELT 0:22:51 Medallion Architecture 0:28:53 Row Based File Formats - CSV JSON 0:37:09 Column Based File Formats - Parquet 0:40:51 Data Normalization and Denormalization 0:46:46 Data Modeling 0:49:54 Star Snowflake 0:58:43 Dimensional Modeling 1:01:27 Slowly Changing Dimensions 1:07:15 Outro Do you want to learn technology from me? Check https://codebasics.io/?utm_source=description&utm_medium=yt&utm_campaign=description&utm_id=description for my affordable video courses. Need help building software or data analytics/AI solutions? My company https://www.atliq.com/ can help. Click on the Contact button on that website. 🎥 Codebasics Hindi channel: https://www.youtube.com/channel/UCTmFBhuhMibVoSfYom1uXEg #️⃣ Social Media #️⃣ 🧑‍🤝‍🧑 Discord for Community Support: https://discord.gg/r42Kbuk 📸 Codebasics' Instagram: https://www.instagram.com/codebasicshub/ 📝 Codebasics' Linkedin : https://www.linkedin.com/company/codebasics/ 📱 Dhaval's X handle
Watch on YouTube ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Related Reads

📰
I Built My Second ETL Pipeline. This Time, I Started Thinking Like a Data Engineer
Learn how to build a production-ready ETL pipeline with Python, Docker, PostgreSQL, and Kestra by thinking like a data engineer
Towards Data Science
📰
JuiceFS Sync for PB-Scale Data Transfers: Resumable Sync, Encryption, and Bandwidth Control
Learn how to efficiently transfer large volumes of data using JuiceFS Sync, which offers resumable sync, encryption, and bandwidth control, ideal for PB-scale data transfers.
Dev.to AI
📰
How Airflow is using AI to make data engineering more resilient, not more complex
Airflow uses AI to make data engineering more resilient by detecting data drift, resuming failed pipelines, and fixing issues automatically, reducing complexity and improving reliability.
Medium · AI
📰
What Can We Do When Memory Becomes the New Bottleneck in Data Engineering?
Learn how to overcome memory bottlenecks in data engineering using Pandas chunking, Dask, and Polars, and why it matters for processing large datasets
Towards Data Science

Chapters (13)

Intro
0:32 OLAP vs OLTP vs ETL vs Data Warehouse
10:02 Data Lake vs Data Warehouse vs Lekehouse
16:53 ETL vs ELT
22:51 Medallion Architecture
28:53 Row Based File Formats - CSV JSON
37:09 Column Based File Formats - Parquet
40:51 Data Normalization and Denormalization
46:46 Data Modeling
49:54 Star Snowflake
58:43 Dimensional Modeling
1:01:27 Slowly Changing Dimensions
1:07:15 Outro
Up next
A Moment Frozen in Time | Arnav Iyengar | TEDxJenks Youth
TEDx Talks
Watch →