10 Concepts all Data Engineers should Know

We know there are much more, but these are fundamentals

Cássio Bolba
4 min readJun 6, 2023

This text talks about a lot of important concepts in the field of Data Engineering. It covers everything from data modeling, which is crucial for creating an efficient database, to data security, which helps protect data from threats and breaches. It also covers cool topics like Data Warehouse, Data Lake, CDC, ETL, Big Data processing, real-time data, data architecture, and Cloud Computing. This text provides an overview of these concepts and processes, which can be very useful for those studying or working with data management.

You might be interest in this series where I’m introducing several important concepts that new Data Engineers should be aware of. The other topics I talked so far:
Data Modelling
CDC
Idempotency
ETL x ELT x EL
Kappa x Lamda Data Architectures
Slowly Changing Dimensions — SCD

I also have 2 series about python:
🐍 Efficient Python
🐍 Software Engineering with Python

lets get started!

--

--

Cássio Bolba
Cássio Bolba

Written by Cássio Bolba

Senior Data Engineer | Udemy Teacher | Expat in Germany | Mentor -> https://linktr.ee/cassiobolba

Responses (4)