My Favourite Google Cloud Resources for Data Engineering

Google Cloud has emerged as a big player, offering a suite of robust tools and services to streamline the process of collecting, processing, and analyzing data.

In this article I aim to explore the resources I used the most and were the best ones to use for the use cases I was facing at the moment.

Before starting the read, I also suggest checking out my recent ➡️Youtube channel. Please, watch and subscribe.

In the YOUTUBE channel there are 2 playlist about GCP Resources, check them out HERE

Google Cloud Storage (GCS)

Google Cloud Storage is the foundational building block for any data engineering project. GCS provides a scalable and secure object storage solution, allowing users to store and retrieve data of any size. Its use cases in data engineering include storing raw data, intermediate results, and final processed datasets. GCS is often integrated with other services like Cloud Storage Transfer Service for data migration and Cloud Storage for Firebase to store and serve user-generated content for mobile and web apps.

Google Cloud Pub/Sub

Google Cloud Pub/Sub is a messaging service that enables real-time communication between applications. In data engineering, it…