When will I receive my Course Certificate?

If you complete the course successfully, your electronic Course Certificate will be added to your Accomplishments page - from there, you can print your Course Certificate or add it to your LinkedIn profile.

Why can’t I audit this course?

This course is currently available only to learners who have paid or received financial aid, when available.

Is financial aid available?

Yes. In select learning programs, you can apply for financial aid or a scholarship if you can’t afford the enrollment fee. If fin aid or scholarship is available for your learning program selection, you’ll find a link to apply on the description page.

Introduction to Data Engineering on Google Cloud

Grow your skills with Coursera Plus for $239/year (usually $399). Save now.

Introduction to Data Engineering on Google Cloud

Instructor: Google Cloud Training

Included with

Learn more

8 modules

Gain insight into a topic and learn the fundamentals.

Beginner level

No prior experience required

9 hours to complete

Flexible schedule

Learn at your own pace

8 modules

Gain insight into a topic and learn the fundamentals.

Beginner level

No prior experience required

9 hours to complete

Flexible schedule

Learn at your own pace

What you'll learn

Understand the role of a data engineer.
Identify data engineering tasks and core components used on Google Cloud.
Understand how to create and deploy data pipelines of varying patterns on Google Cloud.
Identify and utilize various automation techniques on Google Cloud.

Skills you'll gain

Tools you'll learn

Details to know

Shareable certificate

Add to your LinkedIn profile

Assessments

6 assignments

Taught in English

See how employees at top companies are mastering in-demand skills

Learn more about Coursera for Business

logos of Petrobras, TATA, Danone, Capgemini, P&G and L'Oreal

There are 8 modules in this course

In this course, you learn about data engineering on Google Cloud, the roles and responsibilities of data engineers, and how those map to offerings provided by Google Cloud. You also learn about ways to address data engineering challenges.

This section welcomes you to the Introduction to Data Engineering on Google Cloud course, and provides an overview of the course structure and goals.

What's included

1 video

This module provides an introduction to the role of a data engineer. It covers key concepts such as data sources and sinks, data formats, storage options on Google Cloud, metadata management, and the use of Analytics Hub for data sharing within and outside an organization.

What's included

8 videos1 assignment1 app item1 plugin

8 videos Total 12 minutes

Module Introduction 1 minute
The Role of a Data Engineer 1 minute
Data Sources Versus Data Sinks 2 minutes
Data Formats 1 minute
Storage Solution Options on Google Cloud 5 minutes
Metadata Management Options on Google Cloud 1 minute
Sharing Datasets using Analytics Hub 1 minute
Lab Intro: Loading Data into BigQuery 0 minutes

1 assignment Total 15 minutes

Quiz - Data Engineering Tasks and Components 15 minutes

1 app item Total 90 minutes

Lab: Loading Data into BigQuery 90 minutes

1 plugin Total 15 minutes

Accessing and completing labs 15 minutes

This module provides an overview of data replication and migration on Google Cloud. It covers the basic architecture, the 'gcloud' command-line tool, Storage Transfer Service, Transfer Appliance, and Datastream, along with their functionalities and use cases.

What's included

6 videos1 assignment1 app item

6 videos Total 7 minutes

Module Introduction 0 minutes
Replication and Migration Architecture 2 minutes
The gcloud Command Line Tool 0 minutes
Moving Datasets 1 minute
Datastream 4 minutes
Lab Intro: Datastream: PostgreSQL Replication to BigQuery 0 minutes

1 assignment Total 15 minutes

Quiz - Data Replication and Migration 15 minutes

1 app item Total 45 minutes

Lab: Datastream: PostgreSQL Replication to BigQuery 45 minutes

This module focuses on data extraction and loading processes on Google Cloud, particularly with BigQuery. It covers the basic extraction and loading architecture, the bq command-line tool, BigQuery Data Transfer Service, and BigLake as an alternative to traditional extract-load patterns.

What's included

6 videos1 assignment1 app item

6 videos Total 8 minutes

Module Introduction 0 minutes
Extract and Load Architecture 2 minutes
The bq Command Line Tool 1 minute
BigQuery Data Transfer Service 1 minute
BigLake 5 minutes
Lab Intro: BigLake: Qwik Start 0 minutes

1 assignment Total 15 minutes

Quiz: The Extract and Load Data Pipeline Pattern 15 minutes

1 app item Total 45 minutes

Lab: BigLake: Qwik Start 45 minutes

This module provides an overview of ELT (extract, load, transform) processes on Google Cloud. It covers the basic ELT architecture, a common ELT pipeline example, BigQuery's capabilities for scripting and scheduling SQL, and the functionality and use cases of Dataform.

What's included

5 videos1 assignment1 app item

5 videos Total 10 minutes

Module Introduction 0 minutes
Extract, Load, and Transform (ELT) Architecture 1 minute
SQL Scripting and Scheduling with BigQuery 3 minutes
Dataform 6 minutes
Lab Intro: Create and Execute a SQL Workflow in Dataform 0 minutes

1 assignment Total 15 minutes

Quiz - The Extract, Load, and Transform Data Pipeline Pattern 15 minutes

1 app item Total 60 minutes

Lab: Create and Execute a SQL Workflow in Dataform 60 minutes

This module provides an overview of ETL (extract, transform, load) processes on Google Cloud. It covers the basic ETL architecture, GUI tools, batch and streaming data processing options (Dataproc, Dataproc Serverless), and the role of Bigtable in data pipelines.

What's included

8 videos1 assignment2 app items

8 videos Total 13 minutes

Module Introduction 1 minute
Extract, Transform, and Load (ETL) Architecture 1 minute
Google Cloud GUI Tools for ETL Data Pipelines 2 minutes
Batch Data Processing Using Dataproc 5 minutes
Lab Intro: Use Serverless for Apache Spark to Load BigQuery 0 minutes
Streaming Data Processing Options 3 minutes
Bigtable and Data Pipelines 1 minute
Lab Intro: Creating a Streaming Data Pipeline for a Real-Time Dashboard with Dataflow 0 minutes

1 assignment Total 15 minutes

Quiz - The Extract, Transform, and Load Data Pipeline Pattern 15 minutes

2 app items Total 105 minutes

Lab: Use Serverless for Apache Spark to Load BigQuery 45 minutes
Lab: Creating a Streaming Data Pipeline for a Real-Time Dashboard with Dataflow 60 minutes

This module focuses on automation patterns and options for pipelines on Google Cloud. It covers various tools and services like Cloud Scheduler, Workflows, Cloud Composer, Cloud Run functions, and Eventarc, along with their functionalities and use cases for automation.

What's included

7 videos1 assignment1 app item

7 videos Total 6 minutes

Module Introduction 0 minutes
Automation Patterns and Options for Pipelines 1 minute
Cloud Scheduler and Workflows 1 minute
Cloud Composer 1 minute
Cloud Run Functions 1 minute
Eventarc 1 minute
Lab Intro: Use Cloud Run Functions to Load BigQuery 0 minutes

1 assignment Total 15 minutes

Quiz - Automation Techniques 15 minutes

1 app item Total 45 minutes

Lab: Use Cloud Run Functions to Load BigQuery 45 minutes

In this final section, we review what was presented in this course and discuss the next steps to continue your cloud learning journey.

What's included

1 video1 reading

Instructor

Google Cloud Training

Google Cloud

2,113 Courses 4,016,582 learners

Offered by

Google Cloud

Explore more from Cloud Computing

DeepLearning.AI
Introduction to Data Engineering
Course
Duke University
Cloud Data Engineering
Course
Google Cloud
Preparing for Google Cloud Certification: Cloud Data Engr
Professional Certificate
IBM
Introduction to Data Engineering
Course

Why people choose Coursera for their career

Felipe M.

Learner since 2018

"To be able to take courses at my own pace and rhythm has been an amazing experience. I can learn whenever it fits my schedule and mood."

Jennifer J.

Learner since 2020

"I directly applied the concepts and skills I learned from my courses to an exciting new project at work."

Larry W.

Learner since 2021

"When I need courses on topics that my university doesn't offer, Coursera is one of the best places to go."

Chaitanya A.

"Learning isn't just about being better at your job: it's so much more than that. Coursera allows me to learn without limits."

Open new doors with Coursera Plus

Unlimited access to 10,000+ world-class courses, hands-on projects, and job-ready certificate programs - all included in your subscription

Learn more

Advance your career with an online degree

Earn a degree from world-class universities - 100% online

Explore degrees

Join over 3,400 global companies that choose Coursera for Business

Upskill your employees to excel in the digital economy

Learn more

Frequently asked questions

Yes, you can preview the first video and view the syllabus before you enroll. You must purchase the course to access content not included in the preview.

If you decide to enroll in the course before the session start date, you will have access to all of the lecture videos and readings for the course. You’ll be able to submit assignments once the session starts.

Once you enroll and your session begins, you will have access to all videos and other resources, including reading items and the course discussion forum. You’ll be able to view and submit practice assessments, and complete required graded assignments to earn a grade and a Course Certificate.

Introduction to Data Engineering on Google Cloud

Introduction to Data Engineering on Google Cloud

What you'll learn

Skills you'll gain

Tools you'll learn

Details to know

See how employees at top companies are mastering in-demand skills

There are 8 modules in this course

Course Introduction

What's included

Data Engineering Tasks and Components

What's included

Data Replication and Migration

What's included

The Extract and Load Data Pipeline Pattern

What's included

The Extract, Load, and Transform Data Pipeline Pattern

What's included

The Extract, Transform, and Load Data Pipeline Pattern

What's included

Automation Techniques

What's included

Course Summary

What's included

Instructor

Offered by

Explore more from Cloud Computing

Introduction to Data Engineering

Cloud Data Engineering

Preparing for Google Cloud Certification: Cloud Data Engr

Introduction to Data Engineering

Why people choose Coursera for their career

Felipe M.

Jennifer J.

Larry W.

Chaitanya A.

Open new doors with Coursera Plus

Advance your career with an online degree

Join over 3,400 global companies that choose Coursera for Business

Frequently asked questions

Can I preview a course before enrolling?

When will I have access to the lectures and assignments?

What will I get when I enroll?

More questions