Buy Now AED 170.99 + VAT

Monthly Subscription Starting at AED 99 + VAT

Introduction to Data Engineering
  • Level Foundation
  • المدة 13 ساعات hours
  • الطبع بواسطة IBM
  • Offered by

عن

This course introduces you to the core concepts, processes, and tools you need to know in order to get a foundational knowledge of data engineering. You will gain an understanding of the modern data ecosystem and the role Data Engineers, Data Scientists, and Data Analysts play in this ecosystem. The Data Engineering Ecosystem includes several different components. It includes disparate data types, formats, and sources of data. Data Pipelines gather data from multiple sources, transform it into analytics-ready data, and make it available to data consumers for analytics and decision-making. Data repositories, such as relational and non-relational databases, data warehouses, data marts, data lakes, and big data stores process and store this data. Data Integration Platforms combine disparate data into a unified view for the data consumers. You will learn about each of these components in this course. You will also learn about Big Data and the use of some of the Big Data processing tools. A typical Data Engineering lifecycle includes architecting data platforms, designing data stores, and gathering, importing, wrangling, querying, and analyzing data. It also includes performance monitoring and finetuning to ensure systems are performing at optimal levels. In this course, you will learn about the data engineering lifecycle. You will also learn about security, governance, and compliance. Data Engineering is recognized as one of the fastest-growing fields today. The career opportunities available in the field and the different paths you can take to enter this field are discussed in the course. The course also includes hands-on labs that guide you to create your IBM Cloud Lite account, provision a database instance, load data into the database instance, and perform some basic querying operations that help you understand your dataset.

الوحدات

Modern Data Ecosystem and role of Data Engineering

    • 6 Videos
    • 1 Readings
    • 2 Assignment
Show info about module content

2 Assignment

  • Practice Quiz
  • Graded Quiz

6 Videos

  • Welcome to Introduction to Data Engineering
  • Modern Data Ecosystem 
  • Key Players  in the Data Ecosystem
  • What is Data Engineering?
  • Viewpoints: Defining Data Engineering
  • Viewpoints: Evolution of Data Engineering

1 Readings

  • Summary and Highlights

Responsibilities and Skillsets of a Data Engineer

    • 3 Videos
    • 1 Readings
    • 2 Assignment
Show info about module content

2 Assignment

  • Practice Quiz
  • Graded Quiz

3 Videos

  • Responsibilities and Skillsets of a Data Engineer
  • Viewpoints: Skills and Qualities to be a Data Engineer
  • A Day in the Life of a Data Engineer

1 Readings

  • Summary and Highlights

The Data Ecosystem and Languages for Data Professionals

    • 6 Videos
    • 1 Readings
    • 1 Plugin
    • 2 Assignment
Show info about module content

2 Assignment

  • Practice Quiz
  • Graded Quiz

6 Videos

  • Overview of the Data Engineering Ecosystem
  • Types of Data
  • Understanding Different Types of File Formats
  • Sources of Data
  • Languages for Data Professionals
  • Viewpoints: Working with Varied Data Sources and Types

1 Readings

  • Summary and Highlights

Data Repositories, Data Pipelines, and Data Integration Platforms

    • 9 Videos
    • 1 Readings
    • 2 Assignment
Show info about module content

2 Assignment

  • Practice Quiz
  • Graded Quiz

9 Videos

  • Overview of Data Repositories
  • RDBMS
  • NoSQL
  • Data Warehouses, Data Marts, and Data Lakes
  • (Optional): Data Lakehouses Explained
  • Viewpoints: Considerations for Choice of Data Repository
  • ETL, ELT, and Data Pipelines
  • Data Integration Platforms
  • Viewpoints: Tools, Databases, and Data Repositories of Choice

1 Readings

  • Summary and Highlights

[Optional] Create an instance of IBM Db2 database

    • 1 Readings
    • 1 ExternalTool
    • 2 Plugin
Show info about module content

1 External Tool

  • [Optional] Obtain IBM Cloud Feature Code and Activate Trial Account

1 Readings

  • Optional Labs for IBM Cloud and Db2

Big Data Platforms

    • 3 Videos
    • 1 Readings
    • 2 Assignment
Show info about module content

2 Assignment

  • Practice Quiz
  • Graded Quiz

3 Videos

  • Foundations of Big Data
  • Big Data Processing Tools: Hadoop, HDFS, Hive, and Spark
  • Viewpoints: Impact of Big Data on Data Engineering

1 Readings

  • Summary and Highlights

Data Platforms, Data Stores, and Security

    • 4 Videos
    • 1 Readings
    • 2 Assignment
Show info about module content

2 Assignment

  • Practice Quiz
  • Graded Quiz

4 Videos

  • Architecting the Data Platform
  • Factors for Selecting and Designing Data Stores
  • Security
  • Viewpoints: Importance of Data Security

1 Readings

  • Summary and Highlights

Data Collection and Data Wrangling

    • 3 Videos
    • 1 Readings
    • 1 ExternalTool
    • 1 Plugin
    • 2 Assignment
Show info about module content

2 Assignment

  • Practice Quiz
  • Graded Quiz

1 External Tool

  • Hands-On Lab: Load data into the Datasette from a CSV file

3 Videos

  • How to Gather and Import Data
  • Data Wrangling
  • Tools for Data Wrangling

1 Readings

  • Summary and Highlights

Querying Data, Performance Tuning, and Troubleshooting

    • 2 Videos
    • 1 Readings
    • 1 ExternalTool
    • 1 Plugin
    • 2 Assignment
Show info about module content

2 Assignment

  • Practice Quiz
  • Graded Quiz

1 External Tool

  • Lab: Explore your dataset using SQL queries using Datasette

2 Videos

  • Querying and Analyzing Data
  • Performance Tuning and Troubleshooting

1 Readings

  • Summary and Highlights

Governance and Compliance

    • 1 Videos
    • 2 Readings
    • 2 Assignment
Show info about module content

2 Assignment

  • Practice Quiz
  • Graded Quiz

1 Videos

  • Governance and Compliance

2 Readings

  • Summary and Highlights
  • Optional: Overview of the DataOps Methodology

Career Opportunities and Learning Paths

    • 6 Videos
    • 1 Readings
    • 2 Plugin
    • 2 Assignment
Show info about module content

2 Assignment

  • Practice Quiz
  • Graded Quiz

6 Videos

  • Career Opportunities in Data Engineering
  • Viewpoints: Get into Data Engineering
  • Data Engineering Learning Path
  • Viewpoints: What Do Employers Look for in a Data Engineer
  • Viewpoints: The Many Paths to Data Engineering
  • Viewpoints: Advice to Aspiring Data Engineers

1 Readings

  • Summary and Highlights

Final Assignment

    • 1 PeerReview
    • 1 Assignment
Show info about module content

1 Assignment

  • Final Quiz

1 Peer Review

  • Peer Reviewed Assignment

Course Wrap-Up

    • 1 Readings
Show info about module content

1 Readings

  • Congratulations and Next Steps

Auto Summary

Dive into the foundational world of Data Engineering with this engaging course led by Coursera. Explore core concepts, modern data ecosystems, and the roles of Data Engineers, Scientists, and Analysts. You'll cover data pipelines, repositories, integration platforms, and Big Data tools, alongside hands-on labs using IBM Cloud Lite. Perfect for beginners, this 780-minute course offers a comprehensive look at the data engineering lifecycle, including security and career pathways, available under a Starter subscription.

Rav Ahuja
Instructors

Rav Ahuja

Priya Kapoor
Instructors

Priya Kapoor