Data Engineering Capstone Project

About

In this Capstone you'll demonstrate your ability to perform like a Data Engineer. Your mission is to design, implement, and manage a complete data and analytics platform consisting of relational and non-relational databases, data warehouses, data pipelines, big data processing engines, and Business Intelligence (BI) tools.

This Capstone project will require that you apply and sharpen the skills and knowledge you developed in the various courses in the IBM Data Engineering Professional Certificate and utilize multiple tools and technologies to design databases, collect data from multiple sources, extract, transform and load data into a data warehouse, and utilize a cloud-based BI tool to create analytic reports and visualizations. You will also implement predictive analytics and machine learning models using big data tools and techniques.

This capstone requires significant amount of hands-on lab effort throughout the course. You'll exhibit your knowledge and proficiency working with Python, Bash scripts, SQL, NoSQL, RDBMSes, ETL, MySQL, PostgreSQL, Db2, MongoDB, Apache Airflow, Apache Spark, and Cognos Analytics.

Upon successfully completing this Capstone, you should have the confidence and portfolio to take on real-world data engineering projects and showcase your abilities to perform as an entry-level data engineer.

What you will learn

• Build a complete data and analytics platform.
• Setup, manage and query relational and NoSQL databases.
• Create data pipelines and ETL processes using Apache Airflow.
• Design and populate a star/snowflake schema data warehouse and query it using SQL.
• Analyze warehouse data using Business Intelligence (BI) tool Cognos Analytics to create reports and dashboards.
• Deploy a big data machine learning model using Apache Spark.

Skills you learn

• IBM DB2
• Machine Learning
• Business Intelligence
• Big Data
• Predictive Analytics
• MongoDB
• Data Engineering
• Apache Airflow
• Data Warehousing
• Data Collection
• Apache Spark
• Relational Database Management Systems
• NoSQL
• Extract Transform Load (ETL)
• Relational Databases
• SQL (Programming Language)
• Python (Programming Language)
• PostgreSQL
• MySQL
• Bash (Scripting Language)

Auto Summary

The Data Engineering Capstone Project by edX allows you to showcase your skills in SQL, NoSQL, RDBMS, Bash, Python, ETL, Data Warehousing, BI tools, and Big Data. This foundational 6-week IT & Computer Science course offers Starter and Professional subscription options, ideal for those looking to apply their data engineering expertise.