Cloud Data Engineering with Azure Data Factory
Cloud Data Engineering with Azure Data Factory
Get hands on and build a modern data lake with Azure Data Factory (ADF), Data Lake Storage, Azure SQL and more! New
On Udemy -- > Cloud Data Engineering with Azure Data Factory
I am pleased to present this course on one of the most in demand data engineering tools around... Azure Data Factory!
As the demand for cloud-based data integration services continues to skyrocket, there is a huge demand for professionals with knowledge of services like Azure Data Factory. By learning Azure Data Factory, users can enhance their skills and increase their job prospects in the field of data engineering and analytics.
In this course you will primarily be using Azure Data Factory on Microsoft Azure in addition to other services such as Azure Blob Storage, Azure Data Lake Storage Gen 2 and Azure SQL Database.
The course is packed with lectures, code-along videos and a dedicated course project. As an added benefit you will also have lifetime access to all of the lectures…
This course will cover the following topics:
- Azure Storage Solutions such as Azure Blob Storage and Azure Data Lake Gen2 Storage
- The basics of Azure Data Factory including the core components such as Linked Services, Datasets, Activities, Data Flows, Pipelines and Integration Runtimes
- Integrating data from various file formats such as CSV, JSON and Parquet
- The Copy Activity in Azure Data Factory
- Data Flows, Control Flow and Transformation Activities in Azure Data Factory
- Orchestrating Data Integration Workflows
- How to create Schedules and Triggers to execute your pipelines
- How to use Parameters and Variables with your Linked Services, Datasets and Pipelines
- How to use Azure Data Factory with SQL Databases
- Authentication and Access including Managed Identities, Service Principals and Azure Key Vault
What you'll learn
- Overview and Background of Azure Big Data Analytics Solutions
- Azure Data Factory
- Azure Storage Accounts
- Azure SQL Databases and Upsert Operations
- Integrating Data From Various File Formats
- Authentication and Access: Service Principals, Managed Identities and Azure Key Vault
- Data Pipelines, Copy Activity, Data Flows, Control Flow and Transformation Activities
- Implementing a Modern Data Lake
- Control Flow, Parameters and Variables
- Real World Application of Azure Data Factory
