Understand the Vehicle System Use Case

Create Azure SQL Server and Database

Practical Lab Add another pipelines for moving data from Staging to SQL DB

End to End Testing

Create Architect Diagram for Vehicles Data engineering Solution

Practical Lab Create S3 bucket in the AWS Account and upload data

Practical Lab Create ADLS Storage account(Landing Folder)

Practical Lab Create Azure Data Factory Account For Data pipelines

Practical Lab Create Azure Key Vault and Add the secrets

Practical Lab Create Pipeline End to end pipeline with triggers enabled

Practical Lab Create Azure Function with blob trigger logic

Azure Function Update the JSON Format

Project 2 AP Morgan Data Platform Introduction

Practical Lab Add notebook in Databricks and Implement the Business Logic

Practical Lab Create Azure Databricks Linked Service in ADF

Practical Lab Create ADF Pipeline to call Notebook and Test End to End Flow

Project 2 Architecture Diagram

Practical Lab Create Azure Data Lake Storage account and Drop input files

Practical Lab Create Azure Databricks Account Workspace

Practical Lab Azure SQL Server

Practical Lab Connect SQL DB with SSMS and Create MetaData Schema table

Practical Lab Azure Key Vault to keep SQL server password and SAS token Lab

Practical Lab Create a secrets scope in Databricks

Practical Lab Create Cluster in Azure Databricks

Azure Data Factory Introduction

Lab Create Your First ADF Pipeline

Lab Parameterized Dataset in ADF

Integration Runtime

Lab Schedule Trigger in ADF

Lab Tumbling Window Trigger in ADF

Lab Storage Event type Trigger in ADF

Learn Data Flow in Azure Data Factory