Data Engineering on Microsoft Azure: Databrick Processing

Azure 2021    |    Intermediate
  • 11 videos | 1h 49m 12s
  • Includes Assessment
  • Earns a Badge
Likes 28 Likes 28
When working with big data there needs to be a mechanism to process and transform this data quickly and efficiently. Azure Databricks is a service that provides the latest version of Apache Spark that provides functionality processing data from Azure Storage. In this course, you will learn about the types of processing that can be performed with Azure Databricks such as stream, batch, image and parallel processing. Next, you'll learn how to create an Azure Databricks workspace using an Apache Spark cluster, run jobs in the Azure Databricks Workspace jobs using a service principal and query data in SQL server using an Azure Databricks notebook. Next, you'll learn how to retrieve data from an Azure Blob Storage using Azure Databricks and the Azure Key Vault, implement a Cosmos DB service endpoint for Azure Databricks, and extract, transform, and load data using Azure Databricks. Finally, you'll learn how to stream data into Azure Databricks by using Event Hubs and perform sentiment analysis for steam data by making use of Azure Databricks. This course is one in a collection that prepares learners for the Microsoft Data Engineering on Microsoft Azure (DP-203) exam.

WHAT YOU WILL LEARN

  • discover the key concepts covered in this course
    describe the types of available processing when using Azure Databricks such as stream, batch, image and parallel processing
    create an Azure Databricks workspace using an Apache Spark cluster
    run jobs in the Azure Databricks Workspace jobs using a service principal
    query data in SQL server using an Azure Databricks notebook
    validate and handle failed batch loads
  • implement a Cosmos DB service endpoint for Azure Databricks
    extract, transform, and load data using Azure Databricks
    perform sentiment analysis for steam data by making use of Azure Databricks
    debug Spark Jobs running on HDInsight
    summarize the key concepts covered in this course

IN THIS COURSE

  • 2m 7s
  • 8m 9s
    996dda31-1871-48cc-9f44-ca275bdeaf4f FREE ACCESS
  • Locked
    3.  Creating an Azure Databricks Workspace
    5m 58s
    b1e03709-2462-4f0e-aea0-46f7fe907629 FREE ACCESS
  • Locked
    4.  Running Azure Databricks Workspace Jobs
    21m 8s
    e8be6a2b-938e-4b38-9ff2-1895fb6d143c FREE ACCESS
  • Locked
    5.  Querying SQL Server
    12m 25s
    60018d52-e3f0-403e-881d-680b77d79832 FREE ACCESS
  • Locked
    6.  Failed Batch Loads
    4m 40s
    d1dbfc43-9af0-4266-ac8d-a514285ca9bb FREE ACCESS
  • Locked
    7.  Implementing Cosmos DB Endpoints
    17m 59s
    db79d1a2-67ee-4004-958f-bcefb4758f29 FREE ACCESS
  • Locked
    8.  Extracting, Transforming, and Loading Data
    10m 31s
    8a1d165d-0b57-4089-8ad8-6bf957c2f346 FREE ACCESS
  • Locked
    9.  Performing Sentiment Analysis
    17m 10s
    4e38b039-c180-4542-a866-312ffdab3739 FREE ACCESS
  • Locked
    10.  Debugging Spark Job
    8m 11s
    a7e7550d-9995-447d-9bd6-3be25aeca054 FREE ACCESS
  • Locked
    11.  Course Summary
    54s
    d472a211-c2ef-4488-940f-6455f492e457 FREE ACCESS

EARN A DIGITAL BADGE WHEN YOU COMPLETE THIS COURSE

Skillsoft is providing you the opportunity to earn a digital badge upon successful completion on some of our courses, which can be shared on any social network or business platform.

Digital badges are yours to keep, forever.

YOU MIGHT ALSO LIKE

Course Azure Databricks & Data Pipelines
Likes 42 Likes 42  
Course Azure Data Scientist Associate: Machine Learning Data Stores & Compute
Likes 10 Likes 10  
Course Microsoft Azure Fundamentals: Databases & Data Analytics
Likes 229 Likes 229  

PEOPLE WHO VIEWED THIS ALSO VIEWED THESE

Course Microsoft Azure Fundamentals: Databases & Data Analytics
Likes 229 Likes 229  
Course Data Engineering on Microsoft Azure: Data Factory
Likes 93 Likes 93  
Course Data Engineering on Microsoft Azure: Synapse Analytics
Likes 48 Likes 48