Data Engineering on Microsoft Azure: Data Process Monitoring

Azure    |    Intermediate
  • 15 videos | 1h 31m 11s
  • Includes Assessment
  • Earns a Badge
Rating 4.8 of 17 users Rating 4.8 of 17 users (17)
Being able to monitor data processes to ensure they are operational and working correctly is a crucial part of running your business. Azure provides the Azure Monitor service and the Azure Log Analytics service to perform this function. In this course, you'll learn about the features of the Azure Monitor tools and the concepts of continuous monitoring and visualization. Next, you'll examine how to create metric charts using the Azure Monitor, as well as how to collect and analyze Azure resource log data and perform queries against the Azure Monitor logs. You'll explore how to create and share dashboards that display data from Log Analytics, create Azure Monitor alerts, and use the Azure Data Factory Analytics solution to monitor pipelines. You'll learn how to send the Azure Databricks logs to the Azure Monitor and use the dashboard to analyze the Azure Databricks metrics. Finally, you'll learn how to enable monitoring for Azure Stream Analytics and configure alerts, and also query Azure Log Analytics and filter, sort, and group query results. This course is one in a collection that prepares learners for the Microsoft Data Engineering on Microsoft Azure (DP-203) exam.


  • Discover the key concepts covered in this course
    Describe the features of the azure monitor tools and the concepts of continuous monitoring and visualization
    Create metric charts using the azure monitor
    Collect and analyze azure resource log data
    Perform queries against the azure monitor logs
    Create and share dashboards that display data from log analytics
    Describe the features of azure hdinsight for ingesting, processing, and analyzing big data
    Use the azure data factory analytics solution to monitor pipelines
  • Describe how to monitor and tune query performance
    Query azure log analytics and filter, sort, and group query results
    Describe how to implement versioning control in azure data factory
    Describe how to monitor cluster performance
    Describe how to implement logging for custom monitoring
    Archive data from a log analytics workspace to azure storage using logic app
    Summarize the key concepts covered in this course


  • 1m 52s
  • 6m 49s
    675b4b06-e20b-4347-aa9e-670832a7106d FREE ACCESS
  • Locked
    3.  Creating Azure Monitor Metrics
    6m 58s
    75e8f338-3a40-441b-927c-d0af9a170f9d FREE ACCESS
  • Locked
    4.  Analyzing Azure Resource Logs
    5m 13s
    07f8aafc-88a0-40c1-853a-65e44304d7a4 FREE ACCESS
  • Locked
    5.  Querying Azure Monitor Logs
    7m 29s
    ca97e275-278e-47ca-bc74-066552a5153e FREE ACCESS
  • Locked
    6.  Creating Log Analytics Dashboards
    6m 1s
    ee96d49d-2245-4eda-aec3-9fdeab4597a0 FREE ACCESS
  • Locked
    7.  Azure HDInsight
    6m 44s
    e32184a6-b1cf-44ff-b214-e3bfe781b795 FREE ACCESS
  • Locked
    8.  Monitoring Data Factory Pipelines
    9m 40s
    183806bc-43dd-4f19-a085-a58139f07864 FREE ACCESS
  • Locked
    9.  Monitoring and Tuning Query Performance
    10m 32s
    fe2a9bb0-173b-4b9c-8cbb-102069c781b8 FREE ACCESS
  • Locked
    10.  Monitoring Azure Log Analytics
    6m 58s
    c46ebdd2-7cff-4aba-a959-7f97380c7706 FREE ACCESS
  • Locked
    11.  Azure Data Factory Version Control
    5m 10s
    a05dace8-4a2d-4de6-8d7e-4e46c10372da FREE ACCESS
  • Locked
    12.  Azure Monitor Cluster Monitoring
    4m 30s
    454739d8-b288-4dcb-8b2d-0fa9e57925a7 FREE ACCESS
  • Locked
    13.  Azure Monitor Custom Logging
    5m 55s
    6b247384-03c4-4025-80a9-c34afddd048f FREE ACCESS
  • Locked
    14.  Azure Monitor Logic App
    6m 25s
    93c981f8-43cf-4923-b13e-c8859f7b61f1 FREE ACCESS
  • Locked
    15.  Course Summary
    35ce61b7-b8be-42b0-9d82-f63098b16fcf FREE ACCESS


Skillsoft is providing you the opportunity to earn a digital badge upon successful completion on some of our courses, which can be shared on any social network or business platform.

Digital badges are yours to keep, forever.


Rating 4.5 of 29 users Rating 4.5 of 29 users (29)
Rating 4.8 of 42 users Rating 4.8 of 42 users (42)
Rating 4.3 of 6 users Rating 4.3 of 6 users (6)


Rating 4.9 of 7 users Rating 4.9 of 7 users (7)
Rating 4.4 of 186 users Rating 4.4 of 186 users (186)
Rating 4.8 of 53 users Rating 4.8 of 53 users (53)