SRE Data Pipelines & Integrity: Pipeline Design

SRE    |    Intermediate
  • 17 Videos | 1h 2m 59s
  • Includes Assessment
  • Earns a Badge
Likes 22 Likes 22
Site reliability engineers (SREs) encounter numerous and varied pipeline technologies and frameworks in their work. When building a pipeline, SREs need to invest considerable time during the design phase to ensure the results work best for the specific case. In this course, you'll explore the numerous features of a pipeline, such as latency, high availability, development, and operations. You'll also examine the two different pipeline mutations: idempotent and two-phase, as well as the checkpointing technique and various code patterns. You'll then investigate the five core characteristics of the pipeline maturity matrix and outline how they should be used to design the pipeline technology. You'll then identify potential failure modes, outage causes, and different prevention and response techniques. Finally, you'll outline event delivery system design and operations and how to plan for customer integration and support.

WHAT YOU WILL LEARN

  • discover the key concepts covered in this course
    differentiate between the various pipeline features
    differentiate between idempotent and two-phase mutations
    describe what the checkpointing technique is used for, in what situations it's used, and the advantages of its use
    list common code patterns, such as reusing code and the microservice approach
    describe the purpose and characteristics of the maturity matrix
    list example milestones for the failure tolerance maturity matrix characteristic
    list examples of the scalability maturity matrix characteristic
    list examples of the monitoring and debugging maturity matrix characteristic
  • list examples of the implementation maturity matrix characteristic
    list examples of the testing maturity matrix characteristic
    differentiate between the different potential failure modes
    list potential causes of an outage
    recognize event delivery system design and architecture considerations
    outline how event delivery system operations are used using practical examples
    describe considerations when planning for customer integration and support
    summarize the key concepts covered in this course

IN THIS COURSE

  • Playable
    1. 
    Course Overview
    1m 47s
    UP NEXT
  • Playable
    2. 
    Pipeline Features
    6m 34s
  • Locked
    3. 
    Idempotent and Two-phase mutations
    3m 48s
    FREE ACCESS
  • Locked
    4. 
    The Checkpointing Technique
    3m 28s
    FREE ACCESS
  • Locked
    5. 
    Common Code Patterns
    3m 10s
    FREE ACCESS
  • Locked
    6. 
    The Maturity Matrix
    2m 35s
    FREE ACCESS
  • Locked
    7. 
    The Failure Tolerance Maturity Matrix Characteristic
    4m 14s
    FREE ACCESS
  • Locked
    8. 
    The Scalability Maturity Matrix Characteristic
    3m 6s
    FREE ACCESS
  • Locked
    9. 
    The Monitoring and Debugging Maturity Matrix Elements
    3m 7s
    FREE ACCESS
  • Locked
    10. 
    The Implementation Maturity Matrix Characteristic
    3m 20s
    FREE ACCESS
  • Locked
    11. 
    The Testing Maturity Matrix Characteristic
    5m 23s
    FREE ACCESS
  • Locked
    12. 
    Potential Failure Modes
    6m 13s
    FREE ACCESS
  • Locked
    13. 
    Outage Causes
    4m 6s
    FREE ACCESS
  • Locked
    14. 
    Event Delivery System Design and Architecture
    3m 35s
    FREE ACCESS
  • Locked
    15. 
    Event Delivery System Operations
    3m 18s
    FREE ACCESS
  • Locked
    16. 
    Planning For Customer Integration and Support
    4m 3s
    FREE ACCESS
  • Locked
    17. 
    Course Summary
    1m 12s
    FREE ACCESS

EARN A DIGITAL BADGE WHEN YOU COMPLETE THIS COURSE

Skillsoft is providing you the opportunity to earn a digital badge upon successful completion of this course, which can be shared on any social network or business platform

Digital badges are yours to keep, forever.

YOU MIGHT ALSO LIKE

COURSE Core Skills for Site Reliability Engineers: SRE Collaboration & Communication
Likes 23 Likes 23  
COURSE SRE Troubleshooting Processes
Likes 159 Likes 159  
COURSE SRE Data Pipelines & Integrity: Data Integrity
Likes 22 Likes 22  

PEOPLE WHO VIEWED THIS ALSO VIEWED THESE

COURSE SRE Data Pipelines & Integrity: Data Integrity
Likes 22 Likes 22  
COURSE Top 10 List Items
Likes 2025 Likes 2025  
COURSE SRE Testing Tasks: Software Reliability & Testing
Likes 45 Likes 45