SRE Data Pipelines & Integrity: Pipeline Design
SRE
| Intermediate
- 17 videos | 1h 2m 59s
- Includes Assessment
- Earns a Badge
Site reliability engineers (SREs) encounter numerous and varied pipeline technologies and frameworks in their work. When building a pipeline, SREs need to invest considerable time during the design phase to ensure the results work best for the specific case. In this course, you'll explore the numerous features of a pipeline, such as latency, high availability, development, and operations. You'll also examine the two different pipeline mutations: idempotent and two-phase, as well as the checkpointing technique and various code patterns. You'll then investigate the five core characteristics of the pipeline maturity matrix and outline how they should be used to design the pipeline technology. You'll then identify potential failure modes, outage causes, and different prevention and response techniques. Finally, you'll outline event delivery system design and operations and how to plan for customer integration and support.
WHAT YOU WILL LEARN
-
Discover the key concepts covered in this course
Differentiate between the various pipeline features
Differentiate between idempotent and two-phase mutations
Describe what the checkpointing technique is used for, in what situations it's used, and the advantages of its use
List common code patterns, such as reusing code and the microservice approach
Describe the purpose and characteristics of the maturity matrix
List example milestones for the failure tolerance maturity matrix characteristic
List examples of the scalability maturity matrix characteristic
List examples of the monitoring and debugging maturity matrix characteristic -
List examples of the implementation maturity matrix characteristic
List examples of the testing maturity matrix characteristic
Differentiate between the different potential failure modes
List potential causes of an outage
Recognize event delivery system design and architecture considerations
Outline how event delivery system operations are used using practical examples
Describe considerations when planning for customer integration and support
Summarize the key concepts covered in this course
IN THIS COURSE
-
1m 47s
-
6m 34s
-
3. Idempotent and Two-phase mutations3m 48s
-
4. The Checkpointing Technique3m 28s
-
5. Common Code Patterns3m 10s
-
6. The Maturity Matrix2m 35s
-
7. The Failure Tolerance Maturity Matrix Characteristic4m 14s
-
8. The Scalability Maturity Matrix Characteristic3m 6s
-
9. The Monitoring and Debugging Maturity Matrix Elements3m 7s
-
10. The Implementation Maturity Matrix Characteristic3m 20s
-
11. The Testing Maturity Matrix Characteristic5m 23s
-
12. Potential Failure Modes6m 13s
-
13. Outage Causes4m 6s
-
14. Event Delivery System Design and Architecture3m 35s
-
15. Event Delivery System Operations3m 18sIn this video, you'll learn more about event delivery systems. These groups or aggregate incoming events based on type to glean useful information from event streams. You'll discover what types the system supports are important to delivering useful information. Consider a system that collects events from HVAC units and refrigeration units. Both HVAC units and refrigeration units can have a maximum temperature threshold. FREE ACCESS
-
16. Planning For Customer Integration and Support4m 3sIn this video, you'll learn more about integrating your pipelines with client systems and what user support for your pipelines will entail. Your clients' main objective is going to be to get their own systems up and running. They don't want to spend the majority of their time working with your system. So make sure to keep your pipeline services simple, intuitive, and easy to use. FREE ACCESS
-
17. Course Summary1m 12s
EARN A DIGITAL BADGE WHEN YOU COMPLETE THIS COURSE
Skillsoft is providing you the opportunity to earn a digital badge upon successful completion on some of our courses, which can be shared on any social network or business platform.
Digital badges are yours to keep, forever.
