Advanced NLP: Introduction to Transformer Models
Natural Language Processing 2022
| Intermediate
- 12 Videos | 40m 55s
- Includes Assessment
- Earns a Badge
With recent advancements in cheap GPU compute power and natural language processing (NLP) research, companies and researchers have introduced many powerful models and architectures that have taken NLP to new heights. In this course, learn about Transformer models like Bert and GPT and the maturity of AI in NLP areas due to these models. Next, examine the fundamentals of Transformer models and their architectures. Finally, discover the importance of attention mechanisms in the Transformer architecture and how they help achieve state-of-the-art results in NLP tasks. Upon completing this course, you'll be able to understand different aspects of Transformer architectures like the self-attention layer and encoder-decoder models.
WHAT YOU WILL LEARN
-
discover the key concepts covered in this courseoutline and apply sequence-to-sequence (Seq2Seq) encoder-decoder network architecturerecall how to use the attention method to improve NLP model resultsidentify the fundamentals of the Transformer architecturerecall the fundamentals of the self-attention layer in the Transformer architecturestate the fundamentals of multi-head attention in the Transformer architecture
-
identify the encoder block in the Transformer architectureidentify the decoder block in the Transformer architectureoutline the fundamentals of Transformer modelsrecall industry use cases for Transformer modelsstate the challenges for Transformer modelssummarize the key concepts covered in this course
IN THIS COURSE
-
1.Course Overview1m 20sUP NEXT
-
2.Sequence-to-Sequence (Seq2Seq) Models6m 52s
-
3.Attention in Seq2Seq Models7m 19s
-
4.Transformer Architecture1m
-
5.Self-Attention Layer in Transformer Architecture6m 52s
-
6.Multi-head Attention in Transformer Architecture3m 32s
-
7.Transformer Encoder Block1m 56s
-
8.Transformer Decoder Block2m 14s
-
9.Transformer Model Architecture1m 41s
-
10.Industry Use Cases for Transformer Models4m 3s
-
11.Transformer Model Challenges3m 24s
-
12.Course Summary43s
EARN A DIGITAL BADGE WHEN YOU COMPLETE THIS COURSE
Skillsoft is providing you the opportunity to earn a digital badge upon successful completion of this course, which can be shared on any social network or business platform
Digital badges are yours to keep, forever.