Advanced NLP: Language Translation Using Transformer Model

Natural Language Processing 2022    |    Intermediate
  • 13 Videos | 1h 29m 12s
  • Includes Assessment
  • Earns a Badge
Translating from one language to another is a common task in Natural Language Processing (NLP). The transformer model works by passing multiple words through a neural network simultaneously and is one of the newest models propelling a surge of progression, sometimes referred to as transformer AI. In this course, you will solve real-world machine translation problems, translating from English to French. Explore machine translation problem formulation, notebook setup, and data pre-processing. Then, learn to tokenize and vectorize data into a sequence of integers, where each integer represents the index of a word in a vocabulary. Discover transformer encoder-decoder and see how to produce input and output sequences. Finally, define the attention layer and assemble, train, and evaluate the translation model end to end. Upon completing this course, you will be able to solve industry-level problems using deep learning methodology in the TensorFlow ecosystem.

WHAT YOU WILL LEARN

  • discover the key concepts covered in this course
    outline machine translation applications
    demonstrating English to French machine translation - frame a problem and use single sentence translation
    demonstrating English to French machine translation - set up the environment and download the translation data
    demonstrating English to French machine translation - perform exploratory data analysis (EDA) and data pre-processing
    demonstrating English to French machine translation - use tokens and vectors in integer sequences
    demonstrating English to French machine translation - define training and validation datasets with input, target of specified batch size, and sequence length
  • demonstrating English to French machine translation - produce a new representation of input sequence using Transformer encoder
    demonstrating English to French machine translation - produce an output target sequence using Transformer decoder
    demonstrating English to French machine translation - define attention and positional embedding for input sequence
    demonstrating English to French machine translation - assemble and train model end to end
    demonstrating English to French machine translation - translate a test sentence using a trained model
    summarize the key concepts covered in this course

IN THIS COURSE

  • Playable
    1. 
    Course Overview
    1m 22s
    UP NEXT
  • Playable
    2. 
    Machine Translation
    8m 10s
  • Locked
    3. 
    Using Single Sentence English to French Translation
    2m 17s
  • Locked
    4. 
    Setting up the Environment for Translation
    5m 36s
  • Locked
    5. 
    Performing EDA for Translation
    3m 39s
  • Locked
    6. 
    Using Tokens and Vectors for Translation
    4m 48s
  • Locked
    7. 
    Using Training and Validation Data for Translation
    14m 56s
  • Locked
    8. 
    Using Transformer Encoder for Translation
    9m 15s
  • Locked
    9. 
    Using Transformer Decoder for Translation
    11m 35s
  • Locked
    10. 
    Defining Attention and Embedding for Translation
    5m 20s
  • Locked
    11. 
    Assembling and Training the Model for Translation
    10m 6s
  • Locked
    12. 
    Using a Trained Model for Translation
    11m 19s
  • Locked
    13. 
    Course Summary
    48s

EARN A DIGITAL BADGE WHEN YOU COMPLETE THIS COURSE

Skillsoft is providing you the opportunity to earn a digital badge upon successful completion of this course, which can be shared on any social network or business platform

Digital badges are yours to keep, forever.