Hadoop & MapReduce Getting Started

Apache Hadoop 2.9    |    Beginner
  • 8 Videos | 1h 3m 29s
  • Includes Assessment
  • Earns a Badge
Likes 34 Likes 34
In this course, learners will explore the theory behind big data analysis using Hadoop, and how MapReduce enables parallel processing of large data sets distributed on a cluster of machines. Begin with an introduction to big data and the various sources and characteristics of data available today. Look at challenges involved in processing big data and options available to address them. Next, a brief overview of Hadoop, its role in processing big data, and the functions of its components such as the Hadoop Distributed File System (HDFS), MapReduce, and YARN (Yet Another Resource Negotiator). Explore the working of Hadoop's MapReduce framework to process data in parallel on a cluster of machines. Recall steps involved in building a MapReduce application and specifics of the Map phase in processing each row of the input file's data. Recognize the functions of the Shuffle and Reduce phases in sorting and interpreting the output of the Map phase to produce a meaningful output. To conclude, complete an exercise on the fundamentals of Hadoop and MapReduce.

WHAT YOU WILL LEARN

  • describe what big data is and list the various sources and characteristics of data available today
    recognize the challenges involved in processing big data and the options available to address them such as vertical and horizontal scaling
    specify the role of Hadoop in processing big data and describe the function of its components such as HDFS, MapReduce, and YARN
    identify the purpose and describe the workings of Hadoop's MapReduce framework to process data in parallel on a cluster of machines
  • recall the steps involved in building a MapReduce application and the specific workings of the Map phase in processing each row of data in the input file
    recognize the functions of the Shuffle and Reduce phases in sorting and interpreting the output of the Map phase to produce a meaningful output
    recognize the techniques related to scaling data processing tasks, working with clusters, and MapReduce and identify the Hadoop components and their functions

IN THIS COURSE

  • Playable
    1. 
    Course Overview
    2m 53s
    UP NEXT
  • Playable
    2. 
    An Introduction to Big Data
    8m 27s
  • Locked
    3. 
    Building Systems to Scale with Data
    9m 16s
    FREE ACCESS
  • Locked
    4. 
    A Quick Overview of Hadoop
    9m 28s
    FREE ACCESS
  • Locked
    5. 
    MapReduce Overview
    9m 17s
    FREE ACCESS
  • Locked
    6. 
    The Map Phase of a MapReduce
    8m 24s
    FREE ACCESS
  • Locked
    7. 
    The Shuffle and Reduce Phases
    7m 16s
    FREE ACCESS
  • Locked
    8. 
    Exercise: Fundamentals of Hadoop and MapReduce
    8m 28s
    FREE ACCESS

EARN A DIGITAL BADGE WHEN YOU COMPLETE THIS COURSE

Skillsoft is providing you the opportunity to earn a digital badge upon successful completion of this course, which can be shared on any social network or business platform

Digital badges are yours to keep, forever.

YOU MIGHT ALSO LIKE

COURSE Working with Files in Hadoop HDFS
Likes 22 Likes 22  
COURSE AWS Certified Machine Learning: Athena, QuickSight, & EMR
COURSE Collections in Java: Sets & Maps

PEOPLE WHO VIEWED THIS ALSO VIEWED THESE

COURSE Data Silos, Lakes, & Streams Introduction
Likes 23 Likes 23  
COURSE Getting Started with Python: Introduction
Likes 2989 Likes 2989  
COURSE Python - Introduction to NumPy for Multi-dimensional Data
Likes 218 Likes 218