Working with Files in Hadoop HDFS

Apache Hadoop 2.9    |    Beginner
  • 8 Videos | 50m 17s
  • Includes Assessment
  • Earns a Badge
Likes 22 Likes 22
In this Skillsoft Aspire course, learners will encounter basic Hadoop file system operations such as viewing the contents of directories and creating new ones. This 8-video course assumes good understanding of what Hadoop is, and how HDFS enables processing of big data in parallel by distributing large data sets across a cluster; learners should also be familiar with running commands from the Linux shell, with some fluency in basic Linux file system commands. Begin by working with files in various ways, including transferring files between a local file system and HDFS (Hadoop Distributed File System) and explore ways to create and delete files on HDFS. Then examine different ways to modify files on HDFS. After exploring the distributed computing concept, prepare to begin working with HDFS in a production setting. In the closing exercise, write a command to create a directory/data/products/files on HDFS, for which data/products may not exist; list two commands for two copy operations—one from local file system to HDFS, and another for reverse transfer, from HDFS to local host.

WHAT YOU WILL LEARN

  • identify the different ways to use the ls and mkdir commands to explore and create directories on HDFS
    transfer files from your local file system to HDFS using the copyFromLocal command
    copy files from your local file system to HDFS using the put command
    transfer files from HDFS to your local file system using the copyToLocal command
  • use the get and getmerge functions to retrieve one or multiple files from HDFS
    work with the appendToFile and rm commands on the hdfs dfs shell
    utilize HDFS commands to work with and manipulate files using the HDFS shell

IN THIS COURSE

  • Playable
    1. 
    Course Overview
    2m 13s
    UP NEXT
  • Playable
    2. 
    Basic Directory Commands in HDFS
    9m 8s
  • Locked
    3. 
    Using the copyFromLocal Command in HDFS
    6m 47s
  • Locked
    4. 
    Using the put Command in HDFS
    4m
  • Locked
    5. 
    Using the copyToLocal Command in HDFS
    4m 57s
  • Locked
    6. 
    Retrieving files from HDFS
    6m 29s
  • Locked
    7. 
    Append and Delete Operations in HDFS
    8m 58s
  • Locked
    8. 
    Exercise: Working with Files on HDFS
    4m 45s

EARN A DIGITAL BADGE WHEN YOU COMPLETE THIS COURSE

Skillsoft is providing you the opportunity to earn a digital badge upon successful completion of this course, which can be shared on any social network or business platform

Digital badges are yours to keep, forever.

PEOPLE WHO VIEWED THIS ALSO VIEWED THESE

COURSE Introduction
Likes 38 Likes 38  
Likes 193 Likes 193  
Likes 35 Likes 35