Working with Files in Hadoop HDFS

Apache Hadoop    |    Beginner
  • 8 videos | 47m 17s
  • Includes Assessment
  • Earns a Badge
Rating 4.5 of 20 users Rating 4.5 of 20 users (20)
In this Skillsoft Aspire course, learners will encounter basic Hadoop file system operations such as viewing the contents of directories and creating new ones. This 8-video course assumes good understanding of what Hadoop is, and how HDFS enables processing of big data in parallel by distributing large data sets across a cluster; learners should also be familiar with running commands from the Linux shell, with some fluency in basic Linux file system commands. Begin by working with files in various ways, including transferring files between a local file system and HDFS (Hadoop Distributed File System) and explore ways to create and delete files on HDFS. Then examine different ways to modify files on HDFS. After exploring the distributed computing concept, prepare to begin working with HDFS in a production setting. In the closing exercise, write a command to create a directory/data/products/files on HDFS, for which data/products may not exist; list two commands for two copy operations-one from local file system to HDFS, and another for reverse transfer, from HDFS to local host.

WHAT YOU WILL LEARN

  • Identify the different ways to use the ls and mkdir commands to explore and create directories on hdfs
    Transfer files from your local file system to hdfs using the copyfromlocal command
    Copy files from your local file system to hdfs using the put command
    Transfer files from hdfs to your local file system using the copytolocal command
  • Use the get and getmerge functions to retrieve one or multiple files from hdfs
    Work with the appendtofile and rm commands on the hdfs dfs shell
    Utilize hdfs commands to work with and manipulate files using the hdfs shell

IN THIS COURSE

  • 2m 13s
  • 9m 8s
    In this video, you will learn how to identify the different ways to use the ls and mkdir commands to explore and create directories on the Hadoop Distributed File System. FREE ACCESS
  • Locked
    3.  Using the copyFromLocal Command in HDFS
    6m 47s
    In this video, learn how to transfer files from your local file system to HDFS using the copyFromLocal command. FREE ACCESS
  • Locked
    4.  Using the put Command in HDFS
    4m
    In this video, learn how to copy files from your local file system to HDFS using the put command. FREE ACCESS
  • Locked
    5.  Using the copyToLocal Command in HDFS
    4m 57s
    In this video, you will learn how to transfer files from your local file system to HDFS using the copyFromLocal command. FREE ACCESS
  • Locked
    6.  Retrieving files from HDFS
    6m 29s
    During this video, you will learn how to use the get and getmerge functions to retrieve one or multiple files from HDFS. FREE ACCESS
  • Locked
    7.  Append and Delete Operations in HDFS
    8m 58s
    In this video, you will learn how to work with the appendToFile and rm commands on the hdfs dfs shell. FREE ACCESS
  • Locked
    8.  Exercise: Working with Files on HDFS
    4m 45s
    In this video, you will learn how to use HDFS commands to work with and manipulate files using the HDFS shell. FREE ACCESS

EARN A DIGITAL BADGE WHEN YOU COMPLETE THIS COURSE

Skillsoft is providing you the opportunity to earn a digital badge upon successful completion on some of our courses, which can be shared on any social network or business platform.

Digital badges are yours to keep, forever.

YOU MIGHT ALSO LIKE

Book Big Data Using Hadoop and Hive
Course Hadoop HDFS File Permissions
Rating 4.3 of 14 users Rating 4.3 of 14 users (14)
Channel Apache Hadoop

PEOPLE WHO VIEWED THIS ALSO VIEWED THESE

Course Apache Spark Getting Started
Rating 4.5 of 137 users Rating 4.5 of 137 users (137)
Course Fundamentals & Installation
Rating 4.3 of 97 users Rating 4.3 of 97 users (97)
Course Hadoop Design Principles
Rating 5.0 of 2 users Rating 5.0 of 2 users (2)