Hadoop HDFS File Permissions

Apache Hadoop 2.9    |    Intermediate
  • 9 Videos | 48m 34s
  • Includes Assessment
  • Earns a Badge
Likes 11 Likes 11
Explore reasons why not all users should have free reign over all data sets, when managing a data warehouse. In this 9-video Skillsoft Aspire course, learners explore how file permissions can be viewed and configured in HDFS (Hadoop File Management System) and how the NameNode UI is used to monitor and explore HDFS. For this course, you need a good understanding of Hadoop and HDFS, along with familiarity with the HDFS shells, and confidence in working with and manipulating files on HDFS, and exploring it from the command line. The course focuses on different ways to view permissions, which are linked to files and directories, and how these can be modified. Learners explore automating many tasks involving HDFS by simply scripting them, and to use HDFS NameNode UI to monitor the distributed file system, and explore its contents. Review distributed computing and big data. The closing exercise involves writing a command to be used on the HDFS dfs shell to count the number of files within a directory on HDFS, and to perform related tasks.

WHAT YOU WILL LEARN

  • count the number of files and view their sizes on HDFS using the count and du commands
    configure and view permissions for individual files and directories using the getfacl and chmod commands
    define and set permissions for the entire contents of a directory with the chmod command
    write a simple bash script
  • automate the transfer of all the files in a directory on your local file system over the HDFS with a shell script
    identify the data and metrics available on the HDFS NameNode UI and work with its file system explorer
    delete a Google Cloud Dataproc cluster and all of its associated resources
    work with file-permissioning in HDFS and recognize the data and metrics available in the NameNode UI

IN THIS COURSE

  • Playable
    1. 
    Course Overview
    2m 11s
    UP NEXT
  • Playable
    2. 
    The HDFS count and du Commands
    7m 42s
  • Locked
    3. 
    Viewing and Setting File Permissions in HDFS
    6m 54s
    FREE ACCESS
  • Locked
    4. 
    Applying Permissions Recursively in HDFS
    3m 52s
    FREE ACCESS
  • Locked
    5. 
    An Introduction to Bash Scripting
    7m 3s
    FREE ACCESS
  • Locked
    6. 
    Scripting HDFS Operations
    7m 19s
    FREE ACCESS
  • Locked
    7. 
    Exploring the HDFS NameNode UI
    6m 20s
    FREE ACCESS
  • Locked
    8. 
    Cleanup Operations in HDFS
    1m 44s
    FREE ACCESS
  • Locked
    9. 
    Exercise: File Permissions on HDFS
    5m 29s
    FREE ACCESS

EARN A DIGITAL BADGE WHEN YOU COMPLETE THIS COURSE

Skillsoft is providing you the opportunity to earn a digital badge upon successful completion of this course, which can be shared on any social network or business platform

Digital badges are yours to keep, forever.

YOU MIGHT ALSO LIKE

COURSE Hadoop & MapReduce Getting Started
Likes 34 Likes 34  
BOOK Big Data Using Hadoop and Hive
COURSE AWS Solutions Architect Associate 2022: Managing S3 Buckets

PEOPLE WHO VIEWED THIS ALSO VIEWED THESE

COURSE Developing a Basic MapReduce Hadoop Application
Likes 19 Likes 19  
COURSE DevOps with Ansible: Overview
Likes 107 Likes 107  
COURSE Hadoop HDFS Getting Started
Likes 40 Likes 40