Final Exam: Data Analyst
- 1 video | 32s
- Includes Assessment
- Earns a Badge
Final Exam: Data Analyst will test your knowledge and application of the topics presented throughout the Data Analyst track of the Skillsoft Aspire Data Analyst to Data Scientist Journey.
WHAT YOU WILL LEARN
list the six phases of the data lifecycleuse the ggplot2 library to visualize data using Rcreate vectors in Rcrawl data stored in a DynamoDB tablecompare and contrast SQL and NoSQL database solutionsstandardize a distribution to express its values as z-scores and use Pandas to generate a correlation and covariance matrix for your datasetspecify the configurations of the MapReduce applications in the Driver program and the project's pom.xml fileexplain the concept of hierarchical index or multi-index and why can be usefuluse the NumPy library to manipulate arrays and the Pandas library to load and analyze a datasetdelete a Google Cloud Dataproc cluster and all of its associated resourcesconfigure and view permissions for individual files and directories using the getfacl and chmod commandsrecall how Apache Zookeeper enables the HDFS NameNode and YARN ResourceManager to run in high-availability modeload data into a Redshift cluster from S3 bucketsdescribe the options available when iterating over 1-dimensional and multi-dimensional arraysrun the application and examine the outputs generated to get the word frequencies in the input text documentuse the get and getmerge functions to retrieve one or multiple files from HDFSexport the contents of a DataFrame into files of various formatsusing the independent t-test and with a related sample using a paired t-test using the SciPy libraryCreate data frames in Rcreate and configure simple graphs with lines and markers using the Matplotlib data visualization libraryconfigure HDFS using the hdfs-site.xml file and identify the properties which can be set from itwork with the YARN Cluster Manager and HDFS NameNode web applications that come packaged with Hadoopinstall Pandas and create a Pandas Seriesrecognize and deal with missing data in Rexport the contents of a DataFrame into files of various formatsuse NumPy to compute the correlation and covariance of two distributions and visualize their relationship with scatterplotsrecognize the challenges involved in processing big data and the options available to address them such as vertical and horizontal scalingcreate and configure a Hadoop cluster on the Google Cloud Platform using its Cloud Dataproc servicedefine the inter-quartile range of a dataset and enumerate its propertiesdraw the shape of a Gaussian distribution and enumerate its defining properties
execute the application and verify that the filtering has worked correctly; examine the job and the output files using the YARN Cluster Manager and HDFS NameNode web UIsset up a JDBC connection on Glue to the Redshift clusterimport and export data in Rdeploy DynamoDB in the Amazon Web Services cloudusing the mutate methodcreate matrices in Ridentify different tools available for data managementdescribe the ETL process and different tools availableinitialize a Spark DataFrame from the contents of an RDDconfigure a JDBC connection on Glue to the Redshift clusterdescribe NoSQL Stores and how they are usedcreate and load data into an RDDread data from an Excel spreadsheetrun ETL scripts using Glueuse fancy indexing with arrays using an index maskwrite a simple bash scriptidentify the various GCP services used by Dataproc when provisioning a clusterread data from files and write data to files using the Python Pandas librarydefine linear regressionedit individual cells and entire rows and columns in a Pandas DataFrameDefine the mean of a dataset and enumerate its propertiesretrieve specific parts of an array using row and column indicesrecall the steps involved in building a MapReduce application and the specific workings of the Map phase in processing each row of data in the input fileuse NumPy to compute statistics such as the mean and median on your datadescribe the concept of hierarchical index or multi-index and why can be usefuldefine the contents of a DataFrame using the SQLContextdescribe and apply the different techniques involved in handling datasets where some information is missinguse the dplyr library to load data framesbuild and run the application and confirm the output using HDFS from both the command line and the web applicationtransfer files from your local file system to HDFS using the copyFromLocal command
IN THIS COURSE
1.Data Analyst33sUP NEXT
EARN A DIGITAL BADGE WHEN YOU COMPLETE THIS COURSE
Skillsoft is providing you the opportunity to earn a digital badge upon successful completion on some of our courses, which can be shared on any social network or business platform.Digital badges are yours to keep, forever.