Mini Map
Search
⌘ K
Log In
Learn Data Science with Bash Shell
0%
1.
Course Introduction
Introduction
What is Bash?
2.
Project 1: Analyzing the 'US News' University Ranking Data
Unirank: Data Preview (head, pipe and csvlook)
Find the colleges in the ranklist (grep, pipe and wc)
Finding the percent of colleges in the ranklist (wc, grep)
Listing the Institutes from a given state (grep)
Finding the number of Institutes from each state
Finding the correlation between university tuition and ranks
Project demonstration
Project Summary
Test your skills
3.
Project 2: Facebook Data Mining
FB: Data Preview (csvstat, csvcut, head, cat)
Finding the number of status entry (csvcut, sort, uniq)
Find the most popular status entry (awk, sort, cat, csvcut, head)
Finding the most popular entry (Bash function)
Project demonstration
Project Summary
Test your skills
4.
Project 3: Australian Cities Crime Statistics
AU Crime Stats: Introduction
Data Preview
Row and Columns Statistics (sed, wc, head, cat)
Finding the top most crime in the whole country (sort, tail, awk)
Finding the top most crime per city (csvcut, sort, tail, awk)
Finding the best city in Australia! (Bash Shell Script)
Prject demonstration
Project Summary
Test your skills
5.
Project 4: Shakespearean-era plays and poems data mining
Plays and Poems: Data Preview (cat, cut, head and csvlook)
Counting the Plays and Poems (head, sed, grep, wc)
Finding plays/poems by each author (sed, sort, uniq, head)
Finding the most frequent words by Shakespeare
Project Summary
6.
Bash Tutorials
Hello! Bash
Bash variables and functions
Bash command execution and passing arguments
Bash meta characters
Bash quotation basics
Bash read and store user input
Bash redirections
Bash conditional statements
Bash `loop` statements
Bash arithmetic
Bash arrays
7.
REGEX Tutorials
Hello! RegEx
Basic Regular Expressions (BRE)
Extended Regular Expressions (ERE)
REGEX character classes
REGEX look arounds
REGEX atomic groups `(?>)`
How to use REGEX in Bash shell scripting?
8.
AWK Tutorials
Hello! AWK
AWK Built-in Variables
AWK built-in functions
AWK useful examples
9.
SED, GREP and Find Tutorials
Hello! SED - Stream Editor
SED substitutions
SED and regular expressions
SED delete, print and grouping
Hello! GREP
Hello! Find command
10.
Beyond the Text Files! Enter into the Big Data Landscape - Concepts
HDFS - Hadoop Distributed File System
Map Reduce
YARN - Yet Another Resource Negotiator!
Flume
SQOOP
Hive
Pig
Spark
HBase
Big Data file formats
11.
Conclusion
Conclusion and References
Home
Courses
Learn Data Science with Bash Shell
Bash command execution and passing arguments
We'll cover the following...
Inside bash scripts, you can run any command or call
...