Big Data Fundamentals - Introduction to Big Data and Hadoop

0% completed

All LessonsFree Lessons (7)

Hadoop

Introduction Rise of Big Data Types of Big Data Big Data Defined Big Data vs Data Warehouse

YARN

Introduction Workflow Scheduling

Map Reduce

Basics Mapper Testing Mapper Mapper Input Reducer Testing Reducer Testing MapReduce Program Running MapReduce End to End Exploring MapReduce Runs Combiner and Partitioner Putting it Together Resiliency

HDFS

Filesystem The Big Picture Disk Blocks & HDFS Blocks Block Replication Namenode Datanode Writing and Reading High Availability HDFS in Practice HDFS in Practice II Distcp

Spark

Spark Application Life Cycle

Resilient Distributed Datasets (RDDs)

Running Spark Applications

Anatomy of a Spark Application

Execution of a Spark Application

Input & Output Formats

Sequence File: Intro Sequence File: Reading & Writing SerDe Rows vs Columnar Databases Avro: Intro Avro: Code Generation Avro: IDL & RPC Parquet: Intro Parquet: Definition Level Parquet: Repetition Level Parquet: Reading & Writing Parquet: Projection Schema & Misc. Tools

Misc

Zookeeper: Intro Zookeeper: Example Zookeeper: Practical Pig: Overview Summary

Quiz

Quiz 1 Quiz 2 Quiz 3 Quiz 4 Quiz 5 Quiz 6

Reference: Replication

Introduction Single Leader Replication Asynchronous VS Synchronous Replication Followers in Log Replication Log Replication Issues in Single Leader Replication Multi Leader Replication Issues in Multi Leader Replication Multi-Leader Topologies Leaderless Replication R + W > N Quorum Variations Concurrent Writes Video Streaming Queue a Concurrent Writes Example

Reference: Partitioning

Introduction Partitioning Schemes Secondary Indexes Number of Partitions

Reference: Transactions

Introduction to Transactions More On Transactions Isolation Levels Read Skew and Snapshot Isolation Concurrent Writes and Lost Updates Write Skew Serializability Two Phase Locking Serializable Snapshot Isolation

Reference: Issues in Distributed Systems

Introduction Network Agreeing On Time Working with Time issues

Big Data Fundamentals