Back To Module Home

Introduction to Big Data and Hadoop

0% completed

Hadoop

Introduction Rise of Big Data Types of Data Big Data Defined Big Data vs Data Warehouse

Yarn

Introduction Workflow Scheduling

Map Reduce

Basics Mapper Testing Mapper Mapper Input Reducer Testing Reducer Testing MapReduce Program Running MapReduce End to End Exploring MapReduce Runs Combiner and Partitioner Putting it Together Resiliency

HDFS

Filesystem The Big Picture Disk Blocks & HDFS Blocks Block Replication Namenode Datanode Writing and Reading High Availability HDFS in Practice HDFS in Practice II Distcp

Input & Output Formats

Sequence File: Intro Sequence File: Reading & Writing SerDe Rows vs Columnar Databases Avro: Intro Avro: Code Generation Avro: IDL & RPC Parquet: Intro Parquet: Definition Level Parquet: Repetition Level Parquet: Reading & Writing Parquet: Projection Schema & Misc. Tools

Misc

Zookeeper: Intro Zookeeper: Example Zookeeper: Practical Pig: Overview Summary

Quiz

Quiz 1 Quiz 2 Quiz 3 Quiz 4 Quiz 5 Quiz 6

Reference: Replication

Introduction Single Leader Replication Asynchronous VS Synchronous Replication Followers in Log Replication Log Replication Issues in Single Leader Replication Multi Leader Replication Issues in Multi Leader Replication Multi-Leader Topologies Leaderless Replication R + W > N Quorum Variations Concurrent Writes Video Streaming Queue a Concurrent Writes Example

Reference: Partitioning

Introduction Partitioning Schemes Secondary Indexes Number of Partitions

Conclusion

...

/

Final Remarks

Final Remarks

Here's a quick summary of the “Introduction to Big Data and Hadoop” module.

Congratulations! You have completed the “Introduction to Big Data and Hadoop” module.

Summary

In this module, we ...