Search⌘ K

AI Features

Introduction to Big Data and Hadoop

1.Hadoop

Introduction Rise of Big Data Types of Big Data Big Data Defined Big Data vs Data Warehouse

2.YARN

Introduction Workflow Scheduling

3.Map Reduce

Basics Mapper Testing Mapper Mapper Input Reducer Testing Reducer Testing MapReduce Program Running MapReduce End to End Exploring MapReduce Runs Combiner and Partitioner Putting it Together Resiliency

4.HDFS

Filesystem The Big Picture Disk Blocks & HDFS Blocks Block Replication Namenode Datanode Writing and Reading High Availability HDFS in Practice HDFS in Practice II Distcp

5.Spark

Introduction Architecture Spark Application Life Cycle Spark API Resilient Distributed Datasets (RDDs)DataFrames Datasets An Example Running Spark Applications Anatomy of a Spark Application Execution of a Spark Application

6.Input & Output Formats

Sequence File: Intro Sequence File: Reading & Writing SerDe Rows vs Columnar Databases Avro: Intro Avro: Code Generation Avro: IDL & RPC Parquet: Intro Parquet: Definition Level Parquet: Repetition Level Parquet: Reading & Writing Parquet: Projection Schema & Misc. Tools

7.Misc

Zookeeper: Intro Zookeeper: Example Zookeeper: Practical Pig: Overview Summary

8.Quiz

Quiz 1 Quiz 2 Quiz 3 Quiz 4 Quiz 5 Quiz 6

9.Reference: Replication

Introduction Single Leader Replication Asynchronous VS Synchronous Replication Followers in Log Replication Log Replication Issues in Single Leader Replication Multi Leader Replication Issues in Multi Leader Replication Multi-Leader Topologies Leaderless Replication R + W > N Quorum Variations Concurrent Writes Video Streaming Queue a Concurrent Writes Example

10.Reference: Partitioning

Introduction Partitioning Schemes Secondary Indexes Number of Partitions

11.Reference: Transactions

Introduction to Transactions More On Transactions Isolation Levels Read Skew and Snapshot Isolation Concurrent Writes and Lost Updates Write Skew Serializability Two Phase Locking Serializable Snapshot Isolation

12.Reference: Issues in Distributed Systems

Introduction Network Agreeing On Time Working with Time issues

Mock Interview

Big Data Fundamentals

Introduction to Big Data and Hadoop

Quiz 4

We'll cover the following...

...