HomeCoursesDebugging, Disassembly & Reversing in Linux for x64 Architecture

Intermediate

16h

Debugging, Disassembly & Reversing in Linux for x64 Architecture

Gain insights into using GDB for debugging in Linux. Explore disassembly, memory investigation, and register updates. Learn about pointers, stack, and function parameters in x64 architecture.

Join 2.7 million developers at

Overview

Content

Reviews

GNU Debugger (GDB) is used for debugging C/C++ programs in LINUX/UNIX environments. It is a good tool to investigate what is happening inside a program, and how the contents inside the memory are changed with the execution of the program. The main focus of the course is the disassembly of the program, where we'll use simple operations in C. With the help of GDB, we'll examine the contents of the registers and memory. We'll also learn how they are changed while executing basic operations. We’ll then explore the use of pointers, stack, and function parameters, and analyze how different registers update their values. With the help of disassembly output, we’ll learn how a simple C program can be reconstructed. The disassembly output is important for debugging and core dump analysis. We’ll use assembly language for x64 architecture. By the end of this course, you should be able to debug the programs and memory contents at assembly level when a program executes or probe into the problem when a program crashes.

GNU Debugger (GDB) is used for debugging C/C++ programs in LINUX/UNIX environments. It is a good tool to investigate what is hap...Show More

WHAT YOU'LL LEARN

A familiarity with disassembly in GDB environment of simple C/C++ programs

A good understanding of how to debug programs with a cross-sectional view to the contents of registers, stack and memory

The ability to use GDB as a dump analysis tool

Hands-on experience with C/C++ programs from the disassembly output

A familiarity with disassembly in GDB environment of simple C/C++ programs

Content

43 Lessons5 Quizzes1 Assessment

Introduction to the Course

1 Lessons

Get familiar with GDB for debugging, disassembly, and program reconstruction in Linux.

Introduction

Memory, Registers, and Simple Arithmetic

5 Lessons

Grasp the fundamentals of memory, registers, arithmetic operations, and their representations in assembly language.

Comparison Between Memory and Registers

Assigning Numbers to Memory and Register

Adding Numbers to Memory Cells

Incrementing and Decrementing Numbers

Multiplying Numbers

Code Optimization

3 Lessons

Go hands-on with debugging and optimizing code using GDB to enhance performance.

GDB Disassembly Output—No Optimization

GDB Disassembly Output—Optimization

Quiz on Memory, Register, and Code Optimization

Number Representations

2 Lessons

Grasp the fundamentals of number systems, including decimal, ternary, binary, and hexadecimal.

Number System

Hexadecimal Number Representations

Pointers

6 Lessons

Solve problems in using pointers for memory manipulation, arithmetic, incrementation, and multiplication in programming.

Introduction to Pointers

Assigning Numbers to Memory Cells Using Pointers

Adding Numbers Using Pointers

Incrementing Numbers Using Pointers

Multiplying Numbers Using Pointers

Quiz on Number Representations and Pointers

Bytes, Words, Double, and Quad Words

2 Lessons

Investigate memory granularity and layout in x64 Linux, focusing on bytes to quadwords.

Granularity

Memory Layout

Pointers to Memory

3 Lessons

Practice using pointers, their types, initialization, and debugging in memory management.

Declaring Pointers for Different Addressing Types

Pointers Essential

Memory Pointers Project: Memory Layout

Logical Instructions and RIP

4 Lessons

Step through logical instructions, zeroing techniques, and the role of the Instruction Pointer.

Logical Instructions

Zeroing Memory or Registers

Instruction Pointer

Quiz on Granularity, Pointer to Memory, and Logical Instructions

Reconstructing a Program with Pointers

3 Lessons

Unpack the core of disassembling, reconstructing, and optimizing C/C++ code with pointers.

Disassembly Output Without Optimization

Reconstructing C/C++ Code

Disassembly Output in Code Optimization Mode

10.

Memory and Stacks

3 Lessons

Go hands-on with stacks in memory, function calls, and GDB debugging techniques.

Introduction to Stack

Stack in Memory and Registers

Exploring Stack in GDB

11.

Frame Pointer and Local Variables

4 Lessons

Break down the steps to understand stack functionality, function prolog/epilog, and local variables.

Stacks in Frame Pointers and Local Variables

Functions in Frame Pointers and Local Variables

Local Variables

Quiz on Memory, Stack, Frame Pointer, and Local Variables

12.

Function Parameters

2 Lessons

Solve problems in function parameter passing and stack memory analysis in x64 Linux systems.

Function and Stack

A Disassembly Project with Function and Stack

13.

More Instructions

2 Lessons

Simplify complex topics of CPU flags, conditional jumps, and assembly instructions.

Instructions I

Instructions II

14.

Function Pointer Parameters

2 Lessons

Practice using function pointers in projects, dissembling with GDB, and enhancing debugging skills.

Implementation of Project

Quiz on Function Parameters and Function Pointer Parameters

15.

Summary of Code Disassembly Patterns

1 Lessons

Break down key concepts in debugging, disassembly, and reversing for x64 Linux.

Summary of Code

x64 Debugging, Disassembly & Reversing Exam

Assessment

Certificate of Completion

Showcase your accomplishment by sharing your certificate of completion.

Course Author:

Dmitry Vostokov

Developed by MAANG Engineers

Every Educative resource is designed by our in-house team of ex-MAANG software engineers and PhD computer science educators — subject matter experts who’ve shipped production code at scale and taught the theory behind it. The goal is to get you hands-on with the skills you need to stay ahead in today's constantly evolving tech landscape. No videos, no fluff — just interactive, project-based learning with personalized feedback that adapts to your goals and experience.

Trusted by 2.7 million developers working at companies

"These are high-quality courses. Trust me. I own around 10 and the price is worth it for the content quality. EducativeInc came at the right time in my career. I'm understanding topics better than with any book or online video tutorial I've done. Truly made for developers. Thanks"

Anthony Walker

@_webarchitect_

"Just finished my first full #ML course: Machine learning for Software Engineers from Educative, Inc. ... Highly recommend!"

Evan Dunbar

ML Engineer

"You guys are the gold standard of crash-courses... Narrow enough that it doesn't need years of study or a full blown book to get the gist, but broad enough that an afternoon of Googling doesn't cut it."

Software Developer

Carlos Matias La Borde

"I spend my days and nights on Educative. It is indispensable. It is such a unique and reader-friendly site"

Souvik Kundu

Front-end Developer

"Your courses are simply awesome, the depth they go into and the breadth of coverage is so good that I don't have to refer to 10 different websites looking for interview topics and content."

Vinay Krishnaiah

Software Developer

Hands-on Learning Powered by AI

See how Educative uses AI to make your learning more immersive than ever before.

Personalized Interview Prep

Skip the LeetCode grind with a custom roadmap that adapts to your goals. Hands-on practice for Coding Interviews, System Design, and more.

Mock Interviews

Test your skills in a simulated interview setting. Receive personalized feedback based on your performance. Available for Coding Interviews, System Design, and more.

AI Prompt

Build prompt engineering skills. Practice implementing AI-informed solutions.

Code Feedback

Evaluate and debug your code with the click of a button. Get real-time feedback on test cases, including time and space complexity of your solutions.

Explain with AI

Select any text within any Educative course, and get an instant explanation — without ever leaving your browser.

AI Code Mentor

AI Code Mentor helps you quickly identify errors in your code, learn from your mistakes, and nudge you in the right direction — just like a 1:1 tutor!

Free Resources

FOR TEAMS

Interested in this course for your business or team?

Unlock this course (and 1,000+ more) for your entire org with DevPath