HomeCoursesGuide to Building Python and LLM-Based Multimodal Chatbots

Beginner

Updated 2 months ago

Guide to Building Python and LLM-Based Multimodal Chatbots
Save

Explore this AI chatbots course to build Python-based multimodal chatbots with Gradio, Rasa, Gemini, and Whisper v3. Learn LLM-powered techniques, RAG integration, and deploy on Hugging Face.

Join 2.7 million developers at

Overview

Content

Reviews

This hands-on course will transform how you build AI chatbots. Generative AI and large language models (LLMs) have revolutionized chatbot development, enabling smarter and more interactive systems. In this AI chatbots course, you’ll explore the evolution of chatbots and create your own, starting with a simple Python chatbot enhanced with Gradio for a seamless interface. Next, dive into the Rasa Open Source framework to understand pre-generative AI chatbot development. Progress to LLM-powered chatbots with Ollama’s small language models (SLMs) and Meta’s Llama for text-based responses. Integrate multimodal capabilities, like image processing with Gemini and speech recognition, using Whisper v3. Master techniques like retrieval-augmented generation (RAG) with LlamaIndex to improve responses and deploy your chatbot on Hugging Face for accessibility. Whether you’re a developer or AI enthusiast, this course equips you to build cutting-edge AI chatbots.

This hands-on course will transform how you build AI chatbots. Generative AI and large language models (LLMs) have revolutionize...Show More

WHAT YOU'LL LEARN

Deep understanding of core concepts of chatbot development, including how chatbots work, their different types, and the essential elements of conversational design

Familiarity with the Rasa Open Source framework for building ML-powered chatbots

The ability to incorporate small language models (SLMs) into chatbots with Ollama

Hands-on experience with Groq for accessing Llama 3 for text, Gemini for image processing, and Whisper v3 for accurate speech recognition

The ability to use retrieval-augmented generation (RAG) with LlamaIndex to enhance chatbot knowledge and responses

The ability to deploy chatbots to Hugging Face for accessibility and sharing

Deep understanding of core concepts of chatbot development, including how chatbots work, their different types, and the essential elements of conversational design

TAKEAWAY SKILLS

Generative AI

Chatbot

Python

Gradio

Llama

Content

15 Lessons3 Quizzes

Getting Started

1 Lessons

Get an overview of how AI chatbots have evolved and the tools used for building them, including Python and LLMs.

Why AI Chatbots Are Transforming Industries?

Foundations of AI Chatbots

4 Lessons

Learn about the evolution, anatomy, and frameworks for developing AI chatbots, including using Rasa with Python.

What Are Chatbots—The Basics of Conversational AI

Types of Chatbots: Rule-Based, Pattern-Matching, and GenAI

Anatomy of a Chatbot: How They Work

Building Chatbots with Rasa and Python

Building a Generative AI-Powered Chatbot

5 Lessons

Build AI chatbots powered by advanced generative AI, integrating multimodal capabilities for real-world applications.

Building a Chatbot Using Small Language Model (SLM)

Accessing Large Language Models (LLMs) with Groq

Creating a Text-Based Chatbot with Meta’s Llama

Adding Image-to-Text Capabilities with Gemini

Integrating Speech-to-Text with Whisper v3

Speech Recognition With Whisper

Project

Enhancing Chatbots with Advanced Capabilities

4 Lessons

Explore retrieval-augmented generation (RAG) to improve chatbot responses and deploy your chatbots for wider accessibility.

Introduction to RAG with LlamaIndex

Integrating RAG with LlamaIndex for Smarter Chatbots

Deploying Our Chatbot to Hugging Face

Challenge: Creating a Quiz Bot

Build an LLM-powered Chatbot with RAG using LlamaIndex

Project

Conclusion

1 Lessons

Summarize key learnings and explore the future of building AI chatbots with multimodal and generative AI techniques.

Future of AI Chatbots

Certificate of Completion

Showcase your accomplishment by sharing your certificate of completion.

Developed by MAANG Engineers

Every Educative resource is designed by our in-house team of ex-MAANG software engineers and PhD computer science educators — subject matter experts who’ve shipped production code at scale and taught the theory behind it. The goal is to get you hands-on with the skills you need to stay ahead in today's constantly evolving tech landscape. No videos, no fluff — just interactive, project-based learning with personalized feedback that adapts to your goals and experience.

Trusted by 2.7 million developers working at companies

"These are high-quality courses. Trust me. I own around 10 and the price is worth it for the content quality. EducativeInc came at the right time in my career. I'm understanding topics better than with any book or online video tutorial I've done. Truly made for developers. Thanks"

Anthony Walker

@_webarchitect_

"Just finished my first full #ML course: Machine learning for Software Engineers from Educative, Inc. ... Highly recommend!"

Evan Dunbar

ML Engineer

"You guys are the gold standard of crash-courses... Narrow enough that it doesn't need years of study or a full blown book to get the gist, but broad enough that an afternoon of Googling doesn't cut it."

Software Developer

Carlos Matias La Borde

"I spend my days and nights on Educative. It is indispensable. It is such a unique and reader-friendly site"

Souvik Kundu

Front-end Developer

"Your courses are simply awesome, the depth they go into and the breadth of coverage is so good that I don't have to refer to 10 different websites looking for interview topics and content."

Vinay Krishnaiah

Software Developer

Hands-on Learning Powered by AI

See how Educative uses AI to make your learning more immersive than ever before.

Instant Code Feedback

Evaluate and debug your code with the click of a button. Get real-time feedback on test cases, including time and space complexity of your solutions.

AI Mock Interviews

Test your skills in a simulated interview setting. Receive personalized feedback based on your performance. Available for Coding Interviews, System Design, and more.

Adaptive Learning

At various checkpoints throughout Educative courses, you will be prompted to take a quick assessment. Receive a condensed curriculum tailored to your strengths and skill gaps.

Explain with AI

Select any text within any Educative course, and get an instant explanation — without ever leaving your browser.

AI Code Mentor

AI Code Mentor helps you quickly identify errors in your code, learn from your mistakes, and nudge you in the right direction — just like a 1:1 tutor!

Free Resources

FOR TEAMS

Interested in this course for your business or team?

Unlock this course (and 1,000+ more) for your entire org with DevPath

Guide to Building Python and LLM-Based Multimodal Chatbots Save

Guide to Building Python and LLM-Based Multimodal Chatbots
Save