Guide to Building Python and LLM-Based Multimodal Chatbots

Explore this AI chatbots course to build Python-based multimodal chatbots with Gradio, Rasa, Gemini, and Whisper v3. Learn LLM-powered techniques, RAG integration, and deploy on Hugging Face.

15 Lessons

Updated 4 months ago

Join 2.9 million developers at

LEARNING OBJECTIVES

Deep understanding of core concepts of chatbot development, including how chatbots work, their different types, and the essential elements of conversational design
Familiarity with the Rasa Open Source framework for building ML-powered chatbots
The ability to incorporate small language models (SLMs) into chatbots with Ollama
Hands-on experience with Groq for accessing Llama 3 for text, Gemini for image processing, and Whisper v3 for accurate speech recognition
The ability to use retrieval-augmented generation (RAG) with LlamaIndex to enhance chatbot knowledge and responses
The ability to deploy chatbots to Hugging Face for accessibility and sharing

Learning Roadmap

15 Lessons3 Quizzes

Getting Started

Get an overview of how AI chatbots have evolved and the tools used for building them, including Python and LLMs.

Why AI Chatbots Are Transforming Industries?

Foundations of AI Chatbots

Learn about the evolution, anatomy, and frameworks for developing AI chatbots, including using Rasa with Python.

What Are Chatbots—The Basics of Conversational AI

Types of Chatbots: Rule-Based, Pattern-Matching, and GenAI

Anatomy of a Chatbot: How They Work

Building Chatbots with Rasa and Python

Building a Generative AI-Powered Chatbot

5 Lessons

Build AI chatbots powered by advanced generative AI, integrating multimodal capabilities for real-world applications.

Enhancing Chatbots with Advanced Capabilities

4 Lessons

Explore retrieval-augmented generation (RAG) to improve chatbot responses and deploy your chatbots for wider accessibility.

Conclusion

Summarize key learnings and explore the future of building AI chatbots with multimodal and generative AI techniques.

Future of AI Chatbots

Certificate of Completion

Showcase your accomplishment by sharing your certificate of completion.

Developed by MAANG Engineers

Every Educative lesson is designed by a team of ex-MAANG software engineers and PhD computer science educators, and developed in consultation with developers and data scientists working at Meta, Google, and more. Our mission is to get you hands-on with the necessary skills to stay ahead in a constantly changing industry. No video, no fluff. Just interactive, project-based learning with personalized feedback that adapts to your goals and experience.

ABOUT THIS COURSE

This hands-on course will transform how you build AI chatbots. Generative AI and large language models (LLMs) have revolutionized chatbot development, enabling smarter and more interactive systems. In this AI chatbots course, you’ll explore the evolution of chatbots and create your own, starting with a simple Python chatbot enhanced with Gradio for a seamless interface. Next, dive into the Rasa Open Source framework to understand pre-generative AI chatbot development. Progress to LLM-powered chatbots with Ollama’s small language models (SLMs) and Meta’s Llama for text-based responses. Integrate multimodal capabilities, like image processing with Gemini and speech recognition, using Whisper v3. Master techniques like retrieval-augmented generation (RAG) with LlamaIndex to improve responses and deploy your chatbot on Hugging Face for accessibility. Whether you’re a developer or AI enthusiast, this course equips you to build cutting-edge AI chatbots.

Trusted by 2.9 million developers working at companies

These are high-quality courses. Trust me the price is worth it for the content quality. Educative came at the right time in my career. I'm understanding topics better than with any book or online video tutorial I've done. Truly made for developers. Thanks

Anthony Walker

@_webarchitect_

Just finished my first full #ML course: Machine learning for Software Engineers from Educative, Inc. ... Highly recommend!

Evan Dunbar

ML Engineer

You guys are the gold standard of crash-courses... Narrow enough that it doesn't need years of study or a full blown book to get the gist, but broad enough that an afternoon of Googling doesn't cut it.

Software Developer

Carlos Matias La Borde

I spend my days and nights on Educative. It is indispensable. It is such a unique and reader-friendly site

Souvik Kundu

Front-end Developer

Your courses are simply awesome, the depth they go into and the breadth of coverage is so good that I don't have to refer to 10 different websites looking for interview topics and content.

Vinay Krishnaiah

Software Developer