Introduction to JAX and Deep Learning

0%

1.Introduction

Course Introduction JAX Overview

2.JAX Programming Model

Pure Functions JAX and NumPy Just-in-Time (JIT) Compilation JAX Expressions (Jaxpr)Asynchronous Dispatch Auto-differentiation Pytrees Quiz: Basics of JAX Challenge: Basics of JAX

3.Linear Algebra

Vectors Matrices More on Matrices Quiz - Vectors and Matrices Challenge: Vectors and Matrices Auto Vectorization Auto Parallelization Multivariate Calculus Quiz: Multivariate Calculus, Auto Vectorization/Parallelization Challenge II: Linear Regression Convolutions Two-dimensional Convolutions Transposed Convolutions Quiz: Convolution Challenge: Convolution

4.Random Variables and Distributions

Pseudo-Random Number Generation Continuous Probability Distributions Discrete Distributions Quiz: PRNG and Probability Distributions Challenge: PRNG and Probability Distribution Divergence Measures Introduction to Optimal Transport and OTT

5.JAX Ecosystem

Introduction to JAX Ecosystem Introduction to Flax and Linen Flax: Linear Modules Flax: Overview of Convolution and Sequence Models Quiz: Flax Challenge: Flax Haiku Introduction to Optax and Optimizers Optax: Advanced Features Challenge: Optax Jraph Chex Quiz: The JAX Ecosystem Conclusion

Mini Project

Project: GAN Using the JAX ecosystem

6.Appendix

Installation Awesome JAX Libraries Awesome JAX-based Models Vector Calculus - II Common Tracer Errors Glossary

Introduction to JAX and Deep Learning/

...

/

Quiz: The JAX Ecosystem

Quiz: The JAX Ecosystem

Let's test our knowledge about the JAX ecosystem.

We'll cover the following...

Technical Quiz

1.

Why do we use Haiku.transform()?

A.

To apply transformations

B.

To enable the object-oriented Haiku code to convert into pure functions

C.

To project the inputs into higher dimensions.

D.

None of the above.

1 / 5