Search⌘ K
AI Features
Home
Courses
Generative AI with Python and TensorFlow 2

Deep Neural Network Development and Tensorflow

Explore the foundations of deep neural network development focusing on the TensorFlow library. Understand its history, architectural improvements over previous frameworks, and how TensorFlow 2.0 with Keras facilitates flexible, scalable AI model building. Gain insight into TensorFlow's data flow graphs and the advantages of eager execution for dynamic model training.

We'll cover the following...

First, let’s start by diving more into the details of TensorFlow, the library we have used to develop models throughout the rest of this course. What problem does TensorFlow solve for neural network model development? What approaches does it use? How has it evolved over the years? To answer these questions, let’s review some of the history behind deep neural network libraries that led to the development of TensorFlow.

A deep neural network, in essence, consists of matrix operations (addition, subtraction, multiplication), nonlinear transformations, and gradient-based updates computed by using the derivatives of these components.

In the world of academia, researchers have historically often used efficient prototyping tools such as MATLABMATLAB, Natick, Massachusetts: The MathWorks Inc. https://www. mathworks.com/products/matlab.html to run models and prepare analyses. While this approach allows for rapid experimentation, it lacks elements of industrial software development, such as object-oriented (OO) development, that allow for reproducibility and clean software abstractions that allow tools to be adopted by large organizations.

These tools also had difficulty scaling to large datasets and could carry heavy licensing fees for such industrial use cases. However, prior to 2006, this type of computational tooling was largely sufficient for most use cases. However, as the datasets being tackled with deep neural network algorithms grew, groundbreaking results were achieved, such as:

  • Image classification on the ImageNet datasetKrizhevsky A., Sutskever I., & Hinton G E. ImageNet Classification with Deep Convolutional Neural Networks. https://papers.nips.cc/paper/4824- imagenet-classification-with-deepconvolutional-neural-networks.pdf.

  • Large-scale unsupervised discovery of image patterns in YouTube videosDean J., Ng A., (2012, Jun 26). Using large-scale brain simulations for machine learning and A.I.. Google | The Keyword. https://blog.google/technology/ ai/using-large-scale-brain-simulations-for/.

  • The creation of artificial agents capable of playing Atari video gamesMnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., Riedmiller, M. (2013). Playing Atari with Deep Reinforcement Learning. arXiv:1312.5602. https://arxiv.org/abs/1312.5602 and the Asian board game GO with human-like ...