Rule of Thumb in Transfer Learning
In this lesson, we will discuss some of the important points to note while using transfer learning.
Points to consider
There might be a variety of questions in your mind such as:
- When do you fine-tune?
- How do you fine-tune?
- How do you decide what type of transfer learning you should perform on a new dataset?
The answer to the above questions depends on two factors: the size of the new dataset and its similarity to the original dataset on which your pre-trained model was trained. We have listed four common rules that you should keep in mind while performing transfer learning strategies. These are: