Quiz: Fine-Tuning BERT Models

Test yourself on the concepts you learned this chapter.

1

A BERT model has 24 attention heads with dmodeld_{model} = 768. What will the dimension of each dimension head be?

A)

32

B)

64

C)

16

D)

128

Question 1 of 50 attempted

Get hands-on with 1200+ tech skills courses.