Getting Started with Google BERT/

...

/

Quiz: Different BERT Variants

Quiz: Different BERT Variants

Take a short quiz to test your understanding of different BERT variants.

We'll cover the following...
Technical Quiz
1.

(Select all that apply.) Which options are used as the parameter reduction techniques in ALBERT?

A.

Cross-layer parameter sharing technique

B.

Factorized linear layer parameterization technique

C.

Factorized embedding layer parameterization technique

D.

Factorized softmax layer parameterization technique

1 / 7