fixed-roberta-base / README.md
hamishivi's picture
Create README.md
08c6559
|
Raw History Blame Contribute Delete
195 Bytes

Fixed-roberta-base

roberta-base but with a resized embedding matrix and an extra dim in the token type embedding matrix for better sharding/partitioning.