Skip to content

Commit 745bc5f

Browse files
committed
Mention 21k ViT weights in README.md
1 parent 6306aa7 commit 745bc5f

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

README.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -5,6 +5,8 @@
55
### Jan 25, 2021
66
* Add ResNetV2 Big Transfer (BiT) models w/ ImageNet-1k and 21k weights from https://github.com/google-research/big_transfer
77
* Add official R50+ViT-B/16 hybrid models + weights from https://github.com/google-research/vision_transformer
8+
* ImageNet-21k ViT weights are added w/ model defs and representation layer (pre logits) support
9+
* NOTE: ImageNet-21k classifier heads were zero'd in original weights, they are only useful for transfer learning
810
* Add model defs and weights for DeiT Vision Transformer models from https://github.com/facebookresearch/deit
911
* Refactor dataset classes into ImageDataset/IterableImageDataset + dataset specific parser classes
1012
* Add Tensorflow-Datasets (TFDS) wrapper to allow use of TFDS image classification sets with train script

0 commit comments

Comments
 (0)