We currently provide pretraining and finetuning scripts for ALBERT and BERT. ELECTRA is in progress.
Please visit each model's subdirectory for more info! Or see [commands.py] for some preset configurations.
This repository was archived by the owner on May 29, 2025. It is now read-only.