Table 6 Hyperparameters used for fine-tuning BioBERT
From: We are not ready yet: limitations of state-of-the-art disease named entity recognizers
Corpus | Batch size | Learning rate | # of epochs |
|---|---|---|---|
NCBI | 32 | 5e-5 | 7 |
BC5CDR | 32 | 3e-5 | 4 |
NCBI + BC5CDR | 32 | 5e-5 | 4 |
BioNL13-CG | 32 | 5e-5 | 3 |
miRNA-Disease | 32 | 5e-5 | 3 |