The following models have been made available by the BLURB team.
This is the primary model proposed and evaluated in our publication.
To generate this model, we extended the pretraining of a BERT Base model over a collection of PubMed abstracts,
which improves the model's ability to generalize to a wide range of biomedical natural language tasks.
🤗 PubMedBERT (abstracts only)
🤗 PubMedBERT (abstracts + full text)