Model Downloads

The following models have been made available by the BLURB team.

Microsoft Research BiomedBERT (abstracts only)

This is the primary model proposed and evaluated in our publication. To generate this model, we extended the pretraining of a BERT Base model over a collection of PubMed abstracts, which improves the model’s ability to generalize to a wide range of biomedical natural language tasks.

Reference:
🤗 BiomedBERT (abstracts only)

Microsoft Research BiomedBERT (abstracts + full text)

This model was proposed and evaluated in Section 6.4 of our publication. It is an uncased BERT Base model that was pretrained over PubMed abstracts and full PubMed Central articles. At the time of release, this model achieves state-of-the-art performance for our BLURB Score.

Reference:
🤗 BiomedBERT (abstracts + full text)