The Overall score is calculated as the macro-average performance over tasks. Details can be found within our publication.

Show 10255075100All entries

Rank	Model	BLURB Score (Macro Avg.)	Micro Avg.	NER	PICO	RE	SS	Class.	QA
1	BioLinkBERT-Large — Stanford	84.30	84.80	86.89	74.19	82.74	93.63	84.88	83.50
2	BioM-ALBERT-xxlarge-PMC — University of Delaware	84.10	84.41	85.30	73.48	83.14	94.44	83.06	85.20
3	BioM-ELECTRA-Large — University of Delaware	83.81	84.67	86.88	73.67	83.17	91.09	84.03	84.00
4	BioM-BERT-PMC-Large — University of Delaware	83.63	84.24	85.70	73.87	83.27	91.04	83.91	84.00
5	BioLinkBERT-Base — Stanford	83.39	83.84	86.39	73.97	81.56	93.27	84.35	80.81
6	BioM-ALBERT-xxlarge — University of Delaware	82.97	83.71	85.25	73.51	82.69	89.97	82.40	83.99
7	MSR BiomedBERT-LARGE (fine-tuning stabilization; uncased; abstracts) — Microsoft Research	82.91	83.58	86.28	73.61	81.77	92.73	82.70	80.37
8	MSR BiomedBERT (fine-tuning stabilization; uncased; abstracts) — Microsoft Research	82.75	83.24	86.17	73.45	81.53	94.49	83.02	77.86
9	BioELECTRA-Base — Saama Research	82.60	83.19	86.67	74.13	81.44	92.76	84.20	76.38
10	BioM-ELECTRA-Base — University of Delaware	82.46	83.25	86.18	74.23	82.19	89.67	84.14	78.37
11	MSR BiomedBERT (uncased; abstracts + full text) — Microsoft Research	81.50	82.18	86.13	73.72	80.59	92.31	82.62	73.61
12	MSR BiomedBERT (uncased; abstracts) — Microsoft Research	81.16	81.95	86.08	73.38	81.19	92.30	82.32	71.70
13	BioBERT (cased)	80.34	81.31	85.81	73.18	79.79	89.52	81.54	72.19
14	Scibert (uncased)	78.86	80.16	85.43	73.12	79.56	86.25	80.66	68.12
15	Scibert (cased)	78.14	79.38	85.47	73.06	79.19	87.15	81.16	62.81
16	ClinicalBERT (cased)	77.29	77.87	83.99	72.06	76.91	91.23	80.74	58.79
17	RoBERTa (cased)	76.46	77.74	83.09	73.02	77.71	81.25	79.66	64.02
18	BlueBERT (cased)	76.27	77.42	84.50	72.54	76.13	85.38	80.48	58.57
19	BERT base (uncased)	76.11	77.27	82.99	72.34	77.44	82.68	80.20	60.99
20	BERT base (cased)	75.86	77.13	82.90	71.70	76.83	81.40	80.12	62.20
21	Unicoder base (multilingual)	73.60	76.45	83.99	73.28	76.88	75.97	68.96	62.52

Showing 1 to 21 of 21 entries

Previous1Next