Instructions to use mnaylor/bigbird-base-mimic-mortality with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use mnaylor/bigbird-base-mimic-mortality with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-classification", model="mnaylor/bigbird-base-mimic-mortality")# Load model directly from transformers import AutoTokenizer, AutoModelForSequenceClassification tokenizer = AutoTokenizer.from_pretrained("mnaylor/bigbird-base-mimic-mortality") model = AutoModelForSequenceClassification.from_pretrained("mnaylor/bigbird-base-mimic-mortality", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Mitch Naylor commited on
Commit ·
eb2f5ed
1
Parent(s): 830f6b2
Update README.md
Browse files
README.md
CHANGED
|
@@ -1,8 +1,10 @@
|
|
| 1 |
# BigBird for Mortality Prediction
|
| 2 |
|
| 3 |
-
|
| 4 |
-
|
| 5 |
-
|
|
|
|
|
|
|
| 6 |
|
| 7 |
### References
|
| 8 |
* Van Aken, et al., 2021: [Clinical Outcome Prediction from Admission Notes using Self-Supervised Knowledge Integration](https://www.aclweb.org/anthology/2021.eacl-main.75/)
|
|
|
|
| 1 |
# BigBird for Mortality Prediction
|
| 2 |
|
| 3 |
+
Starting with Google's base BigBird model, we fine-tuned on binary mortality prediction in MIMIC admission notes. This
|
| 4 |
+
model seeks to predict whether a certain patient will expire within a given ICU stay, based on the text available upon
|
| 5 |
+
admission. Data prepared for this task as described in [this project](https://github.com/bvanaken/clinical-outcome-prediction),
|
| 6 |
+
using the simulated admission notes (taken from discharge summaries). This model will be used in an upcoming submission for
|
| 7 |
+
IMLH at ICML 2021.
|
| 8 |
|
| 9 |
### References
|
| 10 |
* Van Aken, et al., 2021: [Clinical Outcome Prediction from Admission Notes using Self-Supervised Knowledge Integration](https://www.aclweb.org/anthology/2021.eacl-main.75/)
|