Abstract
A Slovak masked language model called SlovakBERT achieves state-of-the-art results across various NLP tasks and sets a benchmark for Slovak language models.
Generated by Qwen/Qwen2.5-Coder-32B-Instruct
We introduce a new Slovak masked language model called SlovakBERT. This is to our best knowledge the first paper discussing Slovak transformers-based language models. We evaluate our model on several NLP tasks and achieve state-of-the-art results. This evaluation is likewise the first attempt to establish a benchmark for Slovak language models. We publish the masked language model, as well as the fine-tuned models for part-of-speech tagging, sentiment analysis and semantic textual similarity.
Get this paper in your agent:
hf papers read 2109.15254 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 4
Fill-Mask • 0.1B • Updated • 304 • 26
kinit/slovakbert-sentiment-twitter
Text Classification • Updated • 83 • 5
Datasets citing this paper 0
No dataset linking this paper
Cite arxiv.org/abs/2109.15254 in a dataset README.md to link it from this page.
Spaces citing this paper 3
Collections including this paper 0
No Collection including this paper
Add this paper to a collection to link it from this page.