Search

Start Over Contributor Grantová agentura České republiky@@GX20-16819X@@LUSyD – Language Understanding: from Syntax to Discourse@@nationalFunds@@ Contributor Mellon Foundation, Brandeis University@@G-1901-06505@@Transatlantic Collaboration between LAPPS Grid and CLARIN: Implementation of NLP-enabled Tools using Text Archives as a Use Case@@Other@@ Language Czech Rights http://creativecommons.org/licenses/by-nc-sa/4.0/

1. RobeCzech Base

Creator:
Straka, Milan, Náplava, Jakub, Straková, Jana, and Samuel, David
Publisher:
Charles University, Faculty of Mathematics and Physics, Institute of Formal and Applied Linguistics (UFAL)
Type:
text, mlmodel, and languageDescription
Subject:
Czech, BERT, and RoBERTa
Language:
Czech
Description:
RobeCzech is a monolingual RoBERTa language representation model trained on Czech data. RoBERTa is a robustly optimized Transformer-based pretraining approach. We show that RobeCzech considerably outperforms equally-sized multilingual and Czech-trained contextualized language representation models, surpasses current state of the art in all five evaluated NLP tasks and reaches state-of-theart results in four of them. The RobeCzech model is released publicly at https://hdl.handle.net/11234/1-3691 and https://huggingface.co/ufal/robeczech-base, both for PyTorch and TensorFlow.
Rights:
Creative Commons - Attribution-NonCommercial-ShareAlike 4.0 International (CC BY-NC-SA 4.0), http://creativecommons.org/licenses/by-nc-sa/4.0/, and PUB

Limit your search