We explore the impact of the training corpus on contextualized word embeddings in five mid-resource languages.
We explore the impact of the training data size on a French version of RoBERTa.
We introduce the first treebank for a romanized user-generated content variety of Algerian, a North-African Arabic dialect.
Nous explorons l'impact de la taille et de l'hétérogénéité des données d'entraînement sur la modélisation de la langue française.
We explore convert the NER annotations of the French TreeBank to a more user-friendly format and establish a new state of the art for French NER.
We investigate the impact of different types and size of training corpora on language models.
We explore the impact of the OCR quality on grobid-dictionaries models.
We propose a new pipeline to filter, clean and classify Common Crawl by language, we publish the final corpus under the name OSCAR.