À propos de moi

Je suis doctorant en informatique à Sorbonne Université et à l’équipe de recherche ALMAnaCH à Inria.

Je travaille principalement en machine learning, deep learning et traitement automatique du langage naturel.

J’aime le café, les cookies et la programmation.

Intérêts

  • Machine Learning
  • Deep Learning
  • Text Mining
  • NLP

Formation

  • Doctorat en Informatique

    Sorbonne Université

  • Licence MIASHS, 2018

    Université Paris 8

  • Master en Mathématiques, 2017

    Aix-Marseille Université

  • Licence en Mathématiques, 2016

    Universidad Nacional de Colombia

Publications en vedette

A Monolingual Approach to Contextualized Word Embeddings for Mid-Resource Languages

We explore the impact of the training corpus on contextualized word embeddings in five mid-resource languages.
Pedro Javier Ortiz Suárez, Laurent Romary, Benoît Sagot
PDF Jeu de données Projet ACL Anthology ACL 2020 HAL arXiv
A Monolingual Approach to Contextualized Word Embeddings for Mid-Resource Languages

CamemBERT: a Tasty French Language Model

We explore the impact of the training data size on a French version of RoBERTa.
Louis Martin(?), Benjamin Muller(?), Pedro Javier Ortiz Suárez(?), Yoann Dupont, Laurent Romary, Éric de la Clergerie, Djamé Seddah, Benoît Sagot
PDF Jeu de données Projet ACL Anthology arXiv Website ACL 2020 HAL
CamemBERT: a Tasty French Language Model

Asynchronous Pipeline for Processing Huge Corpora on Medium to Low Resource Infrastructures

We propose a new pipeline to filter, clean and classify Common Crawl by language, we publish the final corpus under the name OSCAR.
Pedro Javier Ortiz Suárez, Benoît Sagot, Laurent Romary
PDF Code Jeu de données Projet Diapositives DOI CMLC-7 Website HAL
Asynchronous Pipeline for Processing Huge Corpora on Medium to Low Resource Infrastructures

Publications récentes

A Monolingual Approach to Contextualized Word Embeddings for Mid-Resource Languages

We explore the impact of the training corpus on contextualized word embeddings in five mid-resource languages.
Pedro Javier Ortiz Suárez, Laurent Romary, Benoît Sagot
PDF Jeu de données Projet ACL Anthology ACL 2020 HAL arXiv
A Monolingual Approach to Contextualized Word Embeddings for Mid-Resource Languages

CamemBERT: a Tasty French Language Model

We explore the impact of the training data size on a French version of RoBERTa.
Louis Martin(?), Benjamin Muller(?), Pedro Javier Ortiz Suárez(?), Yoann Dupont, Laurent Romary, Éric de la Clergerie, Djamé Seddah, Benoît Sagot
PDF Jeu de données Projet ACL Anthology arXiv Website ACL 2020 HAL
CamemBERT: a Tasty French Language Model

Building a User-Generated Content North-African Arabizi Treebank: Tackling Hell

We introduce the first treebank for a romanized user-generated content variety of Algerian, a North-African Arabic dialect.
Djamé Seddah, Farah Essaidi, Amal Fethi, Matthieu Futeral, Benjamin Muller, Pedro Javier Ortiz Suárez, Benoît Sagot, Abhishek Srivastava
PDF ACL Anthology ACL 2020

Les modèles de langue contextuels Camembert pour le Français : impact de la taille et de l'hétérogénéité des données d'entrainement

Nous explorons l’impact de la taille et de l’hétérogénéité des données d’entraînement sur la modélisation de la langue française.
Louis Martin(?), Benjamin Muller(?), Pedro Javier Ortiz Suárez(?), Yoann Dupont, Laurent Romary, Éric de la Clergerie, Benoît Sagot, Djamé Seddah
PDF Jeu de données Projet TALN 2020 HAL Website
Les modèles de langue contextuels Camembert pour le Français : impact de la taille et de l'hétérogénéité des données d'entrainement

Establishing a New State-of-the-Art for French Named Entity Recognition

We explore convert the NER annotations of the French TreeBank to a more user-friendly format and establish a new state of the art for French NER.
Pedro Javier Ortiz Suárez, Yoann Dupont, Benjamin Muller, Laurent Romary, Benoît Sagot
PDF LREC 2020 HAL arXiv ACL Anthology
Establishing a New State-of-the-Art for French Named Entity Recognition

French Contextualized Word-Embeddings with a sip of CaBeRnet: a New French Balanced Reference Corpus

We investigate the impact of different types and size of training corpora on language models.
Murielle Popa-Fabre, Pedro Javier Ortiz Suárez, Benoît Sagot, Éric de la Clergerie
PDF CMLC-8 ACL Anthology HAL
French Contextualized Word-Embeddings with a sip of CaBeRnet: a New French Balanced Reference Corpus

How OCR Performance can Impact on the Automatic Extraction of Dictionary Content Structures

We explore the impact of the OCR quality on grobid-dictionaries models.
Mohamed Khemakhem, Ioana Galleron, Geoffrey Williams, Laurent Romary, Pedro Javier Ortiz Suárez
PDF Projet TEI 2019 HAL

Asynchronous Pipeline for Processing Huge Corpora on Medium to Low Resource Infrastructures

We propose a new pipeline to filter, clean and classify Common Crawl by language, we publish the final corpus under the name OSCAR.
Pedro Javier Ortiz Suárez, Benoît Sagot, Laurent Romary
PDF Code Jeu de données Projet Diapositives DOI CMLC-7 Website HAL
Asynchronous Pipeline for Processing Huge Corpora on Medium to Low Resource Infrastructures

Présentations récentes et à venir

Asynchronous Pipeline for Processing Huge Corpora on Medium to Low Resource Infrastructures

We propose a new pipeline to filter, clean and classify Common Crawl by language, we publish the final corpus under the name OSCAR.
Jul 22, 2019 9:30 AM — 10:00 AM Cardiff, UK
Pedro Javier Ortiz Suárez, Benoît Sagot, Laurent Romary
PDF Code Diapositives Follow

Preparing the Dictionnaire Universel for Automatic Enrichment

A talk about automatic enrichment of dictionaries.
Jun 13, 2019 11:00 AM — 11:30 AM Leeuwarden, Pays-Bas
Pedro Javier Ortiz Suárez, Laurent Romary, Benoît Sagot
Diapositives Follow

Projets

*
All Language Modeling Corpus Linguistics Digital Humanities

BASNUM

Digitization and analysis of Basnage de Beauval’s Universal Dictionary: lexicography and scientific networks

CamemBERT

A state-of-the-art language model for French.

OSCAR

OSCAR or Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus.

Contactez moi