LRE Map

Finding new ways through language resources

10000 results found.

Clear all filters

Resource Type

Production Status

Availability

Modality

Ressource Use

Language Type

Languages

Conference

Wiki40B-LM Written Corpus,

Language Type:

Multilingual

Languages:

Arabic Bulgarian Catalan Croatian Czech Danish Dutch English Estonian Filipino Finnish French German Greek Hebrew Hindi Hungarian Indonesian Italian Japanese Korean Latvian Lithuanian Malay Norwegian Persian Polish Portuguese Romanian Russian Serbian Simplified Chinese Slovak Slovenian Spanish Swedish Thai Traditional Chinese Turkish Ukrainian Vietnamese

Availability:

Freely Available

License:

CC-BY-SA

LREC2020 Expand/Collapse

Size:

60 GByte

Production Status:

Newly created-in progress

Use:

Language Modelling

Paper title:
Wiki-40B: Multilingual Language Model Dataset
Paper track:
Written/oral presentation
Paper status:
Accept Oral

Author Number	Name	Affiliation	Country
Main Contact	Rami Al-Rfou	Wiki40B-LM	/N

Documentation:

None

OpenSubtitles2018

Written Corpus,

Language Type:

Monolingual

Languages:

Afrikaans Albanian Arabic Armenian Bangla Basque Bosnian Breton Bulgarian Catalan Croatian Czech Danish Dutch English Esperanto Estonian Filipino Finnish French Galician Georgian German Greek Hebrew Hindi Hungarian Icelandic Indonesian Italian Japanese Kazakh Korean Latvian Lithuanian Macedonian Malay Malayalam Norwegian Persian Polish Portuguese Romanian Russian Serbian Sinhala Slovak Slovenian Spanish Swedish Tamil Telugu Thai Turkish Ukrainian Urdu Vietnamese pt_br ze_en ze_zh zh_cn zh_tw

Availability:

Freely Available

License:

LREC2020 Expand/Collapse

Size:

22.10G tokens

Production Status:

Existing-used

Use:

Machine Translation, SpeechToSpeech Translation

Paper title:
word2word: A Collection of Bilingual Lexicons for 3,564 Language Pairs
Paper track:
Written/oral presentation
Paper status:
Accept Poster

Author Number	Name	Affiliation	Country
Main Contact	Yo Joong Choe	OpenSubtitles2018	/N
Main Contact	Yo Joong Choe	word2word	/N

Documentation:

Yes, on the website.

word2word

Written Lexicon,

Language Type:

Monolingual

Languages:

Availability:

Freely Available

License:

CreativeCommons Attribution 4.0 International

LREC2020 Expand/Collapse

Size:

41 GByte

Production Status:

Newly created-finished

Use:

Machine Translation, SpeechToSpeech Translation

Paper title:
word2word: A Collection of Bilingual Lexicons for 3,564 Language Pairs
Paper track:
Written/oral presentation
Paper status:
Accept Poster

Author Number	Name	Affiliation	Country
Main Contact	Yo Joong Choe	OpenSubtitles2018	/N
Main Contact	Yo Joong Choe	word2word	/N

Documentation:

Yes, on the website.

INEL Dolgan Corpus 1.0

Speech/Written Corpus,

Language Type:

Multilingual

Languages:

Dolgan English Russian

Availability:

Freely Available

License:

https://creativecommons.org/licenses/by-nc-sa/4.0/legalcode

LREC2020 Expand/Collapse

Size:

None

Production Status:

Newly created-finished

Use:

Corpus Creation/Annotation

Paper title:
Processing Language Resources of Under-Resourced and Endangered Languages for the Generation of Augmentative Alternative Communication Boards
Paper track:
Speech/oral presentation
Paper status:
Accept Poster+DemoSuggested

Author Number	Name	Affiliation	Country
Main Contact	Anne Ferger	INEL Dolgan Corpus 1.0	/N

Documentation:

https://corpora.uni-hamburg.de/hzsk/de/islandora/object/file:dolgan-1.0_INEL_Dolgan_Corpus_1.0_User_Documentation/datastream/PDF/INEL_Dolgan_Corpus.pdf

Czech Parliament

Speech Web Service,

Language Type:

Monolingual

Languages:

Czech

Availability:

Freely Available

License:

CreativeCommons

LREC2020 Expand/Collapse

Size:

444 hours

Production Status:

Newly created-in progress

Use:

Speech Recognition/Understanding

Paper title:
Large Corpus of Czech Parliament Plenary Hearings
Paper track:
Speech/oral presentation
Paper status:
Accept Poster

Author Number	Name	Affiliation	Country
Main Contact	Jonas Kratochvil	Czech Parliament	/N

Documentation:

Yes, in Czech language.

pwnalign

Written Evaluation Data,

Language Type:

Monolingual

Languages:

English

Availability:

Freely Available

License:

CreativeCommons

LREC2020 Expand/Collapse

Size:

Production Status:

Newly created-finished

Use:

Evaluation/Validation

Paper title:
Aligning Wikipedia with WordNet:a Review and Evaluation of Different Techniques
Paper track:
Written/oral presentation
Paper status:
Accept Poster

Author Number	Name	Affiliation	Country
Main Contact	Antoni Oliver	pwnalign	/N

Documentation:

None

DBS-eval

Written Corpus,

Language Type:

Monolingual

Languages:

German

Availability:

Freely Available

License:

Creative Commons Attribution 4.0 International (CC BY 4.0)

LREC2020 Expand/Collapse

Size:

26 MByte

Production Status:

Newly created-finished

Use:

Summarisation

Paper title:
Language Agnostic Automatic Summarization Evaluation
Paper track:
Evaluation/poster presentation
Paper status:
Accept Poster

Author Number	Name	Affiliation	Country
Main Contact	Christopher Tauchmann	DBS-eval	/N

Documentation:

Yes, documentation in English is publicly available

CHEMPROT

Written Evaluation Data,

Language Type:

Monolingual

Languages:

English

Availability:

Freely Available

License:

COLING2020 Expand/Collapse

Size:

48223 examples Other

Production Status:

Existing-used

Use:

Evaluation/Validation

Paper title:
CharacterBERT: Reconciling ELMo and BERT for Word-Level Open-Vocabulary Representations From Characters
Paper track:
Long paper/
Paper status:
Accept Poster

Author Number	Name	Affiliation	Country
Main Contact	Hicham El Boukkouri	MIMIC-III	/N
Main Contact	Hicham El Boukkouri	PubMed abstracts	/N
Main Contact	Hicham El Boukkouri	English Wikipedia	/N
Main Contact	Hicham El Boukkouri	OpenWebText	/N
Main Contact	Hicham El Boukkouri	i2b2/VA 2010	/N
Main Contact	Hicham El Boukkouri	MEDNLI	/N
Main Contact	Hicham El Boukkouri	CHEMPROT	/N
Main Contact	Hicham El Boukkouri	DDI	/N
Main Contact	Hicham El Boukkouri	ClinicalSTS	/N
Main Contact	Hicham El Boukkouri	CharacterBERT	/N
Main Contact	Hicham El Boukkouri	BERT (base, uncased)	/N
Main Contact	Hicham El Boukkouri	BlueBERT	/N

Documentation:

None

MEDNLI

Written Evaluation Data,

Language Type:

Monolingual

Languages:

English

Availability:

License:

COLING2020 Expand/Collapse

Size:

14049 examples Other

Production Status:

Existing-used

Use:

Evaluation/Validation

Paper title:
CharacterBERT: Reconciling ELMo and BERT for Word-Level Open-Vocabulary Representations From Characters
Paper track:
Long paper/
Paper status:
Accept Poster

Author Number	Name	Affiliation	Country
Main Contact	Hicham El Boukkouri	MIMIC-III	/N
Main Contact	Hicham El Boukkouri	PubMed abstracts	/N
Main Contact	Hicham El Boukkouri	English Wikipedia	/N
Main Contact	Hicham El Boukkouri	OpenWebText	/N
Main Contact	Hicham El Boukkouri	i2b2/VA 2010	/N
Main Contact	Hicham El Boukkouri	MEDNLI	/N
Main Contact	Hicham El Boukkouri	CHEMPROT	/N
Main Contact	Hicham El Boukkouri	DDI	/N
Main Contact	Hicham El Boukkouri	ClinicalSTS	/N
Main Contact	Hicham El Boukkouri	CharacterBERT	/N
Main Contact	Hicham El Boukkouri	BERT (base, uncased)	/N
Main Contact	Hicham El Boukkouri	BlueBERT	/N

Documentation:

None

i2b2/VA 2010

Written Evaluation Data,

Language Type:

Monolingual

Languages:

English

Availability:

License:

COLING2020 Expand/Collapse

Size:

76350 examples Other

Production Status:

Existing-used

Use:

Evaluation/Validation

Paper title:
CharacterBERT: Reconciling ELMo and BERT for Word-Level Open-Vocabulary Representations From Characters
Paper track:
Long paper/
Paper status:
Accept Poster

Author Number	Name	Affiliation	Country
Main Contact	Hicham El Boukkouri	MIMIC-III	/N
Main Contact	Hicham El Boukkouri	PubMed abstracts	/N
Main Contact	Hicham El Boukkouri	English Wikipedia	/N
Main Contact	Hicham El Boukkouri	OpenWebText	/N
Main Contact	Hicham El Boukkouri	i2b2/VA 2010	/N
Main Contact	Hicham El Boukkouri	MEDNLI	/N
Main Contact	Hicham El Boukkouri	CHEMPROT	/N
Main Contact	Hicham El Boukkouri	DDI	/N
Main Contact	Hicham El Boukkouri	ClinicalSTS	/N
Main Contact	Hicham El Boukkouri	CharacterBERT	/N
Main Contact	Hicham El Boukkouri	BERT (base, uncased)	/N
Main Contact	Hicham El Boukkouri	BlueBERT	/N

Documentation:

None

Previous | Next

LRE Map

Resource-Dataset

Resource-Tool

Resource-Guidelines

Evaluation

Other

4REAL

ACL

ACLHT

AREA

AsianLang

BioTxtM

BR-LRE

BUCC

CCURL

CIDTD

CMLC-2

CMLC-6

CNL

COLING

EMNLP

ES3LOD

FNP

Games4NLP

GLOBALEX

IJCNLP

IndustryTrack

Interspeech

IS

isa-10

ISINLP2

LB-IRL

LDL

LiNCR

LRE-Rel2

LREC

LRT4HDA

LTC

MMC

MomenT

MTE

MultilingualBIO

NAACL

O-COCOSDA

OCOCOSDA18

OSACT

OSACT3

ParlaCLARIN

RANLP

SaLTMiL

SignLanguage

SPLET

TA-COS

The International Conference on Language Resources and Evaluation

WILDRE