awesome-danish

Danish NLP dataset

A curated collection of Danish language resources and datasets for natural language processing tasks.

A curated list of awesome resources for Danish language technology

GitHub

168 stars
16 watching
18 forks
last commit: almost 2 years ago
Linked from 2 awesome lists

awesomeawesome-listdanish

Awesome Danish / Data / Corpora

Danish GigawordCollection of 10^12 words of Danish text. Described in ( )
Danish review dataset2almost 3 years agoTrustpilot-crawled dataset by Alessandro Gianfelici with 44,085 reviews
OSCARDanish corpus derived from the Common Crawl corpus. Described in ( )

Awesome Danish / Data / Corpora / CLARIN-DK-UCPH

The Danish Parliament Corpus 2009 - 2017, v1. The license is Creative Commons - Attribution 4.0 International
Grundtvig's Works Corpus. Not for commercial use as the license is Creative Commons - Attribution-NonCommercial 4.0 International
DK-CLARIN Reference Corpus of General DanishOnly for academic use

Awesome Danish / Data / Corpora

DanFEVERDanish text corpus with over 6'400 claims and support. Described in ( )
DanNetwordnet with usage examples. The usage examples have been used for word sense disambiguation, see
SemDaX1almost 4 years agoPOS-tagged (only adjectives, nouns and verbs), super sense tagged and BIO-tagged sentences. For educational, teaching or research purposes only
NOMCO"an annotated multimodal collection of conversational Danish". Apparently not directly available for download. [ ]
Danish Propbankcommercial resource with 87,000 tokens annotated with morphosyntactic, VerbNet classes and semantic roles
Danish Dependency Treebank v. 1.0Matthias Trautner Kromann et al.'s dependency annotation of some texts from PAROLE
Mr. Bean corpusSmall Danish-Italian corpus with written and spoken retelling (of Mr Bean episodes) and argumentative text (about smoking). Possibly described in
Køge CorpusDanish-Turkish transcribed corpus by Jens Normann Jørgensen
Danske talerCollection of Danish speeches. API available at
DKhatecorpus of 3600 hate speech from Twitter and Reddits as well as news comments. Described in ( )
ScholiaDaNewsroom - Danish summarization dataset. Probably to appear in 2020. Described in ( )

Awesome Danish / Data / Corpora / Wikipedia

wiki40b/daClean-up text from Danish Wikipedia. Described in . ( )

Awesome Danish / Data / Corpora

XED56over 3 years agoemotion annotated movie subtitles. Described in ( )
DaN+5over 3 years agoannotated for nested named entities on top of the entire Danish Universal Dependencies (UD_Danish-DDT) and 3 new web domains and includes lexical normalization. Described in
WikiANNNamed entity annotated corpus. Described in ( )
Corona Dataset11over 6 years agoQuestion dataset from Certainly annotated for domain and intent

Awesome Danish / Data / Parallel corpora

Europarlparallel sentences between Danish and English from the European Parlament
ITU Faroese Pairs DatasetFaroese-Danish parallel text. Described in ( )
JW300"a parallel corpus of over 300 languages with around 100 thousand parallel sentences per language pair on average"
OpenSubtitles2018Parallel corpus from movie and tv subtitles. Described in
TatoebaSentences
WikiMatrix3,604over 2 years ago, parallel sentences from Wikipedias. 1620 language pairs, including Danish

Awesome Danish / Data / Spoken language corpora

CoRalDanish Conversational and Read-aloud Dataset
DanPASSDescribed in ( )
LANCHARTCentre for Language Change In Real Time. Various audio recordings. Whether the data is available is not immediately apparent. Described in, e.g., ( )
Common VoiceCrowdsourced multilingual annotated speech dataset. As of March 2023, 11 hours of validated speech are distributed. Sentences can be entered collaboratively at . Common Voice is described in ( )
FT SpeechDescribed in ( )

Awesome Danish / Data / Spoken language corpora / NST

NST-speech-22khzA 22kHz speech corpus compiled by Nordisk Språkteknologi and made available by the Norwegian Library Service. The speech genre is dictation
NST-speech-16kHzA 16kHz speech corpus compiled by Nordisk Språkteknologi and made available by the Norwegian Library Service. The speech genre is read-aloud and the text is phonetically balanced. Designed for ASR training and testing
NST-speech-44kHzA 44kHz speech corpus compiled by Nordisk Språkteknologi and made available by the Norwegian Library Service. Designed for speech synthesis

Awesome Danish / Data / Spoken language corpora

VoxLingua10728 hours audio with unannotated Danish speech sampled from YouTube videos. Described in ( )
VoxPopuli517over 3 years agoSpeech from the European Parliament including 13'600 hours of unannotated Danish. Described in ( )
Wikimedia Commons Audio files of Danish languageRecordings of readings of articles from the Danish Wikipedia, Danish words and a few Danish literary works

Awesome Danish / Data / Dictionaries and ontologies

Det Centrale Ordregisteridentifier for words and their inflections with 516,017 forms (COR)
The Danish Sentiment Lexicon8over 3 years agoDet Danske Sentimentleksikon (DDS) 13,859 headwords assigned with polarity values
NST-lexical-databaseA pronunciation dictionary compiled by Nordisk Språkteknologi and made available by the Norwegian Library Service
DanNet, Danish Wordnet (v 2.2) - owl formatDanNet - Danish wordnet with three-clause BSD-like license
Retskrivningsordbogen. The official Danish spelling dictionary digitally available under its own special license

Awesome Danish / Data / Dictionaries and ontologies / Retskrivningsordbogen

Opslagsord og ordklasserin CSV format
ExcerptLexemes, word classes and inflections. in the CSF format available. Full list presumably available upon request

Awesome Danish / Data / Dictionaries and ontologies

Stavekontroldenword list with 160,132 Danish words. Used, e.g., for spelling suggestion in LibreOffice. Licensed under GPL, LPGL, and MPL
The Concise Danish Dictionary/The Comprehensive Danish Dictionary/Den Store Danske Ordliste (DSDO), word list created by Skåne Sjælland Linux User Group and distributed under a GPL license
Interactive Terminology for Europe(IATE) - European Union terminology database. October 2020 version contains over 500,000 Danish terms
The Danish FrameNet Lexicon, 40,267 lines resource containing 5,300 verbs and 6,490 verbal nouns
1,290,000 lexemesWikidata lexemes - structured database with metadata about lexemes, their forms and their sense. Over including in April 2024

Awesome Danish / Data / Dictionaries and ontologies / 1,290,000 lexemes

Overview over Danish lexemes in Ordiawebapp with overview of content of Wikidata lexemes based on SPARQL queries
Wikidata lexemes latest lexemes dump in ttlofficial dump of lexeme-only part of Wikidata

Awesome Danish / Data / Dictionaries and ontologies

NST-ngramsA N-gram frequency list compiled by Nordisk Språkteknologi from newspaper text and made available by the Norwegian Library Service. Can be compiled to an n-gram LM with SRILM
AFINN453over 4 years agoDanish lexicons annotated for sentiment
concreteness-estimates-da0over 8 years agoBill D. Thompson's concreteness estimates for Danish words, as detailed in ( )
SAM lexicon7over 6 years agosentiment analysis word list extended from AFINN to 4275 lines. Described in
Danish Swadesh ListList of Danish words of basic concepts from The Rosetta Project
Sketch Enginecloud service with wordlists, thesearus, collocations, n-grams etc. Free for academic use in the European Union and paid service for commercial use

Awesome Danish / Data / Word sets

Danish-Similarity-Dataset8over 6 years agoSimilarity scores for 99 Danish word pairs by Nina Schneidermann and Bolette Sandford Pedersen. Also available in
Wordsim353-da18almost 6 years agoDanish translation by Finn Årup Nielsen of the English Wordsim353 English word pair set. Also available in
Clinical similarity dataset0over 3 years ago289 word pairs score for similarity
Four words18almost 6 years ago100 odd-one-out sets of 4 words or phrases

Awesome Danish / Data / Embeddings

cc.da.300( ) - fastText-trained embedding on Danish part of and Danish Wikipedia. Read more about the method in ( )
wiki.da( ) - fastText-trained embedding on Danish Wikipedia. Read more about the method in ( )
Byte-Pair Encoding embedding1,189almost 2 years agoGensim-based subword embedding. A large number of Danish embeddings are available. They differ in the size of the vocabulary (from 1000 to 200000) and subspace dimensions (from 25 to 300)
NLPL word embeddings repositoryNLPL word embeddings repository by Language Technology Group at the University of Oslo. Two Danish embedding models as of November 2020

Awesome Danish / Data / Embeddings / NLPL word embeddings repository

Danish NLPL word embedding100-dimensional word2vec skipgram model trained by Andrey Kutuzov based on the Danish CoNLL17 corpus

Awesome Danish / Data / Embeddings

Danish DSL and Reddit word2vec word embeddings300-dimensional CBOW word2vec word embedding by Emil Middelboe and Anders Lillie trained on Danish DSL corpus and Reddit

Awesome Danish / Data / Neural text models

A-ttack6over 3 years agoÆlæctra-based model for detection of "textual attacks" developed by . Related to the Ha-te model
Danish BERT164almost 5 years agoCertainly's (Botxo/Møllerhøj) Weights for a BERT trained on a large Danish corpora
Danish ELECTRA30about 5 years agoPhilip Tamimi-Sarnikowski's Danish ELECTRA model. Available in the transformer library
daT5-summariserDanish abstractive summarisation of news articles based on mT5-base
ConvBERT30about 5 years agoPhilip Tamimi-Sarnikowski's model
Danish ELMo on OSCAR(Link does not work as of December 2020)
Ha-te6over 4 years agoHate speech detection based on Ælæctra developed by . Related to the A-ttack model
mfaqMultilingual FAQ retrieval model. Described in ( )
ÆlæctraMalte Højmark-Bertelsen's Danish Gigaword-trained Electra-based model
Multilingual sentence transformersPre-trained multilingual sentence transformers,
wiki40b-lm-dalanguage model trained on Danish from Wiki40B dataset
WikiBERT34over 6 years agoBERT model for many languages, including Danish. Described in ( )

Awesome Danish / Data / Neural speech models

Hugging FaceList of models for Danish automatic speech recognition
Alvenir Wav2vec2Pretrained Danish neural model
WhisperMultilingual neural model from OpenAI
xls-r-300m-danish-nst-cv9Pretrained Danish neural model

Awesome Danish / Tools / Lemmatization

Lemmy76almost 5 years agoLemmatizer for Danish in Python
cstlemma36about 2 years agolemmatiser
spaCyPython-based package with lemmatization

Awesome Danish / Tools / Punctuation

punctfix23over 2 years ago"Adds punctuation and capitalization for a given text."

Awesome Danish / Tools / Named entity recognition

ScandiNERScandinavian named entity recognition, achieving state-of-the-art performance in Danish, Norwegian (both Bokmål and Nynorsk), Swedish, Icelandic and Faroese
DaLUKE9over 4 years agoDanish named entity recognition based on LUKE. Described in
spaCyPython-based named entity extraction
daner17about 7 years agoNamed entity extraction from ITU NLP. Described in ( )
flair+danlp ner-tagger199over 2 years agoFlair NER tagger trained by the Alexandra Institute
Polyglot named entity extraction-

Awesome Danish / Tools / Entity linking

BabelfyWeb app and service for linking words and entities
DBpedia SpotlightDBpedia-based entity linker. Described in ( )

Awesome Danish / Tools / Sentiment analysis

afinn453over 4 years agoPython package with AFINN Danish lexicon annotated for sentiment, also installable with
Hisia13over 2 years agoPython package with pre-trained machine-learning based Danish sentiment analysis by Prayson Wilfred Daniel
senda19over 5 years agoPython package with transformer-based sentiment analysis from Ekstra Bladet Analyse with as of 2021 on one dataset
Sentida20almost 5 years agoR package With Danish sentiment lexicon and handling of, e.g., negation. Detailed in ( )

Awesome Danish / Tools / Automatic Speech Recognition

danspeech29over 3 years agoDeepSpeech2-based Danish speech recognition in Python
kaldi-sprakbanken14,362almost 2 years agoA recipe for training state-of-the-art(2017) speech recogniser for Danish based on the 16kHz NST database

Awesome Danish / Tools / Speech Synthesis (text-to-speech)

espeakAn open-source speech synthesis program for ~56 languages including Danish. eSpeak can also be used as a grapheme-to-phoneme converter and was used to create the Danish Kaldi recipe
ResponsiveVoiceCommercial Web-based (Javascript-based) text-to-speech synthesis for a number of languages, including Danish. The commercial service is currently free for limited and non-commercial use
Google Cloud Text-to-SpeechCommercial Web-based text-to-speech synthesis for a number of languages, including Danish
Amazon PollyCommercial Web-based text-to-speech synthesis for a number of languages, including Danish. Part of Amazon's commercial AWS services. Female and male voices are available as examples. Limited unregistered free service available at

Awesome Danish / Tools / Fundamental processing

DaNLP199over 2 years ago"a repository for Natural Language Processing resources for the Danish Language."
dapipe7over 8 years agoDanish UD-pipe: tokenisation, lemmatisation, PoS tagging, morphology, dependencies
UDPipeNon-language specific version of dapipe. Newer version of the Danish-DDT model than that which is offered by dapipe is available at
DKIEGATE pipeline including wrapped Danish models for Stanford CoreNLP
StanfordNLP. Python software package for dependency parsing, including tokenization, lemmatization and part-of-speech tagging. A pre-trained model for Danish is available
bornholmsk2over 4 years agoDatasets and embeddings for the Bornholmsk dialect
spaCyPython-based natural language processing package
dacy93almost 2 years agoDanish spaCy pipeline

Awesome Danish / Competitions

ELEXIS Monolingual Word Sense Alignment TaskPredicting the relationship between two senses in each of several languages, including Danish
OffensEval 2020 - DanishOffensive Language Identification in Social Media competition. Described in ( )

Awesome Danish / Benchmarks

DanoliterateOverview of the performance of language models on a range of individual benchmarks
ScandEvalOverview of the performance of language models on a range of individual benchmark, Danish as well as other Germanic languages

Awesome Danish / Resources about resources

Danish resourcesFinn Årup Nielsen's PDF with pointers to Danish resources
Scholia's topic aspect for Danish, works (mostly scientific articles) about "Danish" as listed in Wikidata
DaNLP199over 2 years agoAlexandra Institute's list of Danish resources
Language Technology Resources for Danish, list from Det Dansk Sprog- og Litteraturselskab
European Language Resources Association (ELRA) list for Danish, list of various annotated corpora available for purchase with both commercial and non-commercial licenses
sprogteknologi.dkList of Danish language resources. Compiled by the Agency for Digitisation

Backlinks from these awesome lists:

More related projects: