wikibert

Language model library

Provides pre-trained language models derived from Wikipedia texts for natural language processing tasks

BERT models for many languages created from Wikipedia texts

GitHub

34 stars
12 watching
1 forks
last commit: over 6 years ago
Linked from 1 awesome list


Backlinks from these awesome lists:

Related projects:

RepositoryDescriptionStars
langboat/mengziDevelops lightweight yet powerful pre-trained models for natural language processing tasks533
dbmdz/bertsProvides pre-trained language models for natural language processing tasks155
certainlyio/nordic_bertProvides pre-trained BERT models for Nordic languages with limited training data.164
thunlp/openclapA repository of pre-trained language models for natural language processing tasks in Chinese977
zhuiyitechnology/wobertA Word-based Chinese BERT model trained on large-scale text data using pre-trained models as a foundation460
zhuiyitechnology/pretrained-modelsA collection of pre-trained language models for natural language processing tasks989
ethan-yt/guwenbertPre-trained language model for classical Chinese texts using RoBERTa architecture511
baai-wudao/modelA repository of pre-trained language models for various tasks and domains.121
apache/opennlp-modelsProvides pre-trained binary models for natural language text processing across multiple languages4
ncbi-nlp/bluebertPre-trained language models for biomedical natural language processing tasks560
kldarek/polbertA Polish BERT-based language model trained on various corpora for natural language processing tasks70
ibm-granite/granite-3.0-language-modelsA collection of lightweight state-of-the-art language models designed to support multilinguality, coding, and reasoning tasks on constrained resources.232
ymcui/macbertImproves pre-trained Chinese language models by incorporating a correction task to alleviate inconsistency issues with downstream tasks646
peleiden/dalukeA language model trained on Danish Wikipedia data for named entity recognition and masked language modeling9
nttcslab-nlp/doc_lmThis repository contains source files and training scripts for language models.12