ERNIE

Language model tuner

A toolkit for fine-tuning pre-trained language models with knowledge graph representations to improve performance on entity typing and relation classification tasks.

Source code and dataset for ACL 2019 paper "ERNIE: Enhanced Language Representation with Informative Entities"

GitHub

1k stars
28 watching
267 forks
Language: Python
last commit: 11 months ago

Related projects:

Repository Description Stars
google-research/flan A repository providing tools and datasets to fine-tune language models for specific tasks 1,474
leks-forever/nllb-tuning This is an experimental project for fine-tuning the NLB language model with a specific dataset and evaluating its performance on translation tasks. 7
ieit-yuan/yuan2.0-m32 A high-performance language model designed to excel in tasks like natural language understanding, mathematical computation, and code generation 180
autonomio/talos A tool for automating hyperparameter experiments for machine learning models using TensorFlow and Keras 1,625
ys-zong/vlguard Improves safety and helpfulness of large language models by fine-tuning them using safety-critical tasks 45
accenture/ampligraph A Python library for training models on knowledge graphs to predict links between concepts 2,154
thunlp/thulac-python An efficient Chinese lexical analyzer with morphological analysis capabilities 2,023
turkunlp/wikibert Provides pre-trained language models derived from Wikipedia texts for natural language processing tasks 34
zhuiyitechnology/gau-alpha An implementation of a Gated Attention Unit-based Transformer model for natural language processing tasks 96
openai/finetune-transformer-lm This project provides code and model for improving language understanding through generative pre-training using a transformer-based architecture. 2,160
thunlp/openclap A repository of pre-trained language models for natural language processing tasks in Chinese 979
rodrigo-arenas/sklearn-genetic-opt Automated hyperparameter tuning and feature selection using evolutionary algorithms. 314
hit-scir/elmoformanylangs Provides pre-trained ELMo representations for multiple languages to improve NLP tasks. 1,463
jalammar/ecco An interactive visualization library for exploring and understanding transformer-based language models 1,985
jmrichardson/tuneta Automates optimization of technical indicators for machine learning models in finance 413