Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

deep-learning pytorch lora language-model adaptation roberta low-rank gpt-2 gpt-3 deberta

• Updated Dec 17, 2024
• Python

Pre-Training with Whole Word Masking for Chinese BERT（中文BERT-wwm系列模型）

nlp tensorflow pytorch bert rbt roberta chinese-bert bert-wwm bert-wwm-ext roberta-wwm

• Updated Apr 19, 2026
• Python

BertViz: Visualize Attention in Transformer Models

visualization nlp machine-learning natural-language-processing neural-network transformers pytorch transformer bert roberta gpt2

• Updated Jan 8, 2026
• Python

Awesome Pretrained Chinese NLP Models，高质量中文预训练模型&大模型&多模态模型&大语言模型集合

nlp dataset chinese gpt pretrained-models pangu bert multimodel roberta gpt-2 ernie xlnet nezha nlu-nlg simbert large-language-models llm

• Updated Aug 30, 2026
• Python

中文语言理解测评基准 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard

benchmark tensorflow nlu glue corpus transformers pytorch dataset chinese pretrained-models language-model albert bert roberta chineseglue

• Updated Feb 6, 2026
• Python

A LITE BERT FOR SELF-SUPERVISED LEARNING OF LANGUAGE REPRESENTATIONS, 海量中文预训练ALBERT模型

tensorflow pytorch albert bert pre-trained chinese-corpus roberta pre-trained-model xlnet

• Updated Nov 21, 2022
• Python

Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo

natural-language-processing model-zoo pytorch classification bart chinese gpt pegasus ner clue albert bert fine-tuning roberta elmo pre-training gpt-2 t5 unilm xlm-roberta

• Updated May 9, 2024
• Python

Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)

nlp rust machine-learning translation deep-learning sentiment-analysis transformer rust-lang question-answering bart gpt ner bert language-generation electra roberta gpt-2

• Updated Jan 13, 2026
• Rust

RoBERTa中文预训练模型: RoBERTa for Chinese

chinese bert pre-trained roberta gpt2 pre-trained-language-models

• Updated Jul 22, 2024
• Python

news-please - an integrated web crawler and information extractor for news that just works

python nlp elasticsearch json crawler news extractor extract-information data-gathering news-articles news-crawler news-extractor news-websites commoncrawl news-scraper news-archive extract-articles roberta ccnews cc-news

• Updated Apr 14, 2026
• Python

The implementation of DeBERTa

deeplearning representation-learning language-model bert natural-language-understanding self-attention roberta transformer-encoder

• Updated Sep 29, 2023
• Python

🏡 Fast & easy transfer learning for NLP. Harvesting language models for the industry. Focus on Question Answering.

nlp deep-learning pytorch question-answering transfer-learning pretrained-models language-models ner nlp-library bert nlp-framework roberta xlnet-pytorch germanbert

• Updated Dec 20, 2023
• Python

a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.

nlp gpu decoder machine-translation inference pytorch transformer albert bert roberta gpt2 huggingface-transformers

• Updated Jul 18, 2025
• C++

CLUENER2020 中文细粒度命名实体识别 Fine Grained Named Entity Recognition

dataset named-entity-recognition chinese seq2seq sequence-to-sequence ner albert bert sequence-labeling chinese-ner roberta fine-grained-ner chinesener

• Updated Nov 21, 2022
• Python

pytorch实现 Bert 做seq2seq任务，使用unilm方案,现在也可以做自动摘要，文本分类，情感分析，NER，词性标注等任务,支持t5模型，支持GPT2进行文章续写。

text-classification crf pytorch seq2seq ner bert roberta gpt2 unilm t5-model autotitle

• Updated Jun 18, 2022
• Python

Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo

natural-language-processing model-zoo pytorch classification bart chinese gpt pegasus ner clue albert bert fine-tuning roberta elmo pre-training gpt-2 t5 unilm xlm-roberta

• Updated Aug 4, 2024
• Python

Large-scale Pre-training Corpus for Chinese 100G 中文预训练语料

nlp corpus chinese datasets albert bert chinese-corpus roberta pretrain

• Updated Feb 6, 2026

Official implementation of the papers "GECToR – Grammatical Error Correction: Tag, Not Rewrite" (BEA-20) and "Text Simplification by Tagging" (BEA-21)

nlp natural-language-processing transformers bert sequence-labeling text-simplification grammatical-error-correction roberta xlnet

• Updated May 21, 2024
• Python

🤖 A PyTorch library of curated Transformer models and their composable components

nlp transformers pytorch falcon transformer llama albert bert roberta camembert xlm-roberta llm llms dolly2 gptneox

• Updated Apr 17, 2024
• Python

PhoBERT: Pre-trained language models for Vietnamese (EMNLP-2020 Findings)

deep-learning vietnamese transformers python3 named-entity-recognition language-models ner natural-language-inference bert pos-tagging vietnamese-nlp nli fairseq vncorenlp roberta bert-embeddings rdrsegmenter part-of-speech-tagging transformers-library phobert

• Updated Aug 4, 2026