Easy-to-use and high-performance NLP and LLM framework based on MindSpore, compatible with models and datasets of 🤗Huggingface.

An open source NLP library based on MindSpore

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

Library for clinical NLP with spaCy.

💫 Industrial-strength Natural Language Processing (NLP) in Python

Taiwanese Hokkien Transliterator and Tokeniser

Taiwanese Hokkien Transliterator and Tokeniser

xtool is a very small set of Java tools

A curated list of resources dedicated to Python libraries, LLMs, dictionaries, and corpora of NLP for Japanese

Code to run the ExtRA algorithm for unsupervised topic/aspect extraction on English texts.

🦄 Unitxt: a python library for getting data fired up and set for training and evaluation

The Libre Multilingual Analyzer, a Natural Language Processing (NLP) C++ toolkit.

Thai Natural Language Processing in Python.

Instruction/chat prompts creation library for text generation LLMs. It supports local and Hugging Face models.

✍ 🗣 A Text-To-Conversation natural language processing toolkit [WIP].

A Japanese Tokenizer for Business

Self-contained Japanese Morphological Analyzer written in pure Go

A sentence splitting (sentence boundary disambiguation) library for Go. It is rule-based and works out-of-the-box.

DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models.   🤖💤

This repository provides a comprehensive guide to natural language processing. Whether you're a beginner looking to gain a solid understanding of the field or an experienced practitioner looking to expand your skills, this repository has something for everyone. With step-by-step tutorials and detailed explanations,