Word segmentation models

ISO 639 language codes

Linguistica 5: Unsupervised Learning of Linguistic Structure

Massively multilingual pronunciation mining

Cantonese Linguistics and NLP

Language Acquisition Research Tools

Automated testing for the examples in your documentation.

Rime Cantonese input schema | 粵語拼音輸入方案

A python port of the glmnet package for fitting generalized linear models via penalized maximum likelihood.

Spoken mandarin Chinese from Hong Kong.

Spoken Cantonese from Hong Kong.

Alphabetical list of free/public domain datasets with text data for use in Natural Language Processing (NLP)

Benchmarks of approximate nearest neighbor libraries in Python

Multilayer Feed-Forward Neural Network predictive model implementations with TensorFlow and scikit-learn

A pure-python PDF library capable of splitting, merging, cropping, and transforming the pages of PDF files

Community Curated NLP List

English data

A topic-centric list of HQ open datasets.

Repository for Frequency Word List Generator and processed files

Unsupervised learning of root-and-pattern morphology in Python

Resources for Instrumented Item-and-Pattern morphology

Python tools for linguistics research

Stand-alone language identification system

[Deprecated] New development at https://github.com/linguistica-uchicago/lxa5

NLTK Source