Intro to some NLP concepts and libraries in Python for a class at CMU, Feb 2015.

Lots of libraries are required - see here for install info.

Notebook viewer links:

0. Reading in Files: How I made the data files, mostly Gutenberg operations. Add your own URLs!

1. Tokenizing, Stemming, POS - the very basics. POS is "parts of speech" not "piece of %#@t".

2. Wordclouds - entirely optional, but shows off interactive widgets to live-filter stopwords for visual effect

3. TF-IDF, Clustering, Pattern - getting to the meat! Hierarchical clustering here too.

Bonus: Doing some TF-IDF NLP in node's package "natural" (but caveats apply): see here

4. Naive Bayes Classification - the infamous 50 Shades Sex Scene Detection because spam is boring

5. Naive Bayes in Scikit-Learn - very quick intro to the main ML package in Python, for comparison purposes; same sex scene data.

There are some links to libraries and books in the [Intro NLP Links.md](Intro NLP Links.md)