GitLab

* f...ine pep8 changes

* refactor tokenization, use collocations by default.

* trying to refactor sensibly

* return standard cases for each word, disambiguate for bigrams

* add simple smoke tests for the no-collocations path

* Added more words to list of stopwords

* Modified list of stopwords

* Modified list of stopwords- more restricted set included

* starting on bigrams example

* slight cleanup, seems to work well.

Copy STOPWORDS and add to it, then pass it (instead of passing None).

use setuptools, add install_requires

Let process_text() return a dict.

allow a custom regexp

Add recipe for building the package with conda

Use a set for the (lowercase) stopwords, instead of looking up every word via linear search

lower-case stopwords before using them.

fix handling of scale parameter & python 3 compatibility for cli

Add a command line interface

Update font API & merge upper and lower case words when stemming

Has the advantage of producing fewer checks, as most words will be multiples.