added the download instruction for the nltk tokenizer

6 years ago · d90d99dd97
1 changed files with 6 additions and 0 deletions
--- a/cross-reader.tfidf/README.md
+++ b/cross-reader.tfidf/README.md
@ -14,6 +14,12 @@

    $ pip3 install nltk

+You also need to download a nltk package for the tokenizer that is used, to split sentences up in lists of words.
+
+    $ python3
+
+    >>> import nltk
+    >>> nltk.download('punkt')

 ## Start