added two modes for simple_word_tokenize compact and full#7

hadikhamoud merged 1 commit into

mainU4RASD/dalla-data-processing:mainfrom

simplifying-word-tokenizeU4RASD/dalla-data-processing:simplifying-word-tokenizeCopy head branch name to clipboard