NLTK practice with nltk book
- 1. What is the NLTK? How to use NLTK Hyunyoung Lee Natural Language Processing Labs
- 2. TABLE OF CONTENTS PRESENTATION Contents 1 How To Install Anaconda Contents 2 What is the NLTK Contents 3 How To Install NLTK Contents 4 Tutorial 1 of NLTK Contents 5 Tutorial 2 of NLTK 2
- 3. 1. How To Install Anaconda 3
- 4. How To Install Anaconda 4 click (Jupyter notebook) http://jupyter.org/install.html After Installing Anaconda, execute it !
- 5. How To Execute Jupyter Notebook in Anaconda 5 Type “Jupyter notebook” on Anaconda Prompt Do programming of Python3 on Jupyter notebook click Ctrl + Enter
- 6. 2. What is the NLTK 6
- 7. What is the NLTK? http://www.nltk.org/ 7 • NLTK is short for Natural Language Toolkit - NLTK is a leading platform for building Python programs to work with human language data
- 8. 3. How To Install NLTK 8
- 9. How To Install NLTK 9 If you install Anaconda, Anaconda has already NLTK. BUT, If you don’t use Anaconda, install NLTK separately. To install corpora and module of NLTK How to install NLTK http://www.nltk.org/install.html
- 10. 4. Tutorial 1 of NLTK 10
- 11. 4. Tutorial 1 of NLTK http://www.nltk.org/book/ch01.html 11 (NLTK Book) http://www.nltk.org/book/ (Tutorial 1 of NLTK) http://www.nltk.org/book/ch01.html (Tutorial 2 of NLTK) http://www.nltk.org/book/ch03.html
- 12. 4. Tutorial 1 of NLTK : Downloading NLTK BOOK 12
- 13. 4. Tutorial 1 of NLTK : load all items from NLTK’s book module 13 The book module contains tells the data you will need as you read this chapter of NLTK book
- 14. 4. Tutorial 1 of NLTK : Searching Text 14 A concordance view shows us every occ urrence of a given word. “monstrous“ You can find a word similar to “mons trous“
- 15. 4. Tutorial 1 of NLTK : Frequency Distribution 15 NLTK module gives us the frequency of each vocabulary item in the text
- 16. 4. Tutorial 1 of NLTK : Collocations and Bigrams 16 A collocation is a sequence of words that occur together unusually often. Thus, “red wine” is a collocation whereas the wine is not.
- 17. 5. Tutorial 2 of NLTK 17
- 18. 5. Tutorial 2 of NLTK http://www.nltk.org/book/ch03.html 18 A small sample of texts from Project “Gutenberg” appear in the NLTK corpus c ollection. However, you may be interested in analyzing other texts from Project “Gutenberg”. You can browse the catalog of 25,000 free online books at http:// www.Gutenberg.org/catalog/, and obtain a URL to an ASCII text file. Although 90% of the texts in Project “Gutenberg” are in English, it includes material in ov er 50 other languages, including Catalan, Chinese, Dutch, Finnish, French, Germ an, Italian, Portuguese and Spanish(with more than 100 text each). Text number 2554 is an English translation of Crime and Punishment.
- 19. 5. Tutorial 2 of NLTK : Word_tokenize 19 If you now take the step of creating an NLTK text. You can carry out all of the other linguistic processing we saw in Tu torial 1 of NLTK.
- 20. 5. Tutorial 2 of NLTK : Dealing with HTML 20 Create nltk text from tokens
- 21. 5. Tutorial 2 of NLTK : ConditionalFreDist of NLTK 21 Here you will extract all consonant-vowel sequence from the words of Rotokas, such as ka and si.
- 22. 5. Tutorial 2 of NLTK : Normalizing Text and Tokenizing 22 Normalizing text means making text to lowercase.
- 23. Reference 23 • (Information retrieval and data mining) http://cafe.daum.net/sskang-ir/VQRd/25 • (NLTK book) http://www.nltk.org/book/ • (Chapter 1 of NLTK book) http://www.nltk.org/book/ch01.html • (Chapter 3 of NLTK book) http://www.nltk.org/book/ch03.html