Natural Language Processing We are leaning NLP! Tokens: We,are,learning,NLP,! Syntax means proper arrangement of words according to rules. Now when syntax makes sense it becomes semantics His future is very bright. (semantics) Data Processing 1) Pre-processing steps (Text Normalisation) Example words like slang,short form,misspelled,special meaning character needs to be converted into canonical form. Words Canonical form b4,beefore,bifore before Gni8 Good night tysm Thank you so much gr8,grt great Statement: Gn tke care Perform text normalisation Answer: Good night take care. (corpus) There are multiple steps for performing text normalisation: 1. Sentence Segmentation 2. Tokenization 3. Rem...