Dalhousie University    [  http://web.cs.dal.ca/~vlado/csci6509/coursecalendar.html  ]
Winter 2017 (Jan9-Apr10)
Faculty of Computer Science
Dalhousie University

CSCI 4152/6509 - Course Calendar (tentative)

[ Home | Calendar | Project | Misc | A0 | A1 | A2 ]
  Part I: Introduction
1 Mon Jan  9Course Introduction
Course information: logistics and administrivia, textbook and other main references, evaluation scheme, academic integrity policy, culture of respect, tentative course schedule. Introduction to NLP (reading Ch.1 [JM]): natural language and other languages; NLP applications.
Files: Syllabus (PDF), Slides (PDF), Lecture notes (PDF). Reading: [JM] Ch.1
A0 out
2 Tue Jan 10Introduction to Natural Language Processing
NLP as a research area, NLP Research links and NLP Anthology http://aclweb.org/anthology-new/. Short history of NLP. Levels of NLP.
Files: Slides (PDF), Lecture notes (PDF).
3 Thu Jan 12About Course Project
Some reasons why NLP is hard, ambiguities at different levels of NLP, examples of lexical and syntactic ambiguities. Ambiguities at different levels of NLP (continued): syntactic, semantic, pragmatic levels; NLP metholodology; about course project: deliverables, P0, P1, P, R; project types, choosing topic, resources; themes and previous topics.
Files: Slides (PDF), Lecture notes (PDF).
  Part II: Stream-based Text Processing
4 Mon Jan 16 Introduction to Perl
Part II: Stream-based Text Processing; Introduction to Perl, main Perl language features, strengths and weaknesses, resources, file names, running program, simple arithmetic, syntactic elements, reading input, declaring variables, counting lines.
Files: Slides (PDF), Lecture notes (PDF).
A0 due
5 Tue Jan 17Regular Expressions
Regular expressions: reading: Chapter 2 [JM], simple example, use in Perl, examples; Finite state automata, DFA.
Files: Slides (PDF), Lecture notes (PDF). Reading: Chapter 2 [JM]
6 Thu Jan 19Automata, Text Processing in Perl
Non-deterministic finite automata, more on Perl regular expressions; text processing in Perl: examples.
Files: Slides(PDF), Lecture notes (PDF).
L1 Fri Jan 20Lab 1: SVN Tutorial
Logging in, bluenose environment; Basic Perl program; SVN tutorial, checking out the course repository and basic operations.
Files: Slides (PDF), Lab notes (PDF).
  Fr Jan 20Last day to add classes  
7 Mon Jan 23 Elements of Morphology
Elements of Morphology: reading: Section 3.1 [JM]; morphemes, stems, affixes, tokenization, stemming, lemmatization; morphological processes. Characters, Words, and N-grams: counting words, Zipf's law.
Files: Slides (PDF), Lecture notes (PDF). Reading: Section 3.1 [JM]
A1 out
8 Tue Jan 24N-grams
N-grams: character and word n-grams, counting n-grams; Perl: lists, scalar vs. array context in Perl, subroutines, using Ngrams module; Elements of information retrieval: typical IR system architecture, vector space model.
Files: Slides (PDF), Lecture notes (PDF). Reading: [JM] 23.1 (Information Retrieval), [MS] Ch.15 (Topics in Information Retrieval).
9 Thu Jan 25IR Evaluation Measures
Some interesting links: Lucene, IR book by Manning, Raghavan, and Schutze. IR evaluation measures, precision-recall curve, example, other evaluation measures. Text classification: introduction, authorship attribution.
Files: Slides (PDF), Lecture notes (PDF).
L2 Fri Jan 27 Lab 2: Perl Tutorial 1 Files: Slides (PDF), Lab notes (PDF). 
10 Mon Jan 30Similarity-based Text Classification
CNG classification method; evaluating text classification: evaluation measures, example, evaluation methods; overview of text clustering; logical vs. plausible reasoning in AI and NLP.
Files: Slides (PDF), Lecture notes (PDF).
A1 due
  Part III: Probabilistic Approach to NLP
11 Tue Jan 31Probabilistic Approach to NLP
Probabilistic approach to NLP: logical vs. plausible reasoning, plausible reasoning approaches, brief review of elements of probability theory; Bayesian inference, generative models.
Files: Slides (PDF), Lecture notes (PDF).
12 Thu Feb  2Probabilistic Modeling
Probabilistic modeling: random variables, configurations, and models; computational tasks; Joint distribution model and fully independent model; Naive Bayes model.
Files: Slides (PDF), Lecture notes (PDF).
P0 due
  Fri Feb 3Munro Day, University closed, no labs  
13 Mon Feb 6N-grams Model
N-gram model: assumption, graphical representation, n-gram model as Markov chain, perplexity, text classification using language modeling.
Files: Slides (PDF), Lecture notes (PDF). Reading: [JM] Ch4 N-Grams
14 Tue Feb 7Smoothing, Part-of-Speech (POS) Tags
Smoothing: Lapace smoothing, Witten-Bell discounting; POS tags: open and closed word categories, determiners.
Files: Slides (PDF), Lecture notes (PDF) .
A2 out
15 Thu Feb 9Part-of-Speech Tagging
Parts of Speech (POS) and POS Tags (continued); Hidden Markov Model (HMM): definition.
Files: Slides (PDF), Lecture notes (PDF). Reading: [JM] Ch5 Part-of-Speech Tagging
L3 Fri Feb 10Lab 3: Perl Tutorial 2 Files: Slides (PDF), Lab notes (PDF), Slides: Regular Expressions in Perl. 
  Fr Feb 10Last day to drop classes without "W"  
  Tue Feb 14No class, University closed, snow day  
16 Thu Feb 16No class, University closed, snow day
Reading: POS Tagging with HMM.
Files: Lecture notes, slides.
L4 Fri Feb 17Lab 4: Perl Tutorial 3 Files: Slides (PDF), Lab notes (PDF).A2 due
  Mon Feb 20Winter Study Break, no classes, Feb 20-24  
17 Mon Feb 27HMM Tagging with Product-Sum Algorithm  
18 Tue Feb 28To be added  
19 Thu Mar 2To be added P1 due
  Part IV: Parsing (Syntactic Processing)
20 Mon Mar 6Syntax and Context-Free Grammars  
21 Tue Mar 7Phrase Structure Rules for English  
22 Thu Mar 9Parsing and CYK Algorithm  
L5 Fri Mar 10Lab 5: Prolog Tutorial 1  
23 Mon Mar 13Probabilistic Context-Free Grammars  
  Part V: Semantics and Unification-based NLP
24 Tue Mar 14Semantics and Unification-based Approach to NLP  
25 Thu Mar 16DCG -- Definite Clause Grammars  
L6 Fri Mar 17 Lab 6: Prolog Tutorial 2  
  Fr Mar 17Last day to drop classes with "W"  
26 Mon Mar 20 Classical Unification  
27 Tue Mar 21 Feature Structures  
28 Thu Mar 23Feature Structures  
L7 Fri Mar 24 Lab 7: Prolog Tutorial 3  
29 Mon Mar 27 Course Review 1  
30 Tue Mar 28 Course Review 2  
31 Thu Mar 30Course Evaluation, Course Review 3  
  Part VI: Student Presentations
32 Mon Apr 3Student presentations (PT-33, PT-34, PT-35, PT-36)  
33 Tue Apr 4 Student presentations (PT-29*, PT-30, PT-31, PT-32)  
34 Thu Apr 6 Student presentations (PT-25, PT-26, PT-27, PT-28)  
35 Fr Apr 7 Lab-4152 (11:35-12:55) Student presentations (PT-19, PT-20, PT-21, PT-22*, PT-23, PT-24)  
36 Fr Apr 7 Lab-6509 (14:35-15:55) Student presentations (PT-13, PT-14, PT-15, PT-16, PT-17, PT-18)  
37 Mo Apr 10 Lab-4152 (11:35-12:55) Student presentations (PT-07, PT-08, PT-09, PT-10, PT-11, PT-12)
Friday schedule used. Last day of classes
38 Mo Apr 10 Lab-6509 (14:35-15:55) Student presentations (PT-01, PT-02, PT-03*, PT-04, PT-05, PT-06)
Friday schedule used. Last day of classes
  Mon Apr 10Project Reports due Report due
  ?? Apr ?Final Exam (TBA)
Final exam, 2 hours, to be announced. Exam period: Apr 12 to Apr 26 (2 hour final exam); Exams schedule URL: http://www.dal.ca/academics/exam_schedule/halifax_campus_exam_schedule.html

© 2002-2017 Vlado Keselj, last update: 22-Feb-2017