Home » ANLP, Spring 2019

ANLP, Spring 2019

Elena Filatova, efilatova@citytech.cuny.edu

Office: GC 4410

Class is held in room: 7395

Tools, Books, Related Courses

Grading Policy

Class (tentative) schedule:

 

Topic Reading Assignment
1.

Jan. 28

Introduction

Overview: classification, feature engineering, NLP problems casted as classification problems (text classification, POS tagging, sentiment analysis, etc.).

Why deep learning? Why now? How is deep learning different from previously popular classification techniques?

Lecture notes

 

2.

Feb.

4

Neural nets: neuron analogy, one-layer NN as logistic regression classification, forward backward propagation.

Lecture notes

 

3

Feb. 11

Gradient decent, activation functions, regularization, loss functions, vectorization for IPython notebooks

Lecture notes

Assignment 1 is out

4

Feb. 25

Word Vector representation: one-hot representation, word2vec, GloVe, embeddings

Notes on Information Extraction (IE)

snowBallPresentation

Lecture notes

 

Word vectors:

GloVe

5

Mar. 11

TensorFlow, Keras discussion, discussion of possible projects
6

Mar. 18

RNN, CNN

Assignment 2 is out (on Mar. 15)

Project description

 

7

Mar. 25

RNN, CNN

Lecture notes

Lecture notes 2

 

8

Apr. 1

Project discussion (presentation of the task)
9

Apr. 8

Deep learning for classification

Lecture notes 3

Machine Translation

NMT (Stanford lecture)

 

10

Apr. 15

Speech recognition

Assignment 3 is out (due May 4)

11

Apr. 29

WSD problem and Deep Learning

Generative Adversarial Nets (GAN)

 

12

May 6

Text generation

Jiwei Li’s presentation on Deep Learning in Open Domain Dialogue Generation

13

May 13

Additional topics
14
May 15 (instead of the March 4 “snow day”)
Final project presentations, wrap-up
  • Sara
  • Shweta and Kiwook
  • Fuxian Li
  • Andreas and Zhaoheng
15

May 20

Project presentations, wrap-up