dialog problem overview

一 Datasets

1. ubuntu chat corpus: http://daviduthus.org/UCC/
2. dialogue  datasets (circa 2005)

二 Tasks

task1: next utterance classfication

the dual encoder model

task2: large copurs next-utterance retrievl

task3: narural language generation

hierachical encoder-decoder architecture(bengio AAAI 2015)

三 Interesting topics

(Interesting! ) exploring ethical and social  challenge:

bias:

bias in image classification, debiasing word embeddings(bolukbasi et al 2016), hate and offensive language detection  (Davidson at al 2017)

privacy

safety

value alignment

adversarial examples

四 Challenges

Challenge: how to evaluation ?

evaluation for generative models:

perplexity

word error rate

word overlap metrics, BLEU

camparing response with human

五 adversarial examples