Embeddings and Deep Learning

Hinrich Schütze and Martin Schmitt

An advanced course during the first week of the 29th European Summer School in Logic, Language, and Information (ESSLLI) 2017.

Contact:

• martin (at) cis.lmu.de
• hs2012 (at) cislmu.org

Room: C

Time: 11:00 - 12:30

Lectures

Monday. WordSpace: A Basic Embedding Model

Tuesday. Embeddings Learned By Matrix Factorization

Wednesday. Deep Learning I: Gradient Descent

Thursday. Embeddings Learned By Gradient Descent

Friday. Deep Learning II: Neural Networks

Exercises

Exercise Sheet

Code Repository on GitHub

Code and Datasets

• [Wordspace] wordspace.py
• [Wordspace] The Brown Corpus can be found here.
• [Word2vec] semantic_tests.py
• [Word2vec] The Word2vec model trained on Google News can be found here.
• [Deep Learning] Convolutional Neural Network Code in Pytorch