Hi gang,
This week we have two more practice talks for the upcoming NIPS conference.
Ian and Guillaume (take 2) will be presenting their recent work.
Come with questions, comments and critiques.
When: Wednesday Dec. 7nd, 14h00
Where: AA3195
Speaker: Ian Goodfellow
Title: Spike-and-Slab Sparse Coding for Unsupervised Feature Discovery
We introduce spike-and-slab sparse coding (S3C), an unsupervised feature discovery algorithm. S3C is based on a generative model that resembles both the spike-and-slab RBM and sparse coding. Since exact inference in this model is intractable, we derive a structured variational inference procedure and employ a variational EM training algorithm. We demonstrate that this approach improves upon the supervised learning capabilities of both sparse coding and the ssRBM on the CIFAR-10 dataset. We evaluate our approach’s potential for semi-supervised learning on subsets of CIFAR-10. We demonstrate state-of-the art self-taught learning performance on the STL-10 dataset and use our method to win the NIPS 2011 Workshop on Challenges In Learning Hierarchical Models’ Transfer Learning Challenge.
+++++++++++++++++++++++++++++++++++++++++++++++++++++