[Lisa_teatalk] [TeaTalk & LURG] Nov. 28th, Harm de Vries on "GuessWhat?! Visual object discovery through multi-modal dialogue"

Junyoung Chung elecegg at gmail.com
Mon Nov 28 05:13:16 EST 2016


Reminder
-------------

Hi everyone,

we have a tea talk today (during the LURG meeting).
Harm will present his recent work on "GuessWhat?! Visual object discovery
through multi-modal dialogue".

Best,
--Junyoung

On Wed, Nov 23, 2016 at 1:27 PM, Junyoung Chung <elecegg at gmail.com> wrote:

Hi everyone,

we don't have a tea talk on this Friday (Nov 25), but instead we will have
one on next Monday (Nov 28). This talk is also going to be the LURG meeting
of the week. Harm will present his recent work on "GuessWhat?! Visual
object discovery through multi-modal dialogue".

Who:    Harm de Vries
When:  Nov. 28th (Monday) 3PM
Where: PAA3195

Title: GuessWhat?! Visual object discovery through multi-modal dialogue
Abstract: We introduce GuessWhat?!, a two-player guessing game as a testbed
for research on the interplay of computer vision and dialogue systems. The
 goal of the game is to locate an unknown object in a rich image scene by
asking a sequence of questions. Higher-level image understanding, like
spatial reasoning and language grounding, is required to solve the proposed
task. Our key contribution is the collection of a large-scale dataset
 consisting of 150K human-played games with a total of 800K visual
 question-answer pairs on 66K images. We explain our design decisions in
 collecting the dataset and introduce the oracle and questioner tasks that
are associated with the two players of the game. We prototyped  deep
learning models to establish initial baselines of the introduced tasks.

Best,
--Junyoung
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://webmail.iro.umontreal.ca/pipermail/lisa_teatalk/attachments/20161128/e9d79232/attachment.html 


More information about the Lisa_teatalk mailing list