Given an audio file and a puppet video, we produce a dubbed result in which the puppet is saying the new audio phrase with proper mouth articulation. Specifically, each syllable
CategoryResearch
Information Maximizing Visual Question Generation
Example questions generated for a set of images and answer categories. Incorrect questions are shown in grey and occur when no relevant question van be generated for a given image
A Glimpse Far into the Future: Understanding Long-term Crowd Worker Accuracy
A selection of individual workers’ accuracy over time during the question answering task. Each worker remains relatively constant throughout his or her entire lifetime. Authors Kenji Hata, Ranjay Krishna, Li
Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotations
An overview of the data needed to move from perceptual awareness to cognitive understanding of images. We present a dataset of images densely annotated with numerous region descriptions, objects, attributes,
Visual Relationship Detection with Language Priors
Even though all the images contain the same objects (a person and a bicycle), it is the relationship between the objects that determine the holistic interpretation of the image. Authors
Generating Semantically Precise Scene Graphs from Textual Descriptions for Improved Image Retrieval
Actual results using a popular image search engine (top row) and ideal results (bottom row) for the query a boy wearing a t-shirt with a plane on it. Authors Sebastian
Embracing Error to Enable Rapid Crowdsourcing
(a) Images are shown to workers at 100ms per image. Workers react whenever they see a dog. (b) The true labels are the ground truth dog images. (c) The workers’
Image Retrieval using Scene Graphs
Image search using a complex query like “man holding fish and wearing hat on white boat” returns unsatisfactory results in (a). Ideal results (b) include correct objects (“man”, “boat”), attributes
Editorial Algorithms: Using Social Media to Discover and Report Local News
Screenshot of CityBeat interface showing the Detected Events List, Event Window and the Statistics Sidebar Authors Schwartz, R., Naaman M., Teodoro R. Abstract The role of algorithms in the detection, curation