A New Framework for Semisupervised, Multitask Learning

Autor/in	Loeff, Nicolas
Titel	A New Framework for Semisupervised, Multitask Learning
Quelle	(2009), (84 Seiten) PDF als Volltext Verfügbarkeit Ph.D. Dissertation, University of Illinois at Urbana-Champaign
Sprache	englisch
Dokumenttyp	gedruckt; online; Monographie
ISBN	978-1-1095-7256-8
Schlagwörter	Hochschulschrift; Dissertation; Prediction; Cognitive Development; Identification; Internet; Models; Task Analysis; Learning Processes; Supervision; Recognition (Psychology); Data Analysis; Science Education + Suchen Sie Ihr Suchwort? Thesis; Dissertations; Academic thesis; Vorhersage; Kognitive Entwicklung; Identifikation; Identifizierung; Analogiemodell; Aufgabenanalyse; Learning process; Lernprozess; Recognition; Wiedererkennen; Auswertung; Naturwissenschaftliche Bildung
Abstract	Labeling image collections is a tedious task, especially when multiple labels have to be chosen for each image. On the other hand, the explosion of Internet content has provided cheap access to almost unlimited amounts of data, albeit with a lower quality of annotations. In this dissertation we introduce a new framework that extends state-of-the-art models in word prediction to incorporate information from two sources: (1) Unlabeled examples: datapoints without annotations, but lying in a "manifold" of lower dimensionality than the input space. (2) Correlated labels: examples with multiple labels, some of which tend to co-occur. Both are common in image annotation tasks. To the best of our knowledge, this is the first semisupervised multitask model used in vision problems of these characteristics. We start by introducing a new model for semisupervised learning based in a boosting formulation that, unlike most semisupervised approaches, is fast, efficient, and can scale to millions of unlabeled examples. It is flexible enough to handle the whole range of supervision, from fully supervised multiclass classification to unsupervised clustering. The framework is general and accepts many different function approximation techniques. It produces results at the state of the art on standard problems and also tackles problems that were unfeasible with previous approaches. Next we present a novel max-margin framework for multitask learning that exploits natural correlation between labels in image collections, resulting in improved word prediction and good annotation completion. It forces classifiers to share features and thus finds a low-dimensional latent space with high discriminative power for correlated labels. In subsequent chapters, we integrate part of the manifold framework with the multitask formulation, to extend it to semisupervised learning. Our max-margin formulation shares features between tasks and also propagates label information for learning from unlabeled examples. Our experiments show that unlabeled data makes a large contribution to performance of the classifier, especially when the number of labeled examples is low. To conclude, we interpret the internal representation of the model and use it to perform unsupervised scene discovery. Defining a meaningful vocabulary for scene discovery is a challenging problem that has important consequences for object recognition. We consider scenes to depict correlated objects and present visual similarity. We postulate that the internal representation space of our model should allow us to discover a large number of scenes in unsupervised data; we show scene discrimination results on par with supervised approaches even without explicitly labeling scenes, producing highly plausible scene clusters. [The dissertation citations contained here are published with the permission of ProQuest LLC. Further reproduction is prohibited without permission. Copies of dissertations may be obtained by Telephone (800) 1-800-521-0600. Web page: http://www.proquest.com/en-US/products/dissertations/individuals.shtml.] (As Provided).
Anmerkungen	ProQuest LLC. 789 East Eisenhower Parkway, P.O. Box 1346, Ann Arbor, MI 48106. Tel: 800-521-0600; Web site: http://www.proquest.com/en-US/products/dissertations/individuals.shtml
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10