東華大學圖書館 |

Language: English

Help

回圖書館首頁

手機版館藏查詢

Back

Switch To: Labeled | MARC Mode | ISBD

Semi-supervised Learning via General...

Erkan, Ayse Naz.

Linked to FindBook

Google Book

Amazon

博客來

Semi-supervised Learning via Generalized Maximum Entropy.

Record Type:	Language materials, printed : Monograph/item
Title/Author:	Semi-supervised Learning via Generalized Maximum Entropy./
Author:	Erkan, Ayse Naz.
Description:	160 p.
Notes:	Source: Dissertation Abstracts International, Volume: 72-01, Section: B, page: 0341.
Contained By:	Dissertation Abstracts International72-01B.
Subject:	Engineering, Robotics. -
Online resource:	http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=3427925
ISBN:	9781124331270

Semi-supervised Learning via Generalized Maximum Entropy.
Erkan, Ayse Naz.

Semi-supervised Learning via Generalized Maximum Entropy. - 160 p.

Source: Dissertation Abstracts International, Volume: 72-01, Section: B, page: 0341.

Thesis (Ph.D.)--New York University, 2010.

The maximum entropy (MaxEnt) framework has been studied extensively in the supervised setting. Here, the goal is to find a distribution p that maximizes an entropy function while enforcing data constraints so that the expected values of some (pre-defined) features with respect to p match their empirical counterparts approximately. Using different entropy measures, different model spaces for p, and different approximation criteria for the data constraints, yields a family of discriminative supervised learning methods (e.g., logistic regression, conditional random fields, least squares and boosting) (Dudik & Schapire, 2006; Friedlander & Gupta, 2006; Altun & Smola, 2006). This framework is known as the generalized maximum entropy framework.

ISBN: 9781124331270Subjects--Topical Terms:

1018454
Engineering, Robotics.

Semi-supervised Learning via Generalized Maximum Entropy.
LDR:04820nam 2200373 4500 001 1405178
005 20111206130430.5
008 130515s2010 ||||||||||||||||| ||eng d
020 $a 9781124331270
035 $a (UMI)AAI3427925
035 $a AAI3427925
040 $a UMI $c UMI
100 1 $a Erkan, Ayse Naz. $3 1684536
245 1 0 $a Semi-supervised Learning via Generalized Maximum Entropy.
300 $a 160 p.
500 $a Source: Dissertation Abstracts International, Volume: 72-01, Section: B, page: 0341.
500 $a Adviser: Yann LeCun.
502 $a Thesis (Ph.D.)--New York University, 2010.
520 $a The maximum entropy (MaxEnt) framework has been studied extensively in the supervised setting. Here, the goal is to find a distribution p that maximizes an entropy function while enforcing data constraints so that the expected values of some (pre-defined) features with respect to p match their empirical counterparts approximately. Using different entropy measures, different model spaces for p, and different approximation criteria for the data constraints, yields a family of discriminative supervised learning methods (e.g., logistic regression, conditional random fields, least squares and boosting) (Dudik & Schapire, 2006; Friedlander & Gupta, 2006; Altun & Smola, 2006). This framework is known as the generalized maximum entropy framework.
520 $a Semi-supervised learning (SSL) is a promising field that has increasingly attracted attention in the last decade. SSL algorithms utilize unlabeled data along with labeled data so as to increase the accuracy and robustness of inference algorithms. However, most SSL algorithms to date have had trade-offs, e.g., in terms of scalability or applicability to multi-categorical data.
520 $a In this thesis, we extend the generalized MaxEnt framework to develop a family of novel SSL algorithms using two different approaches: (1) Introducing Similarity Constraints We incorporate unlabeled data via modifications to the primal MaxEnt objective in terms of additional potential functions. A potential function stands for a closed proper convex function that can take the form of a constraint and/or a penalty representing our structural assumptions on the data geometry. Specifically, we impose similarity constraints as additional penalties based on the semi-supervised smoothness assumption , i.e., we restrict the MaxEnt problem such that similar samples have similar model outputs. The motivation is reminiscent of that of Laplacian SVM (Sindhwani et al., 2005) and manifold transductive neural networks (Karlen et al., 2008), however, instead of regularizing the loss function in the dual we integrate our constraints directly to the primal MaxEnt problem which has a more straight-forward and natural interpretation. (2) Augmenting Constraints on Model Features We incorporate unlabeled data to enhance the moment matching constraints of the generalized MaxEnt problem in the primal. We improve the estimates of the model and empirical expectations of the feature functions using our assumptions on the data geometry.
520 $a In particular, we derive the semi-supervised formulations for three specific instances of the generalized MaxEnt framework on conditional distributions, namely logistic regression and kernel logistic regression for multi-class problems, and conditional random fields for structured output prediction problems. A thorough empirical evaluation on standard data sets that are widely used in the literature demonstrates the validity and competitiveness of the proposed algorithms. In addition to these benchmark data sets, we apply our approach to two real-life problems, vision based robot grasping, and remote sensing image classification where the scarcity of the labeled training samples is the main bottleneck in the learning process. For the particular case of grasp learning, we also propose a combination of semi-supervised learning and active learning, another sub-field of machine learning that is focused on the scarcity of labeled samples, when the problem setup is suitable for incremental labeling.
520 $a To conclude, the novel SSL algorithms proposed in this thesis have numerous advantages over the existing semi-supervised algorithms as they yield convex, scalable, inherently multi-class loss functions that can be kernelized naturally.
590 $a School code: 0146.
650 4 $a Engineering, Robotics. $3 1018454
650 4 $a Computer Science. $3 626642
690 $a 0771
690 $a 0984
710 2 $a New York University. $b Computer Science. $3 1065424
773 0 $t Dissertation Abstracts International $g 72-01B.
790 1 0 $a LeCun, Yann, $e advisor
790 1 0 $a Fergus, Rob $e committee member
790 1 0 $a Weston, Jason $e committee member
790 1 0 $a Davis, Ernest $e committee member
790 1 0 $a Altun, Yasemin $e committee member
790 $a 0146
791 $a Ph.D.
792 $a 2010
856 4 0 $u http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=3427925