Alternating binary classifier and graph learning from partial labels

Yang, Cheng and Cheung, Gene and Stankovic, Vladimir (2018) Alternating binary classifier and graph learning from partial labels. In: Asia-Pacific Signal and Information Processing Association Annual Summit and Conference 2018, 2018-11-12 - 2018-11-15. (https://doi.org/10.23919/APSIPA.2018.8659448)

[thumbnail of Yang-etal-APSIPA-AC-2018-Alternating-binary-classifier-and-graph-learning-from-partial-labels]
Preview
 Text. Filename: Yang_etal_APSIPA_AC_2018_Alternating_binary_classifier_and_graph_learning_from_partial_labels.pdf
Accepted Author Manuscript
Download (314kB)| Preview

Abstract

Semi-supervised binary classifier learning is a fundamental machine learning task where only partial binary labels are observed, and labels of the remaining data need to be interpolated. Leveraging on the advances of graph signal processing (GSP), recently binary classifier learning is posed as a signal restoration problem regularized using a graph smoothness prior, where the undirected graph consists of a set of vertices and a set of weighted edges connecting vertices with similar features. In this paper, we improve the performance of such a graph-based classifier by simultaneously optimizing the feature weights used in the construction of the similarity graph. Specifically, we start by interpolating missing labels by first formulating a boolean quadratic program with a graph signal smoothness objective, then relax it to a convex semi-definite program, solvable in polynomial time. Next, we optimize the feature weights used for construction of the similarity graph by reusing the smoothness objective but with a convex set constraint for the weight vector. The reposed convex but non-differentiable problem is solved via an iterative proximal gradient descent algorithm. The two steps are solved alternately until convergence. Experimental results show that our alternating classifier / graph learning algorithm outperforms existing graph-based methods and support vector machines with various kernels.

ORCID iDs

Yang, Cheng, Cheung, Gene and Stankovic, Vladimir ORCID logoORCID: https://orcid.org/0000-0002-1075-2420;
CORE (COnnecting REpositories)