Exploiting Hessian matrix and trust-region algorithm in hyperparameters estimation of Gaussian process

Tools

Zhang, Y. and Leithead, W.E. (2005) Exploiting Hessian matrix and trust-region algorithm in hyperparameters estimation of Gaussian process. Applied Mathematics and Computation, 171 (2). pp. 1264-1281. ISSN 0096-3003 (http://dx.doi.org/10.1016/j.amc.2005.01.113)

Full text not available in this repository.Request a copy

Abstract

Gaussian process (GP) regression is a Bayesian non-parametric regression model, showing good performance in various applications. However, it is quite rare to see research results on log-likelihood maximization algorithms. Instead of the commonly used conjugate gradient method, the Hessian matrix is first derived/simplified in this paper and the trust-region optimization method is then presented to estimate GP hyperparameters. Numerical experiments verify the theoretical analysis, showing the advantages of using Hessian matrix and trust-region algorithms. In the GP context, the trust-region optimization method is a robust alternative to conjugate gradient method, also in view of future researches on approximate and/or parallel GP-implementation.

CORE (COnnecting REpositories)