Strathprints Home | Open Access | Browse | Search | User area | Copyright | Help | Library Home | SUPrimo

Efficient Gaussian process based on BFGS updating and logdet approximation

Leithead, W.E. and Zhang, Y. and Leith, D.J. (2005) Efficient Gaussian process based on BFGS updating and logdet approximation. [Proceedings Paper]

Full text not available in this repository. (Request a copy from the Strathclyde author)

Abstract

Gaussian process (GP) is a Bayesian nonparametric regression model, showing good performance in various applications. However, its hyperparameterestimation procedure suffers from numerous covariance-matrix inversions of prohibitively O(N3) operations. In this paper, we propose using the quasi-Newton BFGS O(N2)-operation formula to update recursively the inverse of covariance matrix at every iteration. As for the involved log det computation, a power-series expansion based approximation and compensation scheme is proposed with only 50N2 operations. A number of numerical tests are performed based on the 2D- sinusoidal regression example and the Wiener-Hammerstein identification example. It is shown that by using the proposed implementation, more than 80% O(N3) operations are eliminated, and the speedup of 5 - 9 can be achieved.

Item type: Proceedings Paper
ID code: 42139
Keywords: Gaussian process regression, compensation, approximation, power series expansion, matrix inverse, Electrical engineering. Electronics Nuclear engineering
Subjects: Technology > Electrical engineering. Electronics Nuclear engineering
Department: Faculty of Engineering > Electronic and Electrical Engineering
Related URLs:
    Depositing user: Pure Administrator
    Date Deposited: 20 Nov 2012 11:47
    Last modified: 17 Jul 2013 14:16
    URI: http://strathprints.strath.ac.uk/id/eprint/42139

    Actions (login required)

    View Item