Description:

If you use GPstuff, please use the reference: Jarno Vanhatalo, Jaakko Riihimäki, Jouni Hartikainen, Pasi Jylänki, Ville Tolvanen, Aki Vehtari (2013). GPstuff: Bayesian Modeling with Gaussian Processes. In Journal of Machine Learning Research, 14:1175-1179.

See also user guide at http://arxiv.org/abs/1206.5754

GPstuff is a toolbox for Bayesian Modeling with Gaussian Processes with following features and more:

• Several covariance functions (e.g. squared exponential, exponential, Matérn, periodic and a compactly supported piece wise polynomial function)
  • Sums, products and scaling of covariance functions
  • Euclidean and delta distance
• Several mean functions with marginalized parameters
• Several likelihood/observation models
  • Continuous observations: Gaussian, Gaussian scale mixture (MCMC only), Student's-t, quantile regression
  • Classification: Logit, Probit, multinomial logit (softmax), multinomial probit
  • Count data: Binomial, Poisson, (Zero truncated) Negative-Binomial, Hurdle model, Zero-inflated Negative-Binomial, Multinomial
  • Survival: Cox-PH, Weibull, log-Gaussian, log-logistic
  • Point process: Log-Gaussian Cox process
  • Density estimation and regression: logistic GP
  • Other: derivative observations (for sexp covariance function only)
  • Monotonicity information
• Hierarchical priors for hyperparameters
• Sparse models
  • Sparse matrix routines for compactly supported covariance functions
  • Fully and partially independent conditional (FIC, PIC)
  • Compactly supported plus FIC (CS+FIC)
  • Variational sparse (VAR), Deterministic training conditional (DTC), Subset of regressors (SOR) (Gaussian/EP only)
  • PASS-GP
• Latent inference
  • Exact (Gaussian only)
  • Laplace, Expectation propagation (EP), Parallel EP, Robust-EP
  • marginal posterior corrections (cm2 and fact)
  • Scaled Metropolis, Hamiltonian Monte Carlo (HMC), Scaled HMC, Elliptical slice sampling
  • State space inference (1D for some covariance functions)
• Hyperparameter inference
  • Type II ML/MAP
  • Leave-one-out cross-validation (LOO-CV), Laplace/EP LOO-CV
  • Metropolis, HMC, No-U-Turn-Sampler (NUTS), Slice Sampling (SLS), Surrogate SLS, Shrinking-rank SLS, Covariance-matching SLS
  • Grid, CCD, Importance sampling
• Model assessment
  • LOO-CV, Laplace/EP LOO-CV, IS-LOO-CV, k-fold-CV
  • WAIC, DIC
  • Average predictive comparison

Changes to previous version:

2014-07-22 Version 4.5

New features

• Input dependent noise and signal variance.

  • Tolvanen, V., Jylänki, P. and Vehtari, A. (2014). Expectation Propagation for Nonstationary Heteroscedastic Gaussian Process Regression. In Proceedings of IEEE International Workshop on Machine Learning for Signal Processing, accepted for publication. Preprint http://arxiv.org/abs/1404.5443

• Sparse stochastic variational inference model.

  • Hensman, J., Fusi, N. and Lawrence, N. D. (2013). Gaussian processes for big data. arXiv preprint http://arxiv.org/abs/1309.6835.

• Option 'autoscale' in the gp_rnd.m to get split normal approximated samples from the posterior predictive distribution of the latent variable.

  • Geweke, J. (1989). Bayesian Inference in Econometric Models Using Monte Carlo Integration. Econometrica, 57(6):1317-1339.

  • Villani, M. and Larsson, R. (2006). The Multivariate Split Normal Distribution and Asymmetric Principal Components Analysis. Communications in Statistics - Theory and Methods, 35(6):1123-1140.

Improvements

• New unit test environment using the Matlab built-in test framework (the old Xunit package is still also supported).
• Precomputed demo results (including the figures) are now available in the folder tests/realValues.
• New demos demonstrating new features etc.
  • demo_epinf, demonstrating the input dependent noise and signal variance model
  • demo_svi_regression, demo_svi_classification
  • demo_modelcomparison2, demo_survival_comparison

Several minor bugfixes

BibTeX Entry: Download

Corresponding Paper BibTeX Entry: Download

Supported Operating Systems: Agnostic, Platform Independent

Data Formats: Matlab, Octave

Tags: Classification, Regression, Machine Learning, Nonparametric Bayes, Gaussian Process, Bayesian Inference

Archive: download here

Comments

No one has posted any comments yet. Perhaps you'd like to be the first?

Leave a comment

You must be logged in to post comments.