About: A scalable, fast C++ machine learning library, with emphasis on usability.

Speedups of cover tree traversers; addition of rank-approximate nearest neighbor (RANN); addition of fast exact max-kernel search (FastMKS); fix for EM covariance estimation; more parameters for GMM estimation; force GMM and GaussianDistribution covariance matrices to be positive definite during training; add a tolerance parameter to the Baum-Welch algorithm for HMM training; fix for compilation with clang; fix for k-furthest neighbor search.

About: The GPstuff toolbox is a versatile collection of Gaussian process models and computational tools required for inference. The tools include, among others, various inference methods, sparse approximations and model assessment methods.

2013-04-24 Version 4.1

New features:

• Multinomial probit classification with nested-EP. Jaakko Riihimäki, Pasi Jylänki and Aki Vehtari (2013). Nested Expectation Propagation for Gaussian Process Classification with a Multinomial Probit Likelihood. Journal of Machine Learning Research 14:75-109, 2013.
• Marginal posterior corrections for latent values. Cseke & Heskes (2011). Approximate Marginals in Latent Gaussian Models. Journal of Machine Learning Research 12 (2011), 417-454
  • Laplace: cm2 and fact
  • EP: fact

Improvements

• lgpdens ignores now NaNs instead of giving error
• gp_cpred has a new option 'target' accpeting values 'f' or 'mu'
• unified gp_waic and gp_dic
  • by default return mlpd
  • option 'form' accetps now values 'mean' 'all' 'sum' and 'dic'
• improved survival demo demo_survival_aft (accalerated failure time)
  • renamed and improved from demo_survival_weibull
• rearranged some files to more logical directories
• bug fixes

New files

• gp_predcm: marginal posterior corrections for latent values.
• demo_improvedmarginals: demonstration of marginal posterior corrections
• demo_improvedmarginals2: demonstration of marginal posterior corrections
• lik_multinomprobit: multinomial probit likelihood
• demo_multiclass_nested_ep: demonstration of nested EP with multinomprobit

About: The apcluster package implements Frey's and Dueck's Affinity Propagation clustering in R. The package further provides leveraged affinity propagation, exemplar-based agglomerative clustering, and various tools for visual analysis of clustering results.

• re-implementation of heatmap() method: dendrograms can now be plotted even for APResult and ExClust objects as well as for cluster hierarchies based on prior clusterings; color bars can now be switched off and colors can be changed by user (by new 'sideColor' argument); dendrograms can be switched on and off (by 'Rowv' and 'Colv' arguments);
• added as.hclust() and as.dendrogram() methods
• added new arguments 'base', 'showSamples', and 'horiz' to the plot() method with signature (x="AggExResult", y="missing"); moreover, parameters for changing the appearance of the height axis are now respected as well
• streamlining of methods (redundant definition of inherited methods removed)
• various minor improvements of code and documentation

About: This toolbox implements models for Bayesian mixed-effects inference on classification performance in hierarchical classification analyses.

In addition to the existing MATLAB implementation, the toolbox now also contains an R package of the variational Bayesian algorithm for mixed-effects inference.

About: The aim is to embed a given data relationship matrix into a low-dimensional Euclidean space such that the point distances / distance ranks correlate best with the original input relationships. Input relationships may be given as (asymmetric) distances, dissimilarities, or (negative) scores. Input-output relations are modelled as row-conditioned. (Weighted) Pearson and soft Spearman rank correlation, and unweighted soft Kendall correlation are supported correlation measures for input/output object neighborhood relationships.

• Initial release (Ver 1.0): Weighted Pearson and correlation and soft Spearman rank correlation, Tue Dec 4 16:14:51 CET 2012

• Ver 1.1 Added soft Kendall correlation, Fri Mar 8 08:41:09 CET 2013

About: LIBOL is an open-source library that consists of a family of state-of-the-art online learning algorithms for machine learning and data mining research.

Initial Announcement on mloss.org.

About: FABIA is a biclustering algorithm that clusters rows and columns of a matrix simultaneously. Consequently, members of a row cluster are similar to each other on a subset of columns and, analogously, members of a column cluster are similar to each other on a subset of rows. Biclusters are found by factor analysis where both the factors and the loading matrix are sparse. FABIA is a multiplicative model that extracts linear dependencies between samples and feature patterns. Applications include detection of transcriptional modules in gene expression data and identification of haplotypes/>identity by descent< consisting of rare variants obtained by next generation sequencing.

CHANGES IN VERSION 2.4.0

o spfabia bugfixes

CHANGES IN VERSION 2.3.1

NEW FEATURES

o Getters and setters for class Factorization

2.0.0:

• spfabia: fabia for a sparse data matrix (in sparse matrix format) and sparse vector/matrix computations in the code to speed up computations. spfabia applications: (a) detecting >identity by descent< in next generation sequencing data with rare variants, (b) detecting >shared haplotypes< in disease studies based on next generation sequencing data with rare variants;
• fabia for non-negative factorization (parameter: non_negative);
• changed to C and removed dependencies to Rcpp;
• improved update for lambda (alpha should be smaller, e.g. 0.03);
• introduced maximal number of row elements (lL);
• introduced cycle bL when upper bounds nL or lL are effective;
• reduced computational complexity;
• bug fixes: (a) update formula for lambda: tighter approximation, (b) corrected inverse of the conditional covariance matrix of z;

1.4.0:

• New option nL: maximal number of biclusters per row element;
• Sort biclusters according to information content;
• Improved and extended preprocessing;
• Update to R2.13

About: ELKI is a framework for implementing data-mining algorithms with support for index structures, that includes a wide variety of clustering and outlier detection methods.

This is mostly a bug fix release. A lot of small issues have been fixed that improve performance, make error reporting a lot better, ease the use of sparse vectors and external precomputed distances, for example.

This will be the last ELKI release to support Java 6. The next ELKI release will require Java 7.

Algorithms

• Some new LOF variants (LDF, SimpleLOF, SimpleKernelDensityLOF)
• Correlation Outlier Probabilities (ICDM 2012)
• A naive mean-shift clustering
• Single-link clustering (SLINK algorithm) should be significantly faster due to optimized data structures
• "Benchmarking" algorithms for measuring the performance of index structures

Index layer

• Bulk loading R-Trees should be faster - in particular Sort Tile Recursive can work very well.
• M-Trees have been refactored and optimized for double distances

Database layer

• Bundle format (work in progress): low-level binary format for fast data exchange
• DBID and DataStore layer received some additional classes for further performance improvements
• KNN heap structures were revisited. The code is less clean now, but performs better in benchmarks.

Visualizations

• General clean up and API simplifications
• Some additional modules and improvements

Various

• There is a new parameter class, RandomParameter
• Some new distributions were added, also to the data set generator.

Tutorials

• The website has new tutorials, including one on a k-means variation that produces equal sized clusters.

About: Python Framework for Vector Space Modelling that can handle unlimited datasets (streamed input, online algorithms work incrementally in constant memory).

• added the "hashing trick" (by Homer Strong)
• support for adding target classes in SVMlight format (by Corrado Monti)
• fixed problems with global lemmatizer object when running in parallel on Windows
• parallelization of Wikipedia processing + added script version that lemmatizes the input documents
• added class method to initialize Dictionary from an existing corpus (by Marko Burjek)

About: Stochastic neighbor embedding aims at the reconstruction of given distance, dissimilarity, or score neighborhood relations in a low-dimensional Euclidean space. This can be regarded as general approach to multi-dimensional scaling, but the reconstruction is based on the definition of input (and output) neighborhood probability alone. Probability of score exceedance is used for neighborhood probability estimation, which is connected to soft-rank optimization. The present implementation makes use of quasi 2nd order gradient-based (l-)BFGS optimization.

• scoretoprob.m replaced by d2p.m

• protein score data set added

• trank.m computes (mid/max -tied) ranks along columns of matrix

• local P- neighborhood probability estimation added

• experimental soft_rank_SNE added for minimizing KL between probabilities of exceedance in source and embedding space

• symmetry option removed, because this was strange in previous version

About: PLEASD: A Matlab Toolbox for Structured Learning

Initial Announcement on mloss.org.

About: A general purpose library to process and predict sequences of elements using echo state networks.

Initial Announcement on mloss.org.

About: MLwizard recommends and optimizes classification algorithms based on meta-learning and is a software wizard fully integrated into RapidMiner but can be used as library as well.

Faster parameter optimization using genetic algorithm with predefined start population.

About: Matlab code for learning probabilistic SVM in the presence of uncertain labels.

Added missing dataset function (thanks to Hao Wu)

About: This package contains a python and a matlab implementation of the most widely used algorithms for multi-armed bandit problems. The purpose of this package is to provide simple environments for comparison and numerical evaluation of policies.

Initial Announcement on mloss.org.

About: The package provides a Lagrangian approach to the posterior regularization of given linear mappings. This is important in two cases, (a) when systems are under-determined and (b) when the external model for calculating the mapping is invariant to properties such as scaling. The software may be applied in cases when the external model does not provide its own regularization strategy. In addition, the package allows to rank attributes according to their distortion potential to a given linear mapping.

Version 1.1 (May 23, 2012) memory and time optimizations distderivrel.m now supports assessing the relevance of attribute pairs

Version 1.0 (Nov 9, 2011) * Initial Announcement on mloss.org.

About: Fast C++ implementation of the variation of information (Meila 2003) and Rand index (Rand 1971) with MATLAB mex files

Initial Announcement on mloss.org.