About: SALSA (Software lab for Advanced machine Learning with Stochastic Algorithms) is an implementation of the well-known stochastic algorithms for Machine Learning developed in the high-level technical computing language Julia. The SALSA software package is designed to address challenges in sparse linear modelling, linear and non-linear Support Vector Machines applied to large data samples with user-centric and user-friendly emphasis.

Initial Announcement on mloss.org.

About: Distributed optimization: Support Vector Machines and LASSO regression on distributed data

Initial Upload

About: The Gesture Recognition Toolkit (GRT) is a cross-platform, open-source, c++ machine learning library that has been specifically designed for real-time gesture recognition. It features a large number of machine-learning algorithms for both classification and regression in addition to a wide range of supporting algorithms for pre-processing, feature extraction and dataset management. The GRT has been designed for real-time gesture recognition, but it can also be applied to more general machine-learning tasks.

Added Decision Tree and Random Forests.

About: MLDemos is a user-friendly visualization interface for various machine learning algorithms for classification, regression, clustering, projection, dynamical systems, reward maximisation and reinforcement learning.

New Visualization and Dataset Features Added 3D visualization of samples and classification, regression and maximization results Added Visualization panel with individual plots, correlations, density, etc. Added Editing tools to drag/magnet data, change class, increase or decrease dimensions of the dataset Added categorical dimensions (indexed dimensions with non-numerical values) Added Dataset Editing panel to swap, delete and rename dimensions, classes or categorical values Several bug-fixes for display, import/export of data, classification performance

New Algorithms and methodologies Added Projections to pre-process data (which can then be classified/regressed/clustered), with LDA, PCA, KernelPCA, ICA, CCA Added Grid-Search panel for batch-testing ranges of values for up to two parameters at a time Added One-vs-All multi-class classification for non-multi-class algorithms Trained models can now be kept and tested on new data (training on one dataset, testing on another) Added a dataset generator panel for standard toy datasets (e.g. swissroll, checkerboard,...) Added a number of clustering, regression and classification algorithms (FLAME, DBSCAN, LOWESS, CCA, KMEANS++, GP Classification, Random Forests) Added Save/Load Model option for GMMs and SVMs Added Growing Hierarchical Self Organizing Maps (original code by Michael Dittenbach) Added Automatic Relevance Determination for SVM with RBF kernel (Thanks to Ashwini Shukla!)

About: This package is an implementation of a linear svm solver with a wide class of regularizations on the svm weight vector (l1, l2, mixed norm l1-lq, adaptive lasso). We provide solvers for the classical single task svm problem and for multi-task with joint feature selection or similarity promoting term.

Initial Announcement on mloss.org.

About: The Kernel-Machine Library is a free (released under the LGPL) C++ library to promote the use of and progress of kernel machines.

Updated mloss entry (minor fixes).

About: Python module to ease pattern classification analyses of large datasets. It provides high-level abstraction of typical processing steps (e.g. data preparation, classification, feature selection, [...]

• 2.0.0 (Mon, Dec 19 2011)

This release aggregates all the changes occurred between official releases in 0.4 series and various snapshot releases (in 0.5 and 0.6 series). To get better overview of high level changes see :ref:release notes for 0.5 <chap_release_notes_0.5> and :ref:0.6 <chap_release_notes_0.6> as well as summaries of release candidates below

• Fixes (23 BF commits)

  • significance level in the right tail was fixed to include the value tested -- otherwise resulted in optimistic bias (or absurdly high significance in improbable case if all estimates having the same value)
  • compatible with the upcoming IPython 0.12 and renamed sklearn (Fixes #57)
  • do not double-train slave classifiers while assessing sensitivities (Fixes #53)

• Enhancements (30 ENH + 3 NF commits)

  • resolving voting ties in kNN based on mean distance, and randomly in SMLR
  • :class:kNN's ca.estimates now contains dictionaries with votes for each class
  • consistent zscoring in :class:Hyperalignment

• 2.0.0~rc5 (Wed, Oct 19 2011)

• Major: to allow easy co-existence of stable PyMVPA 0.4.x, 0.6 development mvpa module was renamed into mod:mvpa2.

• Fixes

  • compatible with the new Shogun 1.x series
  • compatible with the new h5py 2.x series
  • mvpa-prep-fmri -- various compatibility fixes and smoke testing
  • deepcopying :class:SummaryStatistics during add

• Enhancements

  • tutorial uses :mod:mvpa2.tutorial_suite now
  • better suppression of R warnings when needed
  • internal attributes of many classes were exposed as properties
  • more unification of __repr__ for many classes

• 0.6.0~rc4 (Wed, Jun 14 2011)

• Fixes

  • Finished transition to :mod:nibabel conventions in plot_lightbox
  • Addressed :mod:matplotlib.hist API change
  • Various adjustments in the tests batteries (:mod:nibabel 1.1.0 compatibility, etc)

• New functionality

  • Explicit new argument flatten to from_wizard -- default behavior changed if mapper was provided as well

• Enhancements

  • Elaborated __str__ and __repr__ for some Classifiers and Measures

• 0.6.0~rc3 (Thu, Apr 12 2011)

• Fixes

  • Bugfixes regarding the interaction of FlattenMapper and BoxcarMapper that affected event-related analyses.
  • Splitter now handles attribute value None for splitting properly.
  • GNBSearchlight handling of
    roi_ids.
  • More robust detection of mod:scikits.learn and :mod:nipy externals.

• New functionality

  • Added a Repeater node to yield a dataset multiple times and
    Sifter node to exclude some datasets. Consequently, the "nosplitting" mode of Splitter got removed at the same time.
  • :file:tools/niils -- little tool to list details (dimensionality, scaling, etc) of the files in nibabel-supported formats.

• Enhancements

  • Numerous documentation fixes.
  • Various improvements and increased flexibility of null distribution estimation of Measures.
  • All attribute are now reported in sorted order when printing a dataset.
  • fmri_dataset now also stores the input image type.
  • Crossvalidation can now take a custom Splitter instance. Moreover, the default splitter of CrossValidation is more robust in terms of number and type of created splits for common usage patterns (i.e. together with partitioners).
  • CrossValidation takes any custom Node as errorfx argument.
  • ConfusionMatrix can now be used as an errorfx in Crossvalidation.
  • LOE(ACC): Linear Order Effect in ACC was added to
    ConfusionMatrix to detect trends in performances across splits.
  • A Node s postproc is now accessible as a property.
  • RepeatedMeasure has a new 'concat_as' argument that allows results to be concatenated along the feature axis. The default behavior, stacking as multiple samples, is unchanged.
  • Searchlight now has the ability to mark the center/seed of an ROI in with a feature attribute in the generated datasets.
  • debug takes args parameter for delayed string comprehensions. It should reduce run-time impact of debug() calls in regular, non -O mode of Python operation.
  • String summaries and representations (provided by __str__ and __repr__) were made more exhaustive and more coherent. Additional properties to access initial constructor arguments were added to variety of classes.

• Internal changes

  • New debug target STDOUT to allow attaching metrics (e.g. traceback, timestamps) to regular output printed to stdout

  • New set of decorators to help with unittests

  • @nodebug to disable specific debug targets for the duration of the test.

  • @reseed_rng to guarantee consistent random data given initial seeding.

  • @with_tempfile to provide a tempfile name which would get removed upon completion (test success or failure)

  • Dropping daily testing of maint/0.5 branch -- RIP.

  • Collection s were provided with adequate (deep|)copy. And Dataset was refactored to use Collection s copy method.

  • update-* Makefile rules automatically should fast-forward corresponding website-updates branch

  • MVPA_TESTS_VERBOSITY controls also :mod:numpy warnings now.

  • Dataset.__array__ provides original array instead of copy (unless dtype is provided)

Also adapts changes from 0.4.6 and 0.4.7 (see corresponding changelogs).

• 0.6.0~rc2 (Thu, Mar 3 2011)

• Various fixes in the mvpa.atlas module.

• 0.6.0~rc1 (Thu, Feb 24 2011)

• Many, many, many

• For an overview of the most drastic changes :ref:see constantly evolving release notes for 0.6 <chap_release_notes_0.6>

• 0.5.0 (sometime in March 2010)

This is a special release, because it has never seen the general public. A summary of fundamental changes introduced in this development version can be seen in the :ref:release notes <chap_release_notes_0.5>.

Most notably, this version was to first to come with a comprehensive two-day workshop/tutorial.

• 0.4.7 (Tue, Mar 07 2011) (Total: 12 commits)

A bugfix release

• Fixed

  • Addressed the issue with input NIfTI files having scl_ fields set: it could result in incorrect analyses and map2nifti-produced NIfTI files. Now input files account for scaling/offset if scl_ fields direct to do so. Moreover upon map2nifti, those fields get reset.
  • :file:doc/examples/searchlight_minimal.py - best error is the minimal one

• Enhancements

  • :class:~mvpa.clfs.gnb.GNB can now tolerate training datasets with a single label
  • :class:~mvpa.clfs.meta.TreeClassifier can have trailing nodes with no classifier assigned

• 0.4.6 (Tue, Feb 01 2011) (Total: 20 commits)

A bugfix release

• Fixed (few BF commits):

  • Compatibility with numpy 1.5.1 (histogram) and scipy 0.8.0 (workaround for a regression in legendre)
  • Compatibility with libsvm 3.0
  • :class:~mvpa.clfs.plr.PLR robustification

• Enhancements

  • Enforce suppression of numpy warnings while running unittests. Also setting verbosity >= 3 enables all warnings (Python, NumPy, and PyMVPA)
  • :file:doc/examples/nested_cv.py example (adopted from 0.5)
  • Introduced base class :class:~mvpa.clfs.base.LearnerError for classifiers' exceptions (adopted from 0.5)
  • Adjusted example data to live upto nibabel's warranty of NIfTI standard-compliance
  • More robust operation of MC iterations -- skip iterations where classifier experienced difficulties and raise an exception (e.g. due to degenerate data)

About: The library implements Optimized Cutting Plane Algorithm (OCAS) for efficient training of linear SVM classifiers from large-scale data.

Implemented COFFIN framework which allows efficient training of invariant image classifiers via virtual examples.

About: This software is designed for learning translation invariant kernels for classification with support vector machines.

Initial Announcement on mloss.org.

About: LIBSVM is an integrated software for support vector classification, (C-SVC, nu-SVC ), regression (epsilon-SVR, nu-SVR) and distribution estimation (one-class SVM). It supports multi-class [...]

Initial Announcement on mloss.org.

About: LibSGDQN proposes an implementation of SGD-QN, a carefully designed quasi-Newton stochastic gradient descent solver for linear SVMs.

small bug fix (thx nicolas ;)

About: The Easysvm package provides a set of tools based on the Shogun toolbox allowing to train and test SVMs in a simple way.

Fixes for shogun 0.7.3.

About: LaRank is an online solver for multiclass Support Vector Machines.

Initial Announcement on mloss.org.

About: SVM Toolbox fully written in Matlab (even the QP solver). Features : SVM, MultiClassSVM, One-Class, SV Regression, AUC-SVM and Rankboost, 1-norm SVM, Regularization Networks, Kernel Basis Pursuit [...]

Initial Announcement on mloss.org.

About: PyML is an interactive object oriented framework for machine learning in python with a focus on kernel methods.

Initial Announcement on mloss.org.

About: BSVM solves support vector machines (SVM) for the solution of large classification and regression problems. It includes three methods

Initial Announcement on mloss.org.

About: This is a C++ software designed to train large-scale SVMs for binary classification. The algorithm is also implemented in parallel (**PGPDT**) for distributed memory, strictly coupled multiprocessor [...]

Initial Announcement on mloss.org.