Description:

An important problem in robotics is the empirical evaluation of classification algorithms that allow a robotic system to make accurate categorical predictions about its environment. Current algorithms are often assessed using sample statistics that can be difficult to interpret correctly and do not always provide a principled way of comparing competing algorithms. To offer a probabilistic alternative, we recently described a Bayesian framework for inferring on balanced accuracies. So far, however, this approach has itself been limited to binary classification. Here, we generalize the balanced accuracy to multiclass problems. Our approach uses Fourier transforms of class-specific performance distributions to obtain a posterior distribution that can be used to evaluate and compare competing classifiers. To facilitate its use, we provide an open-source MATLAB implementation.

Changes to previous version:

Initial Announcement on mloss.org.

BibTeX Entry: Download

Supported Operating Systems: Macosx, Windows, Ubuntu

Data Formats: Any Format Supported By Matlab

Tags: Accuracy

Archive: download here

Comments

No one has posted any comments yet. Perhaps you'd like to be the first?

Leave a comment

You must be logged in to post comments.