mloss.org Model Monitorhttp://mloss.orgUpdates and additions to Model MonitorenMon, 17 Aug 2009 11:05:06 -0000Model Monitor 1.0http://mloss.org/software/view/137/<html><p>Model Monitor is a Java toolkit for the systematic evaluation of classifiers under changes in distribution. It provides methods for detecting distribution shifts in data, comparing the performance of multiple classifiers under shifts in distribution, and evaluating the robustness of individual classifiers to distribution change. As such, it allows users to determine the best model (or models) for their data under a number of potential scenarios. Additionally, Model Monitor is fully integrated with the WEKA machine learning environment, so that a variety of commodity classifiers can be used if desired. </p> <p>Some of the techniques implemented in the software come from our papers: </p> <p>David A. Cieslak and Nitesh V. Chawla "Detecting Fracture Points in Classifier Performance", 7th IEEE Conference on Data Mining, pp. 123-132, 2007. </p> <p>David A. Cieslak and Nitesh V. Chawla "A Framework for Monitoring Classifiers' Performance: When and Why Failure Occurs?", Knowledge and Information Systems 2008. </p> <p>Interested parties can find them on our website: </p> <p>http://www.nd.edu/~dial </p></html>Troy Raeder, Nitesh V. ChawlaMon, 17 Aug 2009 11:05:06 -0000http://mloss.org/software/rss/comments/137http://mloss.org/software/view/137/machine learningdata miningnips2008distribution shiftevaluation