Projects that are tagged with entropy.


Logo JMLR Information Theoretical Estimators 0.62

by szzoli - April 17, 2016, 17:19:00 CET [ Project Homepage BibTeX BibTeX for corresponding Paper Download ] 96499 views, 18813 downloads, 2 subscriptions

About: ITE (Information Theoretical Estimators) is capable of estimating many different variants of entropy, mutual information, divergence, association measures, cross quantities and kernels on distributions. Thanks to its highly modular design, ITE supports additionally (i) the combinations of the estimation techniques, (ii) the easy construction and embedding of novel information theoretical estimators, and (iii) their immediate application in information theoretical optimization problems.

Changes:
  • Von Mises expansion based estimators: included for 7 unconditional quantities (Shannon entropy, Shannon mutual information, Kullback-Leibler divergence, Rényi divergence, Tsallis divergence, Pearson Chi^2 divergence, Hellinger distance.

  • Analytical value (for Gaussian random variables) and quick test: added for the Hellinger distance.


Logo MIToolbox 2.1.2

by apocock - January 10, 2016, 22:19:30 CET [ Project Homepage BibTeX BibTeX for corresponding Paper Download ] 24469 views, 4302 downloads, 2 subscriptions

About: A mutual information library for C and Mex bindings for MATLAB. Aimed at feature selection, and provides simple methods to calculate mutual information, conditional mutual information, entropy, conditional entropy, Renyi entropy/mutual information, and weighted variants of Shannon entropies/mutual informations. Works with discrete distributions, and expects column vectors of features.

Changes:

Relicensed as BSD. Added checks to catch MATLAB inputs that aren't doubles.


Logo JEMLA 1.0

by bathaeian - January 4, 2015, 08:34:49 CET [ Project Homepage BibTeX Download ] 1505 views, 463 downloads, 3 subscriptions

About: Java package for calculating Entropy for Machine Learning Applications. It has implemented several methods of handling missing values. So it can be used as a lab for examining missing values.

Changes:

Discretizing numerical values is added to calculate mode of values and fractional replacement of missing ones. class diagram is on the web http://profs.basu.ac.ir/bathaeian/free_space/jemla.rar