entropies --- Entropy Triangles

An R project to work with entropic coordinates, entropy triangles, NIT and EMA as defined in:

• (2010) Two information-theoretic tools to assess the performance of multi-class classifiers

• (2014) 100% Classification Accuracy Considered Harmful: The Normalized Information Transfer Factor Explains the Accuracy Paradox

• (2017) The Evaluation of Data Sources using Multivariate Entropy Tools

• (2018) Assessing Information Transmission in Data Transformations with the Channel Multivariate Entropy Triangle

• (2020) A framework for supervised classification performance analysis with information-theoretic methods

• (2024) A Formalization of Multilabel Classification in Terms of Lattice Theory and Information Theory: Concerning Datasets

Uses packages ggtern and entropy to provide basic functionality.

Forever in beta testing, since this is the main tool to help me develop the theory, for the time being. At present you can:

• measure the performance of supervised classification on multiclassifiers (finished. Papers: 2010, 2014, 2020). Also applies to binary channels.

• measure the information content of multivariate sources (Discrete sources finished. In progress to improve measurements on continuous sources. Paper: 2017)

• explore the relationship between multilabels in a Multilabel Classification task (Discrete sources. Paper: 2024).

• measure the information transmission in multivariate data transformations (Still experimental. Paper: 2018)

You may find the theoretical framework, latest news and further support on the project overview:

• Evaluation of Machine Learning Techniques by Entropic Means

Usage and Examples

You can see here some use cases in this link, where you can find some examples of real case scenarios.

Related packages

Matlab Entropy Triangle Package (2010)

This package was developed by me as the original tool (e.g used in the 2010 paper)

Matlab Entropy Triangle Package

The following packages have been developed by students of mine with my approval

Weka Entropy Triangle plug-in (2015)

There is a plug-in for Weka that lets you evaluate binary classifiers with the ET.

Weka ET plug-in

Python Entropy Triangle Package (2018)

A Python package to work with entropic coordinates and the entropy triangles.

Interested in porting the ET to your favourite language?

Contact me and I will tell you other initiatives that I am aware of.