Generalized active information: extensions to unbounded domains

In the last three decades, several measures of complexity have been proposed. Up to this point, most of such measures have only been developed for finite spaces. In these scenarios the baseline distribution is uniform. This makes sense because, among other things, the uniform distribution is the mea...

Full description

Saved in:
Bibliographic Details
Published in:arXiv.org 2021-11
Main Authors: Daniel Andrés Díaz-Pachón, Marks, Robert J
Format: Article
Language:English
Subjects:
Entropy
Maximum entropy
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In the last three decades, several measures of complexity have been proposed. Up to this point, most of such measures have only been developed for finite spaces. In these scenarios the baseline distribution is uniform. This makes sense because, among other things, the uniform distribution is the measure of maximum entropy over the relevant space. Active information traditionally assumes a finite interval universe of discourse but can be extended to other cases where maximum entropy is defined. Illustrating this is the purpose of this paper. Disequilibrium from maximum entropy, measured as active information, can be evaluated from baselines with unbounded support.
ISSN:2331-8422
DOI:10.48550/arxiv.2111.06865