Efficient Bayesian estimation of permutation entropy with Dirichlet priors

Estimation of permutation entropy (PE) using Bayesian statistical methods is presented for systems where the ordinal pattern sampling follows an independent, multinomial distribution. It is demonstrated that the PE posterior distribution is closely approximated by a standard Beta distribution, whose...

Full description

Saved in:
Bibliographic Details
Published in:arXiv.org 2021-04
Main Authors: Little, Douglas J, Toomey, Joshua P, Kane, Deb M
Format: Article
Language:English
Subjects:
Bayesian analysis
Computation
Dirichlet problem
Entropy
Optical feedback
Permutations
Probability distribution functions
Self-similarity
Semiconductor lasers
Statistical methods
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Estimation of permutation entropy (PE) using Bayesian statistical methods is presented for systems where the ordinal pattern sampling follows an independent, multinomial distribution. It is demonstrated that the PE posterior distribution is closely approximated by a standard Beta distribution, whose hyperparameters can be estimated directly from moments computed analytically from observed ordinal pattern counts. Equivalence with expressions derived previously using frequentist methods is also demonstrated. Because Bayesian estimation of PE naturally incorporates uncertainty and prior information, the orthodox requirement that \(N \gg D!\) is effectively circumvented, allowing PE to be estimated even for very short time series. Self-similarity tests on PE posterior distributions computed for a semiconductor laser with optical feedback (SLWOF) system show its PE to vary periodically over time.
ISSN:2331-8422
DOI:10.48550/arxiv.2104.08991