ENTROPY: Stata module to compute Shannon, Renyi, HCT entropy & Hill numbers
Muhammad Rashid Ansari
Abstract
Muhammad Rashid Ansari
Abstract
entropy calculates Shannon(1948) entropy, alpha parameterized Renyi(1961), HCT {Havrda, Charvat (1967), Tsallis (1988)} entropy and Hill's (1973) diversity measure for given parameter value. Renyi and HCT are special case of Shannon entropy and tend to Shannon as alpha --> 1. Renyi and HCT reproduce Shannon results for alpha=1, while Hill’s measure equals to exponential (Shannon) for alpha(1).
A significance statement is not available in the OpenAlex record.
A contribution statement is not available in the OpenAlex record.
Method details are not available in the OpenAlex metadata.
Findings are not separately available in the OpenAlex metadata.
Limitations are not available in the OpenAlex metadata.
Application details are not available in the OpenAlex metadata.
entropy calculates Shannon(1948) entropy, alpha parameterized Renyi(1961), HCT {Havrda, Charvat (1967), Tsallis (1988)} entropy and Hill's (1973) diversity measure for given parameter value. Renyi and HCT are special case of Shannon entropy and tend to Shannon as alpha --> 1. Renyi and HCT reproduce Shannon results for alpha=1, while Hill’s measure equals to exponential (Shannon) for alpha(1).
Key concepts: Rényi entropy, Mathematics, Tsallis entropy, Shannon's source coding theorem, Min entropy, Entropy in thermodynamics and information theory, Maximum entropy probability distribution, Joint quantum entropy