1st Edition
Handbook of Differential Entropy
Probability in Brief
Probability Distributions
Expectation and Moments
Random Processes
Probability Summary
The Concept of Entropy
Discrete Entropy
Differential Entropy
Interpretation of Differential Entropy
Historical and Scientific Perspective
Entropy for Discrete Probability Distributions
Differential Entropies for Probability Distributions
Differential Entropy as a Function of Variance
Applications of Differential Entropy
Estimation of Entropy
Mutual Information
Transfer Entropy
Appendices
Derivation of Maximum Entropy Distributions under Different Constraints
Moments and Characteristic Function for the Sine Wave Distribution
Moments, Mode, and Characteristic Function for the Mixed-Gaussian Distribution
Derivation of Function L(α) Used in Derivation for Entropy of Mixed-Gaussian Distribution
References to Formulae Used in This Text
Bibliography
Biography
Joseph V. Michalowicz is a consultant with Sotera Defense Solutions. He retired from the U.S. Naval Research Laboratory as head of the Sensor and Data Processing Section in the Optical Sciences Division. He has published extensively in the areas of mathematical modeling, probability and statistics, signal detection, multispectral infrared sensors, and category theory. He received a Ph.D. in mathematics with a minor in electrical engineering from the Catholic University of America.
Jonathan M. Nichols is a member of the Maritime Sensing Section in the Optical Sciences Division at the U.S. Naval Research Laboratory. His research interests include signal and image processing, parameter estimation, and the modeling and analysis of infrared imaging devices. He received a Ph.D. in mechanical engineering from Duke University.
Frank Bucholtz is head of the Advanced Photonics Section at the U.S. Naval Research Laboratory. He has published in the areas of microwave signal processing and microwave photonics, fiber optic sensors, micro-optical devices, nonlinear dynamics and chaos, hyperspectral imaging systems, and information theory. His current research focuses on optical components for digital communications. He received a Ph.D. in physics from Brown University.
