Design of new kernel density estimator for entropy maximization in independent component analysis
Woong Myung Kim, Hyon Soo Lee
Abstract
Woong Myung Kim, Hyon Soo Lee
Abstract
This paper proposes a new algorithm for estimating the score function using maximum entropy theory and kernel density estimation. The main idea is to control smoothing parameters for maximizing entropy in kernel density estimation. To generate score function, directly partial derivative equation from kernel density estimator is derived. To find suitable smoothing parameter, we adopted gradient descent method. Finally, the new kernel density estimator is experimented in blind separation and discuss on properties of the proposed learning algorithm.
A significance statement is not available in the OpenAlex record.
A contribution statement is not available in the OpenAlex record.
Method details are not available in the OpenAlex metadata.
Findings are not separately available in the OpenAlex metadata.
Limitations are not available in the OpenAlex metadata.
Application details are not available in the OpenAlex metadata.
This paper proposes a new algorithm for estimating the score function using maximum entropy theory and kernel density estimation. The main idea is to control smoothing parameters for maximizing entropy in kernel density estimation. To generate score function, directly partial derivative equation from kernel density estimator is derived. To find suitable smoothing parameter, we adopted gradient descent method. Finally, the new kernel density estimator is experimented in blind separation and discuss on properties of the proposed learning algorithm.
Key concepts: Variable kernel density estimation, Multivariate kernel density estimation, Kernel smoother, Kernel principal component analysis, Kernel embedding of distributions, Mathematics, Kernel density estimation, Estimator