Kullback–Leibler divergence - Axioms of Choice

Processing math: 50%

Kullback–Leibler divergence

Function

context	$p, q$ … probability distributions
definition	todo: type
definition	$D_{\mathrm{KL}}(P\\|Q) = \int_{-\infty}^\infty p(x) \, \log \left( \dfrac{p(x)}{q(x)}\right) {\rm d}x$

Requirements

Cumulative distribution function, Natural logarithm of real numbers

Classical microcanonical entropy

Log In

Improvements of the human condition