ML Community Day is November 9! Join us for updates from TensorFlow, JAX, and more Learn more


Mutual information estimators and helpers.


lower_bound_barber_agakov(...): Lower bound on mutual information from [Barber and Agakov (2003)][1].

lower_bound_info_nce(...): InfoNCE lower bound on mutual information.

lower_bound_jensen_shannon(...): Lower bound on Jensen-Shannon (JS) divergence.

lower_bound_nguyen_wainwright_jordan(...): Lower bound on Kullback-Leibler (KL) divergence from Nguyen at al.