tf_agents.agents.ppo.ppo_utils.nested_kl_divergence

Given two nested distributions, sum the KL divergences of the leaves.