The cross entropy between two probability distributions over the same underlying set of events measures the average number of bits needed to identify an event drawn from the set. The […]