Information and Surprise

We are working on an extension of classical Shannon information theory from partitions to arbitrary covers. This extension aims at situations where decisions are not clear-cut and classifications may be partially overlapping, i.e., not disjoint. Such situations are very common in everyday life, but cannot be treated directly with classical information theory.