Online Decision Making Under Information-Theoretic Constraints