This paper discusses a conception of physics as a collection of theories that, from a logical point of view, is inconsistent. It is argued that this logical conception of the relations between physical theories is too crude. Mathematical subtleties allow for a much more nuanced and sophisticated understanding of the relations between different physical theories.