Latent, Manifest, and Broken Symmetry: A Bottom-up Approach to Symmetry, with Implications for Complex Networks