Visible rust or corrosion on the outside of your water heater is more than just a cosmetic issue. It shows wear and tear, which can lead to leaks or even a complete system failure.