As you said leave it on, or you'll be heating the water from cold. If it's on Economy 7 you should have 2 immersion heaters, one will be used Off Peak the other will be there to boost it if you should use all the hot water.
Both can be left on as the internal thermostats will regulate when they...