You are right, which means that getting some regular sunshine through your lens is the best prevention. Leave them on a window sill for a while if not using them. Fungus also needs a tiny amount of moisture, so keep them in a case with a dessicant, you can get things you dry in the oven on Evilbay.