Using the 'Save for Web and Devices' is likely your best bet, selecting the '2 Up' tab at the top of it is useful for a direct comparision between existing image and compressed version.
Just take the quality of the jpg down as low as you can/want before you start to notice the compression and loose quality.