I'd get the 24-105, you've got nice extra reach and IS.
I have never really missed or wanted to go down to f2.8 when using the 24-105. But, if you think you might be in a situation where you need extra light, why not buy the 24-105mm and a 50 1.8. It would still be cheaper than getting a...