For the last 2 yrs I've had a 5dii, 16-35, 50mm & 70-200, so basically your focal length setup. In the end, when I wanted v good IQ I shot with the lenses I had and adapted my style, esp with the prime on, but the 28-135 I also had was so damn versatile it was often used. It's not too fast though, so there were times I when it wasn't suitable.
I've (literally this week) re-evaluated my lens line-up and I'm probably going to buy a 24-70 f2.8 to fill the mid range, but I know I'll miss the longer end on a walk around zoom. The whole point of these lenses are their versatility, and having moderately wide to moderately tele, with IS, is not to be underestimated. If f4 is enough, then the 24-105 is a v good option.