At the times you just want something like a compact, no I don't think you will notice much difference.
Obviously if you look for it, you will find it. But if you are going to look that close, you would have not taken a compact!
At the same time, there is every possibility that the shot with the compact may turn out better, because the circumstances at the time may mean that you could use it more effectively.
Bumping crowds or rocking ferries etc. are not the easiest places to use a large camera. Also, if you are more likely to take out and use the compact, you are more likely to get some good shots.
For a travel camera ! also think that a good zoom range is essential, as is the stabilisation. Being able to zoom in can give better results then having less zoom and cropping, as I think you mentioned before with your 82.
I have used the TZ series for travel since the TZ1, and have got fantastic results from them, in part because you can fill the frame with what you want and not crop. Often when travelling or just out and about, you can't zoom with your feet.
In good light, two uncropped photos, one taken with the TZ60 and one with the G9 of "average" scenes would not appear much different to each other printed 10X8, and possibly not even bigger. As I said, you will of course find a difference if you look for it.
I have a photo taken with a TZ10 and printed 150cm wide (it covers the wall behind the projector screen) and you have to get about 2' from it before you see any loss of quality, but there is not much fine detail in it.
Use the camera you feel will be easiest and most convenient to use when out and about, then at least it will get used