i went from a 300D to a 20D and found the handling, particularly having the additional wheel on the back of the camera, to be a massive step up. The 40D sounds like a good choice to me and a substantial step up in functionality.
Just for the record, I'm not trying to imply that the 450 is a bad camera in any way.