That's quite remarkable, are all 50D users seeing this same level of noise at ISO400, as that doesn't look right? :o I can see why you are disappointed.
As an example, here a full frame jpg converted from a raw file from a D300, at ISO800 with noise reduction turned off in my processing...