You can grab a corner of the crop and then drag it until the orientation switches. It will resist change to begin with and then, once you go so far, it will flip.
Tag your portrait images and rotate them before cropping then set them back to portrait once cropped.