You'll get an unbalanced turntable, the platter will be falling off, the drive will probably end up out of "whack" and who knows what will happen to the calibration of the motor ...
Alex thinks you wanted to play records in that position, but your post makes clear that's not your intention. But storing the record player vertically will do weird things to the balancing and suspension. Trust me.