That is common with a skeg hung rudder. Even worse if it's a full keel.

I can only guess (I've never seen the underbody) but you probably have a cutaway forefoot and a skeg hung rudder. If that's the case what you're experiencing can be normal.

If it starts to go a direction you don't want,, put it in forward, a burst of throttle, and get the bow to start to rotate the direction you want. Then (quickly) put it back in reverse and give it a jerk of throttle and see if it corrected, then cautiously continue in reverse or do it again. Ya never know. I've had people ask me if I have a bow thruster because I have so much control. Then again,,,,, sometimes it doesn't work and I look like I haven't a clue what I'm doing. For our boat you have to figure out how much inertia is needed in both forward and reverse to get it to track.

Boat's with that kind of underbody are made to go forward, (always forward and for thousands of miles), reverse is not important. Once you understand that, it's ok.