You didn't bend the skeg "slightly turning to manuvere"

. You HIT it good somehow. You may only recall your manuvere as slight OR that being the only hit...
You need to constantly check the lower unit oil if it's getting milky. Do you know how to check and refill? Do you have a fluid pump? Sometimes you will see an oil sheen coming from the prop hub when the water is smooth like glass. Also when really bad there can be some vibration when in gear.
If you don't check it and blow it off for the rest of the season it will blow if bad. Not if but when and usually during a speed run. I know as I've done it before... Not cheap either when that happens....