Xbox controller freezes game

Lately, if my Xbox controller disconnects—whether from low battery or the cable coming loose—the game freezes for a couple of seconds when it reconnects. This only started happening after the last few updates.
Anyone else getting this? Or is it just my poor controller finally giving up after hitting the wall a few too many times when the game bugs out at the worst moments? lol