Thank you for reporting this issue. Could you describe in more detail (perhaps by adding a screenshot) what you mean by the game getting stuck between villages?
It's as simple as not being able to select another village, whether through arrow keys or on the map. I have to refresh the game. It's an old problem resurfaced.