My position stuck on the map

The ‘my position’ place is set along a highway, and won't budge. So all routes are now planned from this place instead of where I actually am. If I press the little goal button it will highlight the place where I am, but when it starts a route it always takes this arbitrarily placed spot along the motorway.

It's not a GPS problem as Google maps works fine. I've tried shutting down the app, restarting my phone, nothing helps.