Cannot delete intermediate stops

On the iPhone when looking at the list of stops there is no option (that I could see) to remove the stop. On the web version there is a little X on the right and the stop is gone.

I had to try to eliminate stops because I was in the middle of my trip and it kept showing me the route from the beginning as if I had not started yet. I could not figure out how to start a trip from my current position so I was reusing the original plan.

The web version is pretty easy to use on a large screen of the desktop computer but the small screen on the phone is murder.