Look - I'm an awkward sod!

If I am on Leg 1 and get to CP3 - then I make the bizarre decision to go to Lamplugh down the track, and make my way back to the Start/Finish area via the road - would I be DQd for missing the flags?