Probably.
The electorate do not behave like ping pong balls but follow trends ("swings") and I suspect, given that the "Shires" will always vote Conservative, floating voters are unlikely to produce the swing necessary to unseat the Conservatives next time, and if the fixed term parliament law has been revoked by then, that may be when the Conservatives choose.
Of course if Labour elect further party leaders who are as detestable as Oswald Mosley it might be time for the long awaited liberal revival or the return of Tony Blair who, like him or not, understood politics as few labour leaders have!