Boris Johnson says deal ‘very difficult’ to vote for but concedes public want an end to constant fights