Lawrence Okolie has been forced to withdraw from his heavyweight clash with rival Londoner Richard Riakporhe.