Fury ‘terrified’ of giving up boxing