Potter on family death threats: ‘You have to put it aside’