Fishing village and former Israeli settlement becomes inhospitable home for tens of thousands of Palestinians