Fewer than one in 12 ex-Tory voters think Sunak deserves to win, poll finds