Conservative party staffers — and the people most likely to vote for them — despair at their languishing pitch