US Supreme Court justice refuses to recuse himself after flag controversy