Andrew Bailey warns of dangers of moving ‘too much or too quickly’ after first reduction in more than four years