‘Not that relevant’ late night TV shows fading to black as even Colbert’s leading ‘Late Show’ sees audience drop 32%