The great migration from Elon Musk’s X has seen users, especially progressives, retreat into one particular silo