The return to office compromise created a nightmare for middle managers