“People are leaving New York by the thousands, and you’re going to have a hard time ever building it up again.”