Earlier quoted context omitted.
Allowing students to (allegedly) be harassed on the basis of their race is what is under contention, not the broader notion of academic freedom.
That's the excuse being used, sure.
While what the Trump admin is doing is wrong, Harvard has given them ample cover for their actions. It would be intellectually lazy to assert, even implicitly, that Harvard has no responsibility over the current state of affairs.