In a semantics way this is correct. However using all of the tools of basic human communication and the context in which Scalia spoke there is little doubt what he meant.
To be fair, Sotomayor interrupted EVERYONE in that hearing. And the Roberts doesn't think the Act is fair, but he wants Congress to fix it, rather than it become unconstitutional.