> It's a frustrating situation because intelligence agencies obviously do need to keep secrets while at the same time they can use this as justification to keep anything they want secret, even when there is no real national security concern with revealing the information.
I agree and think the way to improve this is to codify into the relevant laws that:
1. If the government claims "state secrets" they have a burden of proof to demonstrate a reasonable probability of specific and tangible harm actually occurring.
2. The judge must evaluate whether the secrecy is justified using a 'balance of harms' weighting that considering the degree and probability of harm to the other party, the public and the constitution.
3. In cases where the judge determines a state secrets exception is justified, the other party may propose remedies that allow the case to proceed while mitigating the harm. The judge may appoint a special master to determine if mitigation is possible.
4. The government must demonstrate a reasonable probability that the information which would be publicly disclosed isn't already known to or assumed by the specific target(s) they are operating against.
The last point is key. It means if the justification for the state secrets exception is to preserve spying against foreign powers and/or terrorists, the govt must show that the relevant foreign powers and terrorists don't already know (or assume) the secret info anyway. For example, Russia and China certainly know that the NSA is doing stuff like Upstream 'full take' because they do it too. We also already know that terrorists already assume that every form of electronic communication can be tapped. Thus, the only people who don't know the "secret" aren't the bad guys but the general public who aren't the supposed target of this anyway (because these spying programs aren't legally supposed to be used for criminal investigation).
I think much of the time, the reason the govt wants to keep these things secret isn't to keep it from the bad guys but rather to keep the voters from finding out and pushing congress and the courts to actually do their job and stop unconstitutional programs.