Live data from Hacker News

Anthropic: Expanding Access to Claude for Government

anthropic.com

61–70 of 99 posts

Re: Anthropic: Expanding Access to Claude for Government

#61

I find all of the virtue signalling from AI companies exhausting.

They have to do it for recruitment's sake. Enough of the talent they need live in Ivory Tower land where the base world-model / philosophy is super far to the progressive direction vs those Americans who work in industry.

Re: Anthropic: Expanding Access to Claude for Government

#62
post #32

Earlier quoted context omitted.

It's interesting how we dismiss anyone caring about things other than profit as virtue signally. Anthropic was founded by people who seemed to legitimately care about AI safety. It's possible the current conglomeration that is the company doesn't, but I wouldn't be so quick to assume that.

It's possible that they have the best intentions but are woefully misguided, like pretty much the average sv techno-optimist.

The market will decide if that's right.

Re: Anthropic: Expanding Access to Claude for Government

#63
post #56
post #48

Earlier quoted context omitted.

I haven't tried more than a handful of queries, but I think I've gotten 100% rate of hallucination or generic useless response to specific question.

Can I try your question? Just curious.

I don't remember exactly, but they were broadly "How can I do $WEIRD_NICHE_THING with $GENERAL_FEATURE of gradle / some java library?"

Re: Anthropic: Expanding Access to Claude for Government

#64

So, basically all "confidential" information, if you are a subject "of interest", will be in the cloud and used to train models that can spit it out again. And the models will confabulate stories about you. The can call themselves "sonnet", "bard", "open" and a whole plethora of other positive things. What remains is that they go into the direction of Palantir and the rest is just marketing.

That's not at all evidenced by the link. The link simply says that their language model will be available on AWS GovCloud, and that they've created these specific exceptions to their usage policy.

https://support.anthropic.com/en/articles/9528712-exceptions...

The things which you're allowing yourself to imagine, don't exist in the reality of information we're discussing here

Re: Anthropic: Expanding Access to Claude for Government

#65
post #52

Is there really anyone who thinks this is a good idea? AI systems routinely spit out false information. Why would a system like that be anywhere near a Government? Perhaps (optimistically) this is just a credibility-grab from Anthropic, with no basis in fact.

From the link,

> Government agencies can use Claude to provide improved citizen services, streamline document review and preparation, enhance policymaking with data-driven insights, and create realistic training scenarios. In the near future, AI could assist in disaster response coordination, enhance public health initiatives, or optimize energy grids for sustainability.

Re: Anthropic: Expanding Access to Claude for Government

#66

Earlier quoted context omitted.

Okay, but you still need to debug the program. If your program must give correct results you still need to check the program output against every case. There's no free lunch there.

Speaking generally: The program doesn't always have to give correct results. The program just needs to reduce 30k documents down to 200 documents for human review. You're comparing LLMs to a hypothetical alternative where a human reviews all 30k documents in detail. But the real alternative is often just a worse quality sieve where more errors blunder their way through the existing flawed processes. LLMs can improve…

Yeah I mean I had to move some big folders from server to server last week, maybe about 400. It was too random to script (would take longer to write the script) and I, as a human, doing it manually, still fucked up about 10%. 30k to 200 is exactly the stuff I'm talking about. The other people's existential dread is showing in this thread.

Re: Anthropic: Expanding Access to Claude for Government

#67
post #14

> Claude offers a wide range of potential applications for government agencies, both in the present and looking toward the future. Government agencies can use Claude to provide improved citizen services, streamline document review and preparation, enhance policymaking with data-driven insights, and create realistic training scenarios. In the near future, AI could assist in disaster response coordination, enhance publ…

Its possible that you may have misunderstood what happened.

Firstly, anthropic made an LLM, exposed it to the internet, and provided these terms of acceptable use.

https://www.anthropic.com/legal/archive/4903a61b-037c-4293-9...

There was no need for cynicism or kool aid at this stage.

Later on, presumably now-ish, anthropic changed the usage policy, to add an exception.

https://support.anthropic.com/en/articles/9528712-exceptions...

> Exceptions to our Usage Policy

> Updated today

The exception is that, starting from now,

> Anthropic may enter into contracts with government customers that tailor use restrictions to that customer’s public mission and legal authorities if, in Anthropic’s judgment, the contractual use restrictions and applicable safeguards are adequate to mitigate the potential harms addressed by this Usage Policy.

I don't think any kool aid or cynicism is needed.

The change is that, if anthropic think the client use case meets the listed humanitarian goals, then the client may use the LLM.

Re: Anthropic: Expanding Access to Claude for Government

#68

Earlier quoted context omitted.

Speaking generally: The program doesn't always have to give correct results. The program just needs to reduce 30k documents down to 200 documents for human review. You're comparing LLMs to a hypothetical alternative where a human reviews all 30k documents in detail. But the real alternative is often just a worse quality sieve where more errors blunder their way through the existing flawed processes. LLMs can improve…

The epistemology problem never goes away. How should I have any confidence that it's correctly flagging things for review? I need to go through 28800 documents to see if it missed anything. You're right, I am comparing it to that alternative. There are fields and applications where this is necessary. I do not know if drilling reports are one of them. If you can tolerate a large false negative rate then great. But if…

You can't have confidence, but my point is you often don't need confidence. All you need is an improvement on the flawed status quo.

Re: Anthropic: Expanding Access to Claude for Government

#69
post #52

Is there really anyone who thinks this is a good idea? AI systems routinely spit out false information. Why would a system like that be anywhere near a Government? Perhaps (optimistically) this is just a credibility-grab from Anthropic, with no basis in fact.

From the link, > Government agencies can use Claude to provide improved citizen services, streamline document review and preparation, enhance policymaking with data-driven insights, and create realistic training scenarios. In the near future, AI could assist in disaster response coordination, enhance public health initiatives, or optimize energy grids for sustainability.

Yeah, I read it. That just says what they want to do, and nothing about why it's a good idea. You would have to have your brain plugged in upside-down to even consider using an LLM to "enhance policymaking".

Re: Anthropic: Expanding Access to Claude for Government

#70
post #63
post #56

Earlier quoted context omitted.

Can I try your question? Just curious.

I don't remember exactly, but they were broadly "How can I do $WEIRD_NICHE_THING with $GENERAL_FEATURE of gradle / some java library?"

"do a web search to validate what you've told me"
Post reply on HN