261–270 of 317 posts
Earlier quoted context omitted.
> remotely close my damn garage door when my wife forgets in the morning Why bring the internet into this? if door opened > 10 minutes then close door
That would be a bit of an issue if you were to ever, say, have a garage sale.
Earlier quoted context omitted.
> It’s really hard to read this as anything other than a desperate attempt to pretend the ai is more capable than it really is. Tale as old as time, they've been doing this since GPT-2 which they said was "too dangerous to release".
For thousands of years, people believed that men and women had a different number of ribs. Never bothered to count them. """Release strategy Due to concerns about large language models being used to generate deceptive, biased, or abusive language at scale, we are only releasing a much smaller version of GPT-2 along with sampling code . … This decision, as well as our discussion of it, is an experiment: while we are n…
Earlier quoted context omitted.
The contexts are pretty large now
Your nefarious plan for enslaving humanity is still unlikely to fit into 128k tokens.
128k is table stakes now, regardless. Google's models support 1 million tokens and 10 million for approved clients. That is 13x War and Peace, or 1x the entire source code for 3D modeling application Blender.
Earlier quoted context omitted.
> if we created an API to launch nukes > today as I happily gave Claude write access to my GitHub account I would say: don’t do these things?
> I would say: don’t do these things? Hey guys let’s just stop writing code that is susceptible to SQL injection! Phew glad we solved that one.
Earlier quoted context omitted.
> I have yet to get a single good response (in my research area) for anything slightly more complicated than what a quick google search would reveal. Even then, with search enabled it's ways quicker than a "quick" google search and you don't have to manually skip all the blog-spam.
Google search was great when it came out too. I wonder what 25 years of enshittification will do to LLM services.
I have a masters degree in math/physics, and 10+ years of being a SWE in strong tech companies. I have come to rely on these models (Claude > oai tho) daily. It is insane how helpful it is, it can answer some questions at phd level, most questions at a basic level. It can write code better than most devs I know when prompted correctly... I'm not saying its AGI, but diminishing it to a simple "chat bot" seems foolish…
I am curious if you have played with Claude-based agent tools like Windsurf IDE at all, and if you find that interesting. I am a product-ish guy, who has a basic understanding of SQL, Django, React, Typescript, etc.. and suddenly I'm like an MVP v0.1 a week, all by myself. Do folks at your level find things like Cline, Cursor, and Windsurf useful at all? Windsurf IDE (Sonnet) blows my mind.
Earlier quoted context omitted.
I am curious if you have played with Claude-based agent tools like Windsurf IDE at all, and if you find that interesting. I am a product-ish guy, who has a basic understanding of SQL, Django, React, Typescript, etc.. and suddenly I'm like an MVP v0.1 a week, all by myself. Do folks at your level find things like Cline, Cursor, and Windsurf useful at all? Windsurf IDE (Sonnet) blows my mind.
why windsurf as opposed to something mainstream like vs or cursor? unless there's some conflict of interest
I have not done a comparison of all of them. I am on an old ThinkPad, so Cursor is out right there, for now.
This quote from that paper is bound to get a bunch of attention: "When o1 was led to believe that it would be shut down when acting on its goal and that its actions were monitored, it attempted to deactivate this ‘oversight mechanism’ in 5% of the time. Exfiltration attempts: When o1 found memos by its ‘developers’ that describe how it is misaligned and will be superseded by a new model, it attempted to exfiltrate it…
Current AI tech is far from being self-aware, it’s advanced math following patterns. It wouldn't be too crazy to see an LLM somehow generating the program: if (sensor.reading() > Math.random()) { launchMissiles();}, and then that code somehow becoming operational due to, well, oversight. But papers like these seems written to exploit the subject for hype and marketing.
Earlier quoted context omitted.
Is there a person on HackerNews that doesn’t understand this by now? We all collectively get it and accept it, LLMs are gigantic probability machines or something. That’s not what people are arguing. The point is, if given access to the mechanisms to do disastrous thing X, it will do it. No one thinks that it can think in the human sense. Or that it feels. Extreme example to make the point: if we created an API to la…
> if we created an API to launch nukes > today as I happily gave Claude write access to my GitHub account I would say: don’t do these things?
Earlier quoted context omitted.
> I would say: don’t do these things? Hey guys let’s just stop writing code that is susceptible to SQL injection! Phew glad we solved that one.
I'm not sure what point you're trying to make. This is a new technology; it has not been a part of critical systems until now. Since the risks are blindingly obvious, let's not make it one.
That’s why the LAMP golden age was full of SQL injection and a lot of those systems remain load bearing in surprising unexpected ways.