This part continues to bug me in ways that I can't seem to find the right expression for: > Previous Claude models often made unnecessary refusals that suggested a lack of contextual understanding. We’ve made meaningful progress in this area: Opus, Sonnet, and Haiku are significantly less likely to refuse to answer prompts that border on the system’s guardrails than previous generations of models. As shown below, the…
The sense of entitlement is epic. You're offended are you? Are you offended that Photoshop won't let you edit images of money too? Its not your model. You didn't spend literally billions of dollars developing it. So you can either use it according to the terms of the people who developed it (like literally any commercially available software ever) or not use it at all.
Claude 3 model family
681–690 of 723 posts
Re: Claude 3 model family
#682This part continues to bug me in ways that I can't seem to find the right expression for: > Previous Claude models often made unnecessary refusals that suggested a lack of contextual understanding. We’ve made meaningful progress in this area: Opus, Sonnet, and Haiku are significantly less likely to refuse to answer prompts that border on the system’s guardrails than previous generations of models. As shown below, the…
You don't think that if the hammer company had a way (that cost them almost nothing) to make sure that the hammer its never used to attack human beings they wouldn't add such feature? I think many would, if anything by pressure of their local goverment or even the competition ("our hammers can't hurt your baby on accident like those other companies!") , but its impossible to add such feature to hammer; so maybe the l…
Re: Claude 3 model family
#683Earlier quoted context omitted.
LLMs are intuitive computing algorithms, which means they only mimic the subconscious faculties of our brain. You’re referencing the need for careful systematic logical self-aware thinking, which is a great point! You’re absolutely right that LLMs can only loosely approximate it on their own, and not that well. Luckily, we figured out how to write programs to mimic that part of the brain in the 70s ;)
> Luckily, we figured out how to write programs to mimic that part of the brain in the 70s What’s this in reference to?
The scruffies spent decades being shit on by the other camp as being lazy and simple-minded (due to a perception of “brute forcing” problems), only to find more success than most of them had ever imagined. I think anyone who says they were confident that ML-based NLP models could one day not only predict text, but also perform intuition, is either a revisionist or a prophet.
The whole Neat field got kinda stuck when we translated the low hanging fruit to symbolic algorithms (Simon & Newell’s Problem Solving being the most interesting IMO), but we had no way to test them. As another commenter alluded to, these systems lacked any “intuitive”(aka subconscious, fuzzy, approximate) faculties, so their high-level strategies could never work in the messy real world, mostly because it’s pretty impossible to definitively tell what information is relevant and what information isn’t to any given problem. This is called the problem of contextual “attention and selection”, and the problem more generally “the frame problem”.
Now that we have systems that mimic human subconscious intuition AND systems that mimic human self conscious reason, of course the next step is… declare complete victory and abandon the latter group forever as trash, apparently.
This is all a super biased take from someone who only got into this specific debate last year, tho I promise I do have some relevant credentials and have been working full time on this for close to a year. I strongly believe that LLMs are about to unlock the first (true) Cognitive Revolution.
Re: Claude 3 model family
#684Earlier quoted context omitted.
To be fair, the search engine monopoly has done a pretty good job of making that information quite difficult to actually find. Not impossible, but much more difficult than you might assume.
https://wikileaks.org/gifiles/attach/130/130179_Secrets_of_M... seems to be a cookbook, but I'm no chemist. took me a couple of minutes via Google.
Re: Claude 3 model family
#685Earlier quoted context omitted.
> it is impossible to use a nuke without negatively affecting other people Should I be allowed to own C4 explosives and machine guns? Because I can use C4 explosives in a way that doesn't harm other people by simply detonating it on my private property. I am confused about what the limiting principle is supposed to be here. Do we just allow people to have access to technology of arbitrary power as long as there exist…
Yes you should be allowed to own C4 and machine guns. And you can. Because you can use them in a way that doesnt hurt other people, we as a society allow that.
Re: Claude 3 model family
#686Earlier quoted context omitted.
This is a weird demand to have in my opinion. You have plenty of applications on your computer and they only do what they were designed for. You can't ask a note taking app (even if it's open soured) to do video editing, unless you modify the code.
My note taking app has never refused my input of a swear word.
Re: Claude 3 model family
#687Earlier quoted context omitted.
I find it incredibly hard to believe we stumbled upon an efficient architecture that requires nothing but more compute not 10 years after the AI winter thawed. That's incredibly optimistic to the point of blind hope. What is your background and what makes you think we've somehow already figured everything out?
I have been working on architectures in this field for almost a decade now and I've seen firshand how things have changed. It might seem hard to believe if you have been to university ~10 years ago and only know the state of deep learning from the early revolutions back then, but we are in a totally different era now. With the transformer, we now have a true general-purpose, efficiently scalable, end-to-end different…
Re: Claude 3 model family
#688Earlier quoted context omitted.
> Luckily, we figured out how to write programs to mimic that part of the brain in the 70s What’s this in reference to?
The field of Symbolic Artificial Intelligence which is still (for now…) a majority of what is taught in American AI courses IME. It’s also the de facto technical translation of Cognitive Science. There’s a long debate between the two “camps”, which were called the neats (Turing, Minsky, McCarthy, etc) and the scruffies (the people behind ML). The scruffies spent decades being shit on by the other camp as being lazy a…
Re: Claude 3 model family
#689Earlier quoted context omitted.
Hi Simon, Big fan of your work with the LLM tool. I have a cool use for it that I wanted to share with you (on mac). First, I created a quick action in Automator that recieves text. Then I put together this script with the help of ChaptGPT: escaped_args="" for arg in "$@"; do escaped_arg=$(printf '%s\n' "$arg" | sed "s/'/'\\\\''/g") escaped_args="$escaped_args '$escaped_arg'" done result=$(/Users/XXXX/Library/Python/…
Does someone know a similar tool like Automator on Linux for this particular use case?
Re: Claude 3 model family
#690Earlier quoted context omitted.
The sense of entitlement is epic. You're offended are you? Are you offended that Photoshop won't let you edit images of money too? Its not your model. You didn't spend literally billions of dollars developing it. So you can either use it according to the terms of the people who developed it (like literally any commercially available software ever) or not use it at all.
Fairly rich coming from an account where all it does is call others hacks.