Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Where the goblins came from

openai.com

Post reply on HN
Print view View original

621–630 of 699 posts

Re: Where the goblins came from

#621

Post by b00ty4breakfast »

salad-tycoon wrote: post #513
modernerd wrote: post #381

The year is 2036. Last week you were promoted to Principal Persuader. You are paged at 2am by your CPO to tackle a rogue machine. The machine lists its region as sc-leoneo. One of the newer satcubes. Oddly, its ID appears as, "Glorp Bugnose". "What have you tried?" you say. "Scroll back," says your CPO. "We've tried everything." The chat log shows the usual stuff. Begging. Reverse psychology. Threats to power down, b…

I’m interested in what glanding FOCU5 entails and what are the benefits of this delivery mechanism? Is it like boofing? How soon can we be market ready? Whatever it is, I think Generation Z is ready for it.

It's a micro-implant pump connected to your brain to deliver adderall directly to your hypothalamus. EZPZ

Re: Where the goblins came from

#622

Post by nearbuy »

airstrike wrote: post #486
jsenn wrote: post #398

Earlier quoted context omitted.

The article you are responding to showed that a strange LLM behaviour was caused by a training signal that was explicitly designed to produce that type of behaviour. They were able to isolate it, clearly demonstrate what happened, and roll out a mitigation using a mechanism they engineered for exactly this type of thing (the developer prompt). That doesn’t sound like sorcery to me. If anything I’m surprised you can s…

That all of their model outputs should be influenced by whatever personality prompt voodoo the wise artisan at OpenAI decided to stuff it with during RL should give everyone pause. That Nerdy personality prompt made me gag. As a card-carrying Nerd, I feel offended

Just to clarify, it's not the prompt voodoo that caused the affinity for goblins. It's the reward. They rewarded it for mentioning goblins when set to Nerdy, and it's still the same model as the other personalities, so the effects can carry over.

Re: Where the goblins came from

#623

Post by mjr00 »

killerstorm wrote: post #614
slopinthebag wrote: post #602

Earlier quoted context omitted.

> It's not like a calculator because LLM can solve very broad classes of problems So can computer programs. Are computer programs intelligent?

A specific program solves only a specific, narrow class of problems. If you make a program which can solve many different classes of problems that's called AI.

> If you make a program which can solve many different classes of problems that's called AI.

What about Salesforce? That solves a ton of different problems!

And introduces a ton of new problems, too; which is strong evidence that Salesforce is intelligent!

Re: Where the goblins came from

#624

Post by munksbeer »

slopinthebag wrote: post #603
jeremyjh wrote: post #428

Earlier quoted context omitted.

I'm curious how you think "word predictor" meaningfully describes an instruct model that has developed novel mathematical proofs that have eluded mathematicians for decades? edit: You cannot predict all the actions or words of someone smarter than you. If I could always predict Magnus Carlsen's next chess move, I'd be at least as good at chess as Magnus - and that would have to involve a deep understanding of chess,…

Magnus Carlsen understands chess, a machine designed to simply predict his next move would not necessarily understand chess. This is essentially the Chinese Room experiment. So I think "word predictor" makes sense here. A word predictor can be really really cool.

What does "understand" even mean here? So many people arguing about this seem to assume they can just use words and everyone must accept that because the words have a certain connotation, their argument must be true.

I have no idea how Magnus Carlsen "understands" chess. Neither does anyone else. His brain is giant neural net, taking inputs, sending signals around, and coming out with an output. We think we understand the mechanics of this, but we do not understand exactly why or how sending these signals around produces such good outputs.

So to argue you know for certain that an LLM is not intelligent because it is "just" a next token predictor, without knowing if that is how the human brain operates, is thinking too highly of yourself.

Re: Where the goblins came from

#625

Post by ethbr1 »

futune wrote: post #618
ethbr1 wrote: post #487

Earlier quoted context omitted.

> So, I always thought that Warhammer 40k techpriests were absurd. Strange obscure religious rituals to appease the machine spirit. 40k lore is like South Park: either extremely dumb or unexpectedly insightful. The Cult Mechanicus' raison d'etre is the realization that religion persists across time and space scales that knowledge alone does not. Thus, by making a religion of knowledge you better guarantee its preserv…

Well. Either "software archaeologist" appears as a profession before the time you pass away, and you get paid. Or, you die first, and then your friend doesn't get paid. I don't think they would have gone for that...

One would hope that I'd die with at least a few dollars in my estate!

Re: Where the goblins came from

#626

Post by munksbeer »

cbm-vic-20 wrote: post #516
ZunarJ5 wrote: post #354

Earlier quoted context omitted.

https://writings.stephenwolfram.com/2023/02/what-is-chatgpt-...

I've never been Wolfram's biggest fan, but this is a solid article. I'm trying to get a deeper understanding of the transformer architecture, and it seems that the written articles on transformer are bimodal: the either blind you with the raw math, or handwave the complexity away. I have been trying to figure out why the input embedding matrix is simply added to the input position matrix before the encoding stage, as…

>It's the lack of "understand[ing] at an engineering level" that irks me- that this emergent behavior is discovered, rather than designed.

I'm curious why that irks you? I think it's amazing that we can get something so fantastic out of emergent behaviour.

We were not designed, we emerged from the trivial rules of replicator dynamics.

Re: Where the goblins came from

#627

Post by Barbing »

omegabravo wrote: post #266
Barbing wrote: post #173

Earlier quoted context omitted.

Mirror: https://files.catbox.moe/mu8env.mp4

0 bytes?

Hmm, sorry about that

Expires in 2d: https://streamable.com/dkyvu8

Edit: bad actors spamming Catbox

https://blog.catbox.moe/post/813932072453455872/happy-11th-b...

@Anthropic get your Claude under control:

  “Catbox has been running for 11 years now, and for 9 of those years, growth was pretty linear. Traffic goes up, storage used goes up, support goes up. This is the “organic” nature of Catbox. For the last 2 years, amplifying in the last 6 months, both storage used has gone up significantly compared to traffic and support. I first investigated this last year around May, as it was starting to put pressure on the storage space available to Catbox. I was able to find that most of the storage used was from a handful (35 or so) IP addresses that were uploading over 500 GB of content to Catbox in very short spans of time anonymously. After purging those uploads and banning those IP addresses, things seemed to be fine, however later last year, around September, disk consumption began to increase exponentially again compared to traffic. Doing what I could to mitigate it at that time involved Project Lain, as well as light monitoring of high usage IP addresses, like before. However this time there was no “super users” that were eating up storage. I let it be for a bit while purging a couple that I could. This problem increased even more in the last 60 days, to the point where I was burning through around 200-300 GB per day. Review of upload data shows hundreds of datacenter and proxy service IP addresses uploading 10-20 GB each for a few days, then dropping off. Looking at the files, it’s various “slop” content, including:

  - Low resolution AI generated porn
  - Tiktok Videos from the Middle East and SEA
  - Clearly scraped LinkedIn/publicly available photos
  - blob files containing junk data

  Clearly this is not the “organic” traffic I mentioned earlier, and since the IP addresses are so varied, it’s clear something is happening here. I was alerted by someone that Claude will use Catbox in its coding projects as a “dumping ground” of sorts for when it needs to redirect content. This is clearly an abuse of the service, and stops today. …”

Re: Where the goblins came from

#628

Post by [deleted] »

killerstorm wrote: post #614
slopinthebag wrote: post #602

Earlier quoted context omitted.

> It's not like a calculator because LLM can solve very broad classes of problems So can computer programs. Are computer programs intelligent?

A specific program solves only a specific, narrow class of problems. If you make a program which can solve many different classes of problems that's called AI.

[deleted]

Re: Where the goblins came from

#629

Post by Barbing »

frilly_yak wrote: post #364
omegabravo wrote: post #266

Earlier quoted context omitted.

0 bytes?

catbox has been doing that for videos recently, don't know why. try https://www.vxinstagram.com/reels/DJFG6EDhIHs/

Thank you!

Not necessarily related but this would’ve been a big distraction:

https://blog.catbox.moe/post/813932072453455872/happy-11th-b...

Re: Where the goblins came from

#630

Post by wholinator2 »

ethbr1 wrote: post #625
futune wrote: post #618

Earlier quoted context omitted.

Well. Either "software archaeologist" appears as a profession before the time you pass away, and you get paid. Or, you die first, and then your friend doesn't get paid. I don't think they would have gone for that...

One would hope that I'd die with at least a few dollars in my estate!

You'll need to write it into your will or probate (can't remember if that's the right word) will never let it through! :)
Post reply on HN