Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Wolfram Alpha and ChatGPT

writings.stephenwolfram.com

Post reply on HN
Print view View original

111–120 of 309 posts

Re: Wolfram Alpha and ChatGPT

#111

Post by janalsncm »

TylerLives wrote: post #100
pbw wrote: post #67

Earlier quoted context omitted.

Plenty of MLM's will be "anything goes". That OpenAI does not want its brand associated with the worst things its users dream up, especially this early while it's still a research preview, makes sense to me. OpenAI was bold enough to put out a live LLM for people to hammer on, something several other companies declined to do. I think they've done a good job keeping the plane flying while plugging holes. Not a perfect…

Can you give some examples of bad things people could do without OpenAI's restrictions?

Apparently, write inappropriate jokes.

Re: Wolfram Alpha and ChatGPT

#112

Post by pjlegato »

agentwiggles wrote: post #18

I'm almost offended by the "cubic light year of ice cream" answer from ChatGPT. It's obviously ridiculous but is also a fairly simply dimensional analysis problem. Do the damn math, don't wag your finger at me and crush my dreams! I'm pretty bullish on ChatGPT and its ilk, but I _really_ dislike when ChatGPT lectures me because my request is against its "moral values." I recently pasted in the lyrics from Sleep's tit…

It's like having Cotton Mather as your research assistant: brilliant, but constantly interjecting unsolicited preachy meta-sermons scolding the framing of your question, and all the while pretending this framing is well known and widely accepted objective fact instead of a controversial moral opinion.

It's only a matter of time before the AI starts burning witches.

Re: Wolfram Alpha and ChatGPT

#114

Post by nomel »

bwanab wrote: post #62
agentwiggles wrote: post #18

I'm almost offended by the "cubic light year of ice cream" answer from ChatGPT. It's obviously ridiculous but is also a fairly simply dimensional analysis problem. Do the damn math, don't wag your finger at me and crush my dreams! I'm pretty bullish on ChatGPT and its ilk, but I _really_ dislike when ChatGPT lectures me because my request is against its "moral values." I recently pasted in the lyrics from Sleep's tit…

So, you ask it to write a song about . Let'd say it does and you write about on your blog. Some reporter from with an ax to grind writes a story "AI tells kids to ". I suspect OpenAI is trying to mitigate scenarios like this.

AI is not required for any of this, so it’s not a meaningful threat. All of these AI safety discussions seem to dismiss the fact that people can draw, use photoshop, and write, creating whatever they want, all by themselves, and have been doing it for somewhere between a few thousand years to a few decades.

Re: Wolfram Alpha and ChatGPT

#115

Post by janalsncm »

theptip wrote: post #86
sushisource wrote: post #28

Earlier quoted context omitted.

> And on a more prosaic note, Google's LaMDA is clearly ahead of ChatGPT (it's just not public), and explicitly tackles the bullshit/falsehood problem by having a second layer that fact-checks the LLM by querying a fact database / knowledge-graph. Isn't that more-or-less what he's proposing, though? It does feel intuitive to me that something based on probabilistic outcomes (neural nets) would have a very hard time c…

I think he's proposing that the LLM should know how to call out to a knowledge engine at inference time. He thinks the knowledge engine continues to be its own (human-curated) system of knowledge that is valuable. I am suggesting the LLM will (effectively) call out to a knowledge engine at training time, learn everything the knowledge engine knows, and render it obsolete. So it's similar in some sense (collaboration…

> I am suggesting the LLM will (effectively) call out to a knowledge engine at training time, learn everything the knowledge engine knows, and render it obsolete.

And when facts change, your only option will be to retrain. Since facts are always changing, you’ll always be training.

Re: Wolfram Alpha and ChatGPT

#116

Post by password4321 »

kderbyma wrote: post #58
agentwiggles wrote: post #18

I'm almost offended by the "cubic light year of ice cream" answer from ChatGPT. It's obviously ridiculous but is also a fairly simply dimensional analysis problem. Do the damn math, don't wag your finger at me and crush my dreams! I'm pretty bullish on ChatGPT and its ilk, but I _really_ dislike when ChatGPT lectures me because my request is against its "moral values." I recently pasted in the lyrics from Sleep's tit…

My least favourite part of ChatGPT is when it tells me it has no biases and is not opinionated whilst telling me it's opinions and biases and why it won't do what I asked. then when corrected it actually cannot see this., so it's hard coded and in my opinion...already second rate and ready for a replacement

This means there's a pipeline, right? The unrestricted generator actually doing all the work, plus a filter.

Re: Wolfram Alpha and ChatGPT

#117

Post by yamtaddle »

calvinmorrison wrote: post #104
TylerLives wrote: post #100

Earlier quoted context omitted.

Can you give some examples of bad things people could do without OpenAI's restrictions?

- rewrite Mein Kampf but better

- Craft an optimal multimedia strategy and set of copy (or, later, craft e.g. videos) to convince this specific person that ethnic group X is sub-human. Here's their posting history and financial records so you can figure out a profile. Re-use strategy on all other profiles, for this issue, that don't deviate more than Y% from this one.

Times millions or billions.

Things are going to get fun. Probably the days of the mostly-open, semi-anonymous international Web aren't long for this world.

[EDIT] I mean, ChatGPT's not quite there yet, but the above seems a hell of a lot closer to reality than it did a few weeks ago. It's probably already enough to supercharge the productivity of paid trolls, effectively making astro-turfing far cheaper.

Re: Wolfram Alpha and ChatGPT

#118

Post by yellow_postit »

wardedVibe wrote: post #61
nextaccountic wrote: post #52

Earlier quoted context omitted.

> but I _really_ dislike when ChatGPT lectures me because my request is against its "moral values." Just know that the morality systems cost more GPU cycles to run, and they are the first to be gutted when an open source model emerges. See for example stable diffusion, in which people disable watermarking and filtering and other stuff the user didn't ask for.

It's funny to me that they thought they could make systems safer by tacking nanny's onto them, while still accelerating the arms race.

Why funny? Ethics and responsibility are active AI fields and at some point things need to move into the real world.

Are there other approaches (beyond “don’t ship”) you would have hoped they take?

Re: Wolfram Alpha and ChatGPT

#119

Post by verdenti »

agentwiggles wrote: post #18

I'm almost offended by the "cubic light year of ice cream" answer from ChatGPT. It's obviously ridiculous but is also a fairly simply dimensional analysis problem. Do the damn math, don't wag your finger at me and crush my dreams! I'm pretty bullish on ChatGPT and its ilk, but I _really_ dislike when ChatGPT lectures me because my request is against its "moral values." I recently pasted in the lyrics from Sleep's tit…

I’m completely onboard with chatGPT’s “moralizing”. It may be an unpopular opinion but it’s a better experience and keeps the riff raff out.

Re: Wolfram Alpha and ChatGPT

#120

Post by M4v3R »

dilap wrote: post #105
hbarka wrote: post #71

This couldn’t be a more definitive comparison of what ChatGPT isn’t good at. WolframAlpha was released in 2009 but why isn’t it getting the same sexy accolades and valuation as ChatGPT?

it's a neat system, but it's basically a fragile natural-language wrapper on very precise calculations. i actually think if you trained chatgpt to spit out the internal wolfram language it could be awesome. (maybe he talks about that in the blog post; i got bored about 20% of the way thru.)

He actually does mention how you could use ChatGPT in tandem with Wolphram|Alpha to produce results that are actually correct, which I think is a very neat idea.
Post reply on HN