Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Don't believe ChatGPT – we do not offer a "phone lookup" service

blog.opencagedata.com

Post reply on HN
Print view View original

171–180 of 284 posts

Re: Don't believe ChatGPT – we do not offer a "phone lookup" service

#171

Post by akira2501 »

hayksaakian wrote: post #11

This marks the new age of "AI Optimization" where companies will strive to get their business featured into answers in ChatGPT. The OP's example is Unwanted demand, but it clearly shows that ChatGPT can funnel potential customers towards a product or service.

> This marks the new age of "AI Optimization"

Or it marks the beginning of the next "AI Winter."

> but it clearly shows that ChatGPT can funnel potential customers towards a product or service.

And the next logical step is "chatgpt keywords advertising." Which is right back where we started.

Re: Don't believe ChatGPT – we do not offer a "phone lookup" service

#172

Post by alfalfasprout »

cypress66 wrote: post #165
alfalfasprout wrote: post #112

Earlier quoted context omitted.

By definition, an LLM doesn't have a semantic world model or ontology. Even the most "dumb" (and I use that in quotes because they really aren't) animal is able to reason about uncertain concepts and understands risk and uncertainty. Yann Lecun has posted a lot recently about this but basically LLMs are a "useful offramp on the road to AGI".

There's nothing "by definition" that says so. In fact many propose that when you train an LLM, in order to be able to predict the next word with enough accuracy, it must internally build a world model. Yann Lecun is very salty about chatgpt, I wouldn't take his word seriously.

Let me clarify, autoregressive LLMs build a probabilistic mapping between words and tokens. They don't actually understand what these concepts mean. Only what they appear in conjunction with, etc. We (and most animals) interact with the physical world and learn through a combination of doing, experiencing, biology, and book learning. That lets us reason about how things work in unseen contexts and we know what we know vs. don't know (whether we express it or not is a different story).

> Yann Lecun is very salty about chatgpt, I wouldn't take his word seriously. With all due respect, he's not salty at all. He's even overseen plenty of cutting edge research in the LLM space. But he rightfully has pointed out what they can and can't do.

There's too many people encountering a chatbot for the first time that sounds coherent and engaging in anthropomorphism.

Re: Don't believe ChatGPT – we do not offer a "phone lookup" service

#173

Post by BeFlatXIII »

TehCorwiz wrote: post #31
Xylakant wrote: post #23

Earlier quoted context omitted.

> Because ChatGPT is so new, we are in this weird period where people haven't learned that is just as incorrect as the rest of us. It’s worse than that. It’s wrong, you cannot correct it and it makes up supporting citations on the fly. Very few humans behave like that.

I can think of more than a few that regularly appear on TV.

I can think of one who was once in the White House.

Re: Don't believe ChatGPT – we do not offer a "phone lookup" service

#174

Post by dpkirchner »

hackernewds wrote: post #9
fire wrote: post #5

Earlier quoted context omitted.

have you been able to contact OpenAI about this? It sounds like they're actively adding load to your CS ops with this

what are they going to do? add custom logic? where does it stop? the malady is that LLMs cannot do operational adhoc changes such as these kinds of errors at scale

They've already added custom logic to prevent their LLM from e.g. praising Nazis or whatever restrictions people are upset about -- seems it'd be easy to configure the software to exclude references to known unavailable services.

Re: Don't believe ChatGPT – we do not offer a "phone lookup" service

#175

Post by [deleted] »

crazygringo wrote: post #54

I'm curious -- does anyone know of ML directions that could add any kind of factual confidence level to ChatGPT and similar? We all know now that ChatGPT is just autocomplete on steroids. It produces plausibly convincing patterns of speech. But from the way it's built and trained, it's not like there's even any kind of factual confidence level you could threshold, or anything. The concept of factuality doesn't exist…

[deleted]

Re: Don't believe ChatGPT – we do not offer a "phone lookup" service

#176

Post by mrtnmcc »

crazygringo wrote: post #54

I'm curious -- does anyone know of ML directions that could add any kind of factual confidence level to ChatGPT and similar? We all know now that ChatGPT is just autocomplete on steroids. It produces plausibly convincing patterns of speech. But from the way it's built and trained, it's not like there's even any kind of factual confidence level you could threshold, or anything. The concept of factuality doesn't exist…

Giving LLM the ability to query other services like Google should solve much of this. For example ChatGPT can be initialized to be told it can output commands like "QUERY_GOOGLE:What is the current time?" and get Google's response, which it can incorporate. You can actually do this yourself and prove it works by performing the Google search for ChatGPT.

Re: Don't believe ChatGPT – we do not offer a "phone lookup" service

#177

Post by juujian »

crazygringo wrote: post #54

I'm curious -- does anyone know of ML directions that could add any kind of factual confidence level to ChatGPT and similar? We all know now that ChatGPT is just autocomplete on steroids. It produces plausibly convincing patterns of speech. But from the way it's built and trained, it's not like there's even any kind of factual confidence level you could threshold, or anything. The concept of factuality doesn't exist…

People say things that are wrong. We train language model on what people say. And even if we were able to filter the training data for just factually correct things---language models use stochastic to generate novel replies, there is always the risk something wrong comes up. So in short, no, that is not what language models are designed to do.

Re: Don't believe ChatGPT – we do not offer a "phone lookup" service

#179

Post by d110af5ccf »

alfalfasprout wrote: post #172
cypress66 wrote: post #165

Earlier quoted context omitted.

There's nothing "by definition" that says so. In fact many propose that when you train an LLM, in order to be able to predict the next word with enough accuracy, it must internally build a world model. Yann Lecun is very salty about chatgpt, I wouldn't take his word seriously.

Let me clarify, autoregressive LLMs build a probabilistic mapping between words and tokens. They don't actually understand what these concepts mean. Only what they appear in conjunction with, etc. We (and most animals) interact with the physical world and learn through a combination of doing, experiencing, biology, and book learning. That lets us reason about how things work in unseen contexts and we know what we kno…

> They don't actually understand what these concepts mean.

You say this so confidently. But can you define in terms that are directly quantifiable what "understanding a concept" actually means?

I don't believe that anyone can (at present, anyway) although there are certainly some interesting theories and heuristics that have been put forward by various people.

Re: Don't believe ChatGPT – we do not offer a "phone lookup" service

#180

Post by vgeek »

rosywoozlechan wrote: post #64
kelseyfrog wrote: post #18

> All suggestions are welcome. Monetize it! Evil answer: Partner with an advertiser and sell https://api.opencagedata.com/geocode/v1/json as an ad space. This may be the first opportunity for an application/json-encoded advertisement. Nice answer: Partner with an actual phone lookup platform and respond with a 301 Moved Permanently at the endpoint.

there's no "actual phone lookup platform" you can't get a person's location by knowing their phone number, that's a huge privacy violation. You can get the location of your own phone via icloud or google's system for android. You could also install an app on your phone to track your phone's location. You cannot find people based on knowing their phone number, that would be a serious safety issue for you know people t…

That is widely known about and freely available to the public, maybe. There are multiple options available for pseudo-LE types with relatively lax access prerequisites.

https://www.robertxiao.ca/hacking/locationsmart/ is an example of one provider's public demo (requiring only a phone number) being used to provide non-consensual location data.

Post reply on HN