Live data from Hacker News

More questions about whether researchers can trust OpenAI with unpublished math

mathstodon.xyz

71–80 of 847 posts

Re: More questions about whether researchers can trust OpenAI with unpublished math

#72

If we put aside the idea of credit for a moment, it sounds like human/AI collaboration is indeed super charging discovery.

"Discovery" is not a goal in itself. I could launch a project to find out how many people in the United States have names such that if you assign numbers to every character and then sum the values, the sum works out to 72. It's discovery, but it's useless unless it has some higher goal. The labs are attacking these problems as a demonstration of capabilities, spending more money on the demos than any mathematician wi…

Right, mathematicians care about clout and tenure, which is a much higher purpose.

Re: More questions about whether researchers can trust OpenAI with unpublished math

#73
post #27

[flagged]

An academic's whole career is built on credit assignment for research breakthroughs. If someone else takes the credit, you lose. This is fundamentally different from a builder. You create things, solve problems and get paid for that instance. Nobody cares you 'invented' the blueprint for that building method. Your job is to instantiate. 100 Contractors can be building instance the exact same building somewhere else, it would not affect you. Most of IT builders are paid for what is basically 2 or 3 tier CRUD.

Re: More questions about whether researchers can trust OpenAI with unpublished math

#74

Earlier quoted context omitted.

"Discovery" is not a goal in itself. I could launch a project to find out how many people in the United States have names such that if you assign numbers to every character and then sum the values, the sum works out to 72. It's discovery, but it's useless unless it has some higher goal. The labs are attacking these problems as a demonstration of capabilities, spending more money on the demos than any mathematician wi…

Right, mathematicians care about clout and tenure, which is a much higher purpose.

this guy already has clout and tenure

Re: More questions about whether researchers can trust OpenAI with unpublished math

#75
post #34

I'm genuinely surprised that more people - including this mathematician in particular - don't untick the "improve the model for everyone" box. Unless the suggestion is that OpenAI ignore this preference?

That doesn't stop them from training on your data apparently. I have that disabled but still has to disable "Don't train on my data" in the privacy center too. https://privacy.openai.com/policies?modal=take-control

If that's true, it's scandalous. The "improve the model for everyone" dialogue states:

"Allow your content to be used to train our models, which makes ChatGPT better for you and everyone who uses it. We take steps to protect your privacy. Learn more"

Re: More questions about whether researchers can trust OpenAI with unpublished math

#76

Only after reading this post did I learn that my preferred AI trains on my inputs (prompts). How was I not aware of this before?

Good question, this was very well known. Do you have an answer?

There is no fine-print (let alone a loud banner) on the chat thread page that tells me my prompts can be used for training.

Re: More questions about whether researchers can trust OpenAI with unpublished math

#77
post #26

Only after reading this post did I learn that my preferred AI trains on my inputs (prompts). How was I not aware of this before?

AI is also trained on your HN posts. And lots of other things you post on the internet.

Public posts on the internet are acceptable (to me).

For my (private) prompts, I need a warning telling me they may be used for training.

Re: More questions about whether researchers can trust OpenAI with unpublished math

#78

Earlier quoted context omitted.

But this is what we do. Nobody ever invented or discovered anything in a vacuum - all discovery is synthesis of existing ideas and concepts applied to a novel domain. We laud Einstein for instance, but his work was a logical extension of Riemann - Riemann had a neat mathematical toy, Einstein described the universe with it - should we say Einstein was incapable of unique work?

The difference is that Einstein didn't literally have someone prompting him towards his result.

Uh, he did. Marcel Grossmann.

“It was Grossmann who emphasized the importance of a non-Euclidean geometry called Riemannian geometry (also elliptic geometry) to Einstein, which was a necessary step in the development of Einstein's general theory of relativity. Abraham Pais's book on Einstein suggests that Grossmann mentored Einstein in tensor theory as well. Grossmann introduced Einstein to the absolute differential calculus, started by Elwin Bruno Christoffel and fully developed by Gregorio Ricci-Curbastro and Tullio Levi-Civita. Grossmann facilitated Einstein's unique synthesis of mathematical and theoretical physics in what is still today considered the most elegant and powerful theory of gravity: the general theory of relativity.”

Re: More questions about whether researchers can trust OpenAI with unpublished math

#79
post #38

Earlier quoted context omitted.

Given OpenAI's well documented history of unethical behaviour it seems adorably naive to think they actually do that in general, or that they wouldn't pull this particular data separately to generate these proofs.

Unethical doesn't mean irrational. They'd be risking massive lawsuits and a total loss of trust if they got caught lying about this. Doesn't seem worth it.

They've done similar things with similar risks repeatedly.

Re: More questions about whether researchers can trust OpenAI with unpublished math

#80
post #51
post #37

All the big AI labs were built on stealing IP; who is surprised that's still how they operate? And who believes, or has ever believed, their promises that your data is private and not logged, etc.? The big AI labs are not trying to advance humanity, they are in this for the money, and as most (all?) private companies they don't care about ethics at all. That doesn't mean they can't be useful, or that their products a…

It's hilarious how people think they care about their reputation, and wouldn't circumvent ZDR policies. Like bro, they literally covertly hired Apple employees and had them steal IP and equipment form Apple. They aren't scared of Apple lawyers, so they definitely aren't scared of yours.

AI is America's last chance to salvage its empire. Nothing will be allowed to impede it.
Post reply on HN