Live data from Hacker News

An Alien Mind

openai.com

91–100 of 488 posts

Re: An Alien Mind

#91
post #76

One of my favorite things to do with these blog posts is to imagine an Alien Museum on the Remains of Humanity, and wonder what the little text flyouts and commentary on the screenshot of this one might say. Some ideas: "Despite a nuanced view of the complexities of what lay ahead, humanity found itself collectively unable to stop the process it had set in motion." "Despite significant progress on the mechanisms of a…

This would be a fun website - you should have an AI build it!

Re: An Alien Mind

#92
> We do not have a satisfactory theory of generalization, and it seems unlikely that we can develop one soon, at least without the help of more powerful AI. Therefore, at present, our ability to empirically validate our alignment techniques is in practice arguably even more important than the alignment techniques themselves.

They are speeding toward RSI without a solid foundation for alignment, hoping to solve the problem with a future AI model. These are dangerous times for humanity.

Re: An Alien Mind

#93

Earlier quoted context omitted.

The crucial distinction here is that "seem" does not at all mean the same thing as "is". Thunder seems like the anger of the gods but it isn't . We've had chess playing programs for a long time now and despite it seeming like thinking is required for them, it isn't. The principle you're using here isn't a scientific one but magical [1]. Abandoning empiricism and rationality is not a good way to make progress. [1] htt…

You're insisting on a particular definition of a vague term. It makes sense now to say that temperature is what a thermometer measures. However, before there were good thermometers, people often thought that heat and cold were different things. The meanings of the words we use were influenced by scientific progress. For thinking, we don't have a good thermometer. There are IQ tests, but they aren't aren't necessarily…

People in the past being wrong doesn't mean you have to repeat the same mistakes, and it definitely doesn't mean you should throw your hands up and declare that all similar things must be identical.

Quibbling over commonly-understood definitions is not a strong argument. If you're genuinely struggling to understand that El Ajedrecista [1] did not meet any definition of thought, then the solution is not to demand that people redefine all terms to accomodate you, but that you consult a dictionary.

You clearly have a working definition, or you wouldn't have been able to declare that tallness isn't thinking; please engage honestly.

[1] https://en.wikipedia.org/wiki/El_Ajedrecista

Re: An Alien Mind

#94

Pre-IPO positioning … or how a charity dedicated to saving humanity from the apocalypse realized the most responsible thing to do was float 15% of the apocalypse on the NASDAQ.

its like in the exorcist, except the demon is the charity: "the power of capitalism compels you!"

Re: An Alien Mind

#95

Earlier quoted context omitted.

Maybe I just lack imagination, but I don't really know how jobs are supposed to solidify around the role of giving prompts to agents and then looking at the results. I mean, engineers will be in the breadline because their role was simply to prompt the agents.. only to be superseded by managers or executives who no longer manage engineers but themselves prompt the agents? And, for this previously considered obsolete…

Regardless of the imagination quandary, this second, RIGHT NOW is the worst these systems will ever be. They are only going to get better.

For sure, and for that reason I mean to say that I wouldn't feel great as a manager/executive/etc either.

Re: An Alien Mind

#96

Earlier quoted context omitted.

The crucial distinction here is that "seem" does not at all mean the same thing as "is". Thunder seems like the anger of the gods but it isn't . We've had chess playing programs for a long time now and despite it seeming like thinking is required for them, it isn't. The principle you're using here isn't a scientific one but magical [1]. Abandoning empiricism and rationality is not a good way to make progress. [1] htt…

First, define “thinking”

Coming equipped to discuss a topic before chiming in is your responsibility.

Re: An Alien Mind

#97
post #53

Sometimes I wonder if the people working at frontier AI labs even talk to other humans anymore. Reading this little essay started out normal, but soon felt like a look into a disturbed and worrying mind, and if you find yourself taking it at face value, I urge you to step away from chat bots and spend some time with friends and family.

Frontier AI labs I don't know, but I know for a fact that the company I work for has been experiencing "its pivotal moment" (with strongly negative connotation), per the sentiments of both its longest-serving employees and the newcomers baffled at the number of idiotic instructions and fines, since the emergence of LLMs the company's founder has been spending entire nights chatting with.

People have been fleeing like it's a sinking ship.

Re: An Alien Mind

#98

Earlier quoted context omitted.

Maybe I just lack imagination, but I don't really know how jobs are supposed to solidify around the role of giving prompts to agents and then looking at the results. I mean, engineers will be in the breadline because their role was simply to prompt the agents.. only to be superseded by managers or executives who no longer manage engineers but themselves prompt the agents? And, for this previously considered obsolete…

Regardless of the imagination quandary, this second, RIGHT NOW is the worst these systems will ever be. They are only going to get better.

Maybe, maybe not. It's not unreasonable that these systems cap out at some point, or perhaps fizzle away entirely.

The businesses that create these systems are not profitable and run at a massive historical and go-forward loss.

New data centers required to operate these systems are facing increasing pushback at local levels. New construction is not guaranteed. Energy and power grid constraints exist as well.

Government regulation is way behind. What happens when (if) mass layoffs due to AI occur? How does the population react? Theoretically AI can be regulated out of significant progress, or outright existence for many purposes. At the end of the day, US and other prominent governments make the calls, not corporations.

Re: An Alien Mind

#99

Earlier quoted context omitted.

Maybe I just lack imagination, but I don't really know how jobs are supposed to solidify around the role of giving prompts to agents and then looking at the results. I mean, engineers will be in the breadline because their role was simply to prompt the agents.. only to be superseded by managers or executives who no longer manage engineers but themselves prompt the agents? And, for this previously considered obsolete…

Regardless of the imagination quandary, this second, RIGHT NOW is the worst these systems will ever be. They are only going to get better.

I don't know if he's right, but Peter Zeihan thinks the breakdown in globalization will negatively affect the ability to continue to improve the chips that AI depends on[0]. Too many steps in the supply chain, too widespread, too vulnerable to deglobalization.

0: https://zeihan.com/the-ai-race-to-regression/

Re: An Alien Mind

#100
> The strongest argument I see for continuing to train much smarter models quickly is the need to build defensive systems against the dangers posed by other AI.

Yikes! I really wonder about the cognitive dissonance necessary to work at OpenAI these days. They’re in an arms race to build a machine god, knowing full well that it could end humanity.

Post reply on HN