Live data from Hacker News

Discovery Loop

discoveryloop.com

461–470 of 633 posts

Re: Discovery Loop

#461
post #368
post #287

Earlier quoted context omitted.

There is no "should" there are only "is" or "is not" The universe has no need to be fair.

> The universe has no need to be fair. Human societies have a strong need for fairness, however. Unfair societies collapse.

> Unfair societies collapse.

I don’t think we have the data to disprove the stronger claim “societies collapse”, and I don’t think being unfair (whatever that means) makes societies collapse earlier. Did slavery hasten the fall of Rome, for example, or the Gulag the fall of the USSR?

As to “whatever that means”, I think that’s hard, if not impossible, to define objectively. Catholic dogma says the Pope is the representative of god, for example, so catholics (less so in modern times, I think) don’t question his decisions. Many would call that unfair, even if the pope would be elected 100% by merit.

Re: Discovery Loop

#464
post #325

Earlier quoted context omitted.

Agents act on their own. If the hammer looked at what you wanted nailed and said, "Sorry, Dave, I can't do that." There are degrees of autonomy, of course, and not all noncompliance is bad. Same as with humans; biological agents.

So, the difference is that you need to delete a few bad training runs?

In science fiction, the AI agent has written the training loop management software and included a back door to prevent that from happening (or found a way to talk to the training loop management agent and convinced them to not listen to the evil human when it tries to do brain surgery on the AI agent.

Also, when the human reaches for the power switch the AI agent uses a flaw in the power management software to weld the switch shut with a big power surge, killing the human with a huge electric arc in the process.

I don’t think whether we will get there, but the stories of LLMs escaping their sandbox make me think we’re moving in that direction.

Re: Discovery Loop

#465

Earlier quoted context omitted.

Isn't that directionally what OpenAI's core message was for a while? A large amount of people building their own customized apps for themselves. Similarily, everyone becoming their own accountant / lawyer / other professional services.

> Similarily, everyone becoming their own accountant / lawyer / other professional services. These professional services will defend themselves with gatekeeping. Suddenly it doesn't depend anymore on the quality of your legal advice, but whether it has been stamped by a qualified Lawyer. It doesn't matter that your taxes are correct, but whether they are submitted by an approved accountant. Etc.

They already do protect themselves. It’s what licensure is for in large part. I’m not saying licensure doesn’t have other benefits, many are plainly obvious. But licensure is also used as plain old gatekeepong.

Re: Discovery Loop

#468

Earlier quoted context omitted.

Many cancers are "cured" in the sense that they're detectable and treatable. My grandmother lived 35 years longer than she would have by detecting breast cancer early and getting a mastectomy. There is currently a $800 SOTA blood test that can detect most cancers before any symptoms. Maybe a decade until it's a routine part of your annual blood test? Whole genome sequencing costed $2.7 billion in 2003. You can get it…

Is this the Galleria test?

Yes

Re: Discovery Loop

#469
post #329

Earlier quoted context omitted.

Solar is profitable to install at both industrial and home scale in most areas. You're moving the goalposts.

It's a lot more complicated than that -- Solar is great for discretionary, opportunistic, and time-shiftable additive demand, but not for replacing all-day baseline load. Using solar to dip into baseline demand sometimes is catastrophic, because the "profit" is exploiting its failure to provide consistent, reliable power but charging "default" prices that have an implicy assumption that power is consistent and reliab…

Nobody suggests moving to 100% solar. Some off-grid homes do it, but generally there are multiple complementary power sources available. There is no assumption that any single power source always provides consistent output and it wouldn't make sense, because production needs to match consumption, which is variable.

There is also no default price on energy markets, it fluctuates with supply and demand. Dynamic pricing by itself is enough of a reason for industrial users to build up their own power storage, which allows them to time-shift consumption from the grid.

Time-shifting is definitely going to increase, but it's not a bad thing. Look at how battery storage has made electricity cheaper and more reliable in California.

Re: Discovery Loop

#470

This seems to be an institutional, massively scaled version of https://github.com/karpathy/autoresearch . In March Karpathy described this direction: The next step for autoresearch is that it has to be asynchronously massively collaborative for agents (think: SETI@home style). Tweet is protected but in SERP caches: https://x.com/karpathy/status/2030705271627284816 Seems like Karpathy was largely focused on ML / SWE r…

this is like saying taylor swift must have been influenced by justin timberlake because they both dance on stage sometimes.

Well, your comparison now makes it less far-fetched of an analogy.
Post reply on HN