Live data from Hacker News

AI-Shunning robots.txt

github.com

61–70 of 92 posts

Re: AI-Shunning robots.txt

#61
post #60

Earlier quoted context omitted.

Only on hackernews you get the most ironic of takes. Supposedly someone who is educated and technologically literate to a high degree, thinks opposition to AI is a good thing. Crazy world.

The level of scrutiny and plurality of opinions towards technology in general is imho what makes a tech forum good.

I'm not saying it's a bad thing, it's just so unexpected that every time I see it it fascinates me.

Re: AI-Shunning robots.txt

#62

Not that I'm arguing for or against preventing access from AI crawlers, but wouldn't it make more sense to block them at a higher level, e.g. the webserver, and not even give them the choice to obey/disobey robots.txt?

How would you propose doing so?

Off the top of my head:

- Cloudflare

- Webserver-level user-agent blocking (Apache, nginx)

- Application-level user-agent blocking (`if request.user_agent == 'OpenAI'`)

None of them are ideal since you can simply change your user agent, but all of them seem like better options than robots.txt to me.

Re: AI-Shunning robots.txt

#63

Earlier quoted context omitted.

Actually, I believe it was my education in pure mathematics (PhD), computer programming, and technology, as well as living in three countries and seeing the word that allowed me to truly realize how damaging AI can really be. Believe it or not, I was heavily into technology when I was in my 20s. But after seeing environmental damage, reading widely in philosophy and sociology, writing about it to clarify it, I came t…

I'm 30, you sound older. I did my education in philosophy and physics and I'm a data engineer at a F200. I think you couldn't be more wrong, and out of touch. You sound like Kaczynsky. I love technology because it's interesting, who cares what rich people think. I can't understand this oldhead defeatist mentality a lot of people here seem to have similar to yours.

You sound incredibly naive. Good luck enjoying technology when all you get to do is manual labor to feed the machine. Everything else will be done "for us", with the rich people in charge of it all.

Re: AI-Shunning robots.txt

#64
post #32

Earlier quoted context omitted.

Only on hackernews you get the most ironic of takes. Supposedly someone who is educated and technologically literate to a high degree, thinks opposition to AI is a good thing. Crazy world.

> thinks opposition to AI is a good thing. Because we don't want nearly every job to be automated by AI? "Crazy world"

It's crazy you think we don't want our jobs automated away. The whole point of automation is to reduce human labor. Mind boggling people literally choose to want to have to labor even if it is no longer necessary.

Re: AI-Shunning robots.txt

#65

Earlier quoted context omitted.

I'm always dumbfounded by the luddites on hackernews, it blows my mind.

Is your position that the scenario outlined above is irrational?

Yes, it is; it's as irrational as seamstresses complaining about looms.

Re: AI-Shunning robots.txt

#66

Earlier quoted context omitted.

Actually, I believe it was my education in pure mathematics (PhD), computer programming, and technology, as well as living in three countries and seeing the word that allowed me to truly realize how damaging AI can really be. Believe it or not, I was heavily into technology when I was in my 20s. But after seeing environmental damage, reading widely in philosophy and sociology, writing about it to clarify it, I came t…

I'm 30, you sound older. I did my education in philosophy and physics and I'm a data engineer at a F200. I think you couldn't be more wrong, and out of touch. You sound like Kaczynsky. I love technology because it's interesting, who cares what rich people think. I can't understand this oldhead defeatist mentality a lot of people here seem to have similar to yours.

I love wildlife and the natural world, and technology is utterly dependent on destroying it via mining. The directions we go in shouldn't be determined based on just whether they are interesting. They also need to be constrained based on whether they are sustainable. You obviously don't care much about the negative environmental effects of technological development.

By the way, I am not defeatist because:

1. I think we can make great progress, only progress towards rewilding nature

2. I only consider technology a dead-end, not humanity! I believe we can move past arbitrary technological development and discard our consumerist ways.

Re: AI-Shunning robots.txt

#67

Earlier quoted context omitted.

Because if a job is automted, it means that the person whose job is automated now is unemployed. Even if we have UBI, it means that the person DOING the automating will get a disproportionate share of the resources compared with the pittance given to the person who was automated. Personally, I don't want my job to be automated. I write for a living and if AI takes my job, I won't get paid. I prefer to create value in…

I'm always dumbfounded by the luddites on hackernews, it blows my mind.

Don't worry, I am equally dumbfounded by blind faith in technology.

Re: AI-Shunning robots.txt

#68

Earlier quoted context omitted.

Because if a job is automted, it means that the person whose job is automated now is unemployed. Even if we have UBI, it means that the person DOING the automating will get a disproportionate share of the resources compared with the pittance given to the person who was automated. Personally, I don't want my job to be automated. I write for a living and if AI takes my job, I won't get paid. I prefer to create value in…

...unless we change our socio-political systems. A complex endeavour but worth remembering.

Change, or revolt against them...

Re: AI-Shunning robots.txt

#69
post #51
post #49

Earlier quoted context omitted.

Why would the value of AIs plummet if they know more? Or did you mean sites? Information wants to be free. If AI is trained only on data provided by those with agendas, you won’t want to live in that world.

I am saying the opposite, if they have less data the value of AI's will plummet and hopefully their use will plummet. That is a good thing.

Market dynamics. Since use of better AIs confers advantages, they will be improved. No set of players will be able to stop this because the incentives are so strong for others to continue using and developing them. The best we can hope for is AIs that are not misled.

Sometimes you have to work with the tide, because fighting it is futile and even self defeating.

Re: AI-Shunning robots.txt

#70

Earlier quoted context omitted.

I'm 30, you sound older. I did my education in philosophy and physics and I'm a data engineer at a F200. I think you couldn't be more wrong, and out of touch. You sound like Kaczynsky. I love technology because it's interesting, who cares what rich people think. I can't understand this oldhead defeatist mentality a lot of people here seem to have similar to yours.

You sound incredibly naive. Good luck enjoying technology when all you get to do is manual labor to feed the machine. Everything else will be done "for us", with the rich people in charge of it all.

I sound naive? Have you even read any Marx?
Post reply on HN