Live data from Hacker News

Twitter now requires an account to view tweets

techcrunch.com

681–690 of 1001 posts

Re: Twitter now requires an account to view tweets

#682
post #618

From Elon's twitter ( https://twitter.com/elonmusk/status/1674942336583757825?s=20 ) "This will be unlocked shortly. Per my earlier post, drastic & immediate action was necessary due to EXTREME levels of data scraping. Almost every company doing AI, from startups to some of the biggest corporations on Earth, was scraping vast amounts of data. It is rather galling to have to bring large numbers of servers online on an…

Well they killed the API, what did they think would happen? It's easier to control access and rate limit with a proper API.

The actual problem seems to be that a large number entities now want a full copy of the entire site.

But why not just... provide it? Charge however much for a box of hard drives containing every publicly-available tweet, mailed to the address of buyer's choosing. Then the startups get their stupid tweets and you don't have any load problems on your servers.

Re: Twitter now requires an account to view tweets

#683

From Elon's twitter ( https://twitter.com/elonmusk/status/1674942336583757825?s=20 ) "This will be unlocked shortly. Per my earlier post, drastic & immediate action was necessary due to EXTREME levels of data scraping. Almost every company doing AI, from startups to some of the biggest corporations on Earth, was scraping vast amounts of data. It is rather galling to have to bring large numbers of servers online on an…

Elon has a good point there. Much of the current AI hotness is predicated on stealing peoples content and exploiting the infrastructure that other people have built. I don’t think it’s acceptable.

The licenses, compensation models, law, technical solutions, attribution, security and privacy all need time to catch up. Regulation has a role to play as its a bit of a free for all right now.

The irony of Elon mentioning “outrageous valuations” though!

Re: Twitter now requires an account to view tweets

#684

Earlier quoted context omitted.

If anything, nature is healing. I’ve noticed at least 1 community return to forums due to all of this ( https://mholdschool.com/ ), and while unfortunately AFAIK there isn’t any good FLOSS software for it, it’s certainly a start.

Zig community at reddit was closed recently and they decided to make its discourse instance as the primary discussion center. https://ziggit.dev/

Discourse is going to pull the same shenanigans as Reddit and Twitter, you can be sure of that. No one is going to host millions of users for free, forever, they'll all come around to get their investment back one day.

Re: Twitter now requires an account to view tweets

#685
post #584

The overthinking, speculation, and wasted thoughts in the comments due to misinformed people attempting to spread unsubstantiated claims is quite shocking. https://twitter.com/elonmusk/status/1674887204580073474?s=20 ---- @elonmusk "Several hundred organizations (maybe more) were scraping Twitter data extremely aggressively, to the point where it was affecting the real user experience. What should we do to stop that?…

It's amusing that anyone takes anything Elon says seriously. At this point the "free speech absolutist" has about as much credibility as an orange reality TV star.

Re: Twitter now requires an account to view tweets

#686
post #618

From Elon's twitter ( https://twitter.com/elonmusk/status/1674942336583757825?s=20 ) "This will be unlocked shortly. Per my earlier post, drastic & immediate action was necessary due to EXTREME levels of data scraping. Almost every company doing AI, from startups to some of the biggest corporations on Earth, was scraping vast amounts of data. It is rather galling to have to bring large numbers of servers online on an…

Well they killed the API, what did they think would happen? It's easier to control access and rate limit with a proper API.

You think companies massively scraping right now would respect API rate limit?

Re: Twitter now requires an account to view tweets

#687
post #616

From Elon's twitter ( https://twitter.com/elonmusk/status/1674942336583757825?s=20 ) "This will be unlocked shortly. Per my earlier post, drastic & immediate action was necessary due to EXTREME levels of data scraping. Almost every company doing AI, from startups to some of the biggest corporations on Earth, was scraping vast amounts of data. It is rather galling to have to bring large numbers of servers online on an…

I used to work for a very large financial institution. Scraping from finance apps was a material source of load even with substantial countermeasures in place. I can’t imagine what it does to sites like Twitter and Reddit (and HN).

HN has an open API look at the footer

Re: Twitter now requires an account to view tweets

#689
post #616

From Elon's twitter ( https://twitter.com/elonmusk/status/1674942336583757825?s=20 ) "This will be unlocked shortly. Per my earlier post, drastic & immediate action was necessary due to EXTREME levels of data scraping. Almost every company doing AI, from startups to some of the biggest corporations on Earth, was scraping vast amounts of data. It is rather galling to have to bring large numbers of servers online on an…

I used to work for a very large financial institution. Scraping from finance apps was a material source of load even with substantial countermeasures in place. I can’t imagine what it does to sites like Twitter and Reddit (and HN).

HN volume is absolutely tiny (the ids are sequential so you can easily check how many items there are in a given day) and there’s an API. It’s no comparison.

Re: Twitter now requires an account to view tweets

#690

Earlier quoted context omitted.

Electricity markets are a prime example of ideology winning over logic. In Australia, the eastern states have a privatised electricity market while Western Australia has a very limited market with agreements to hold a certain amount of gas fuel at a certain price. Currently the price of electricity is significantly higher in the eastern market than the "less free" western one.

The western Australian example just demonstrates why petrostates are wealthy - if you have big energy resources you can make stuff cheaper, surprise! And realistically all that's really happening there is west Australia is effectively imposing a tax on gas profits to subsidize the grid. There's no magic success here - just a redistribution of gas profits to electricity consumers. I don't actually think the Australian…

WA owns its electricity generation and supply companies, so no it’s not just a tax, it’s nationalised infrastructure and it works great for us.

It’s not just cheaper, it takes the privatised profits off the table and instead feeds them back.

It’s not magic, it’s pretty good sense though, and it serves the people of the state well.

Post reply on HN