Live data from Hacker News

Bluesky Social Dataset (235M posts from 4M users)

zenodo.org

11–20 of 46 posts

Re: Bluesky Social Dataset (235M posts from 4M users)

#11
post #8
post #2

Pollution of online social spaces caused by rampaging d/misinformation is a growing societal concern. However, recent decisions to reduce access to social media APIs are causing a shortage of publicly available, recent, social media data, thus hindering the advancement of computational social science as a whole. To address this pressing issue, we present a large, high-coverage dataset of social interactions and user-…

[deleted]

[deleted]

Re: Bluesky Social Dataset (235M posts from 4M users)

#14
post #12
post #9

Earlier quoted context omitted.

"Personal data" that was voluntarily published on a public microblogging platform with the explicit intention to share it with the world?

[deleted]

The data is public by default. You know this when you sign up and use the service. This should inform your expectations of how the data will be used.

Re: Bluesky Social Dataset (235M posts from 4M users)

#17
post #15
post #13

Earlier quoted context omitted.

Don't make it public then.

[deleted]

Is you reading my comment on HN also entitlement? I certainly didn't give you permission to do it. It may have some personal details that I don't want you to see. Why do you think that is okay?

Re: Bluesky Social Dataset (235M posts from 4M users)

#19
post #9
post #8

Earlier quoted context omitted.

[deleted]

"Personal data" that was voluntarily published on a public microblogging platform with the explicit intention to share it with the world?

Would it make a difference if we were talking about articles on a news website? I'm kind of on the fence on this one but I can see the point of view that just posting something online doesn't necessarily grant the end user an unlimited license to use the data. Source code is another example; open-sourcing a project doesn't automatically give someone else the right to use that code in their own projects.

Does Bluesky explicitly state the license the user will be publishing under (Creative Commons or whatever), or allow them to choose one?

Re: Bluesky Social Dataset (235M posts from 4M users)

#20
post #4
post #2

Pollution of online social spaces caused by rampaging d/misinformation is a growing societal concern. However, recent decisions to reduce access to social media APIs are causing a shortage of publicly available, recent, social media data, thus hindering the advancement of computational social science as a whole. To address this pressing issue, we present a large, high-coverage dataset of social interactions and user-…

I wonder how much time it takes to run this / what the script is / how resource intensive it is? Bsky is public right, so do you get rate limited? Do you scrape or use an official API? So many questions Also, I feel like only recently there's been an influx of people who have actually interesting things to say so I'd love to see nextyear's dataset

I was checking out the Python API today (the "firehouse" via "atproto" package) and got 5000 posts in 7.5 seconds.
Post reply on HN