Live data from Hacker News

Show HN: Python package to collect normalized news from almost any website

github.com

171–180 of 203 posts

Re: Show HN: Python package to collect normalized news from almost any website

#171

For any news junkies heres, I've built https://maagnit.com which gathers both Left and Right leaning sources for any story and displays them altogether on one page. My approach has been, if we can't get neutral/objective coverage, getting comprehensive, 360 desgree coverage is a good alternative. These days, news bias is not only in the way a story is covered, but also which stories are covered. So, maagnit automatic…

When I was a kid CNN used to do this: they would invite a single climate scientist and a single climate change skeptic and have them make their points on equal time. CNN would then say “who’s right? You decide.” And the program would end. This was extremely harmful to the overall mission of informing people and created a false balance between sides which are not equally valid. Today, this is almost universally seen a…

This is literally what news is supposed to do — that is enable multiple & unbiased perspectives on a topic, and if necessary, give equal time to bias opposing views.

Otherwise you end up with the “ministry of truth” — and we all know how that worked out.

Re: Show HN: Python package to collect normalized news from almost any website

#172

Earlier quoted context omitted.

Sorry, I have to respectfully disagree. This is the model that PBS Nightly News takes: let both sides of an issue talk and treat everyone respectfully. Compare this to MSNBC and Fox News whose business models are really the same: cater to their viewers’ dogma/bubble and reinforce biases, and don’t try to introduce new ideas because it is bad for their business.

I don’t live in the US, so please take what I’m saying with a grain of salt. I imagine you are a smart and decent person on the other side of this screen. Usually print media is considered higher quality journalism than TV media. There are numerous studies that show reading print media leads to people being more informed than just watching TV news. Whether this is correlation or causation I can’t really say. My under…

>> “ Fox and MSNBC is they are entertainment programs”

No, maybe to you, but to vast amounts of people, millions of people, they watch a singular source for news and to them, that is the news.

In the US, since you’re referring to them, the news legally used to have to allow all sides of an issues to present their views. In the 1980s, the laws changed, and that is how news became so one-side.

Re: Show HN: Python package to collect normalized news from almost any website

#173
post #104

Earlier quoted context omitted.

I would prefer to be persuaded than told what to think. Otherwise, journalists can tell us whatever they want to without any accountability. > Today, this is almost universally seen as a failure of journalism. That is a shame.

The problem is that for many people, someone appearing persuasive is orthogonal to them actually being correct .

Unfortunately, the alternative to persuasion is belief and trust.

Re: Show HN: Python package to collect normalized news from almost any website

#174

Earlier quoted context omitted.

When I was a kid CNN used to do this: they would invite a single climate scientist and a single climate change skeptic and have them make their points on equal time. CNN would then say “who’s right? You decide.” And the program would end. This was extremely harmful to the overall mission of informing people and created a false balance between sides which are not equally valid. Today, this is almost universally seen a…

"Of course there are reasons why a gubernatorial election should not be decided by a ski race, but are there also reasons why it should? For the sake of fairness, we’ve brought in two experts with opposite opinions, who will now have equal time to just say those opinions, because that’s what news is." https://www.youtube.com/watch?v=MUx09Z_SJMI&t=11

I mean honestly I think the person advocating for the ski-race should probably get more time since that's the stance I am, and the audience presumably, are least familiar with.

There are some good faith and sound mind tests that should be applied here but if someone wants to genuinely make a case for choosing a political leader via athletic competition (which has no basis in history at all, nope) then why not hear them out? What are you afraid of?

Re: Show HN: Python package to collect normalized news from almost any website

#175
post #172

Earlier quoted context omitted.

I don’t live in the US, so please take what I’m saying with a grain of salt. I imagine you are a smart and decent person on the other side of this screen. Usually print media is considered higher quality journalism than TV media. There are numerous studies that show reading print media leads to people being more informed than just watching TV news. Whether this is correlation or causation I can’t really say. My under…

>> “ Fox and MSNBC is they are entertainment programs” No, maybe to you, but to vast amounts of people, millions of people, they watch a singular source for news and to them, that is the news. In the US, since you’re referring to them, the news legally used to have to allow all sides of an issues to present their views. In the 1980s, the laws changed, and that is how news became so one-side.

They are news entertainment not just to him, pretty much all the mainstream sources are news entertainment. They're not objective. This argument seems like calling breakfast cereal breakfast whereas it's marketed as part of a complete breakfast. The differences are subtle, like the WHO is a political organization that covers medical topics. A decent write up of the broadcast transition: https://www.medialit.org/reading-room/whatever-happened-news

Re: Show HN: Python package to collect normalized news from almost any website

#176

Earlier quoted context omitted.

Sorry, I have to respectfully disagree. This is the model that PBS Nightly News takes: let both sides of an issue talk and treat everyone respectfully. Compare this to MSNBC and Fox News whose business models are really the same: cater to their viewers’ dogma/bubble and reinforce biases, and don’t try to introduce new ideas because it is bad for their business.

I don’t live in the US, so please take what I’m saying with a grain of salt. I imagine you are a smart and decent person on the other side of this screen. Usually print media is considered higher quality journalism than TV media. There are numerous studies that show reading print media leads to people being more informed than just watching TV news. Whether this is correlation or causation I can’t really say. My under…

I think the world would be better off if no one ever referred to anything they watched on TV as “news” any more and kept it that news is something you read that can be cited and referenced.

Re: Show HN: Python package to collect normalized news from almost any website

#177

Earlier quoted context omitted.

I don’t live in the US, so please take what I’m saying with a grain of salt. I imagine you are a smart and decent person on the other side of this screen. Usually print media is considered higher quality journalism than TV media. There are numerous studies that show reading print media leads to people being more informed than just watching TV news. Whether this is correlation or causation I can’t really say. My under…

As misleading as a particular spin of a story might be, those perspectives are still valid in the sense they connect with what is important to their readers. I'd like to see a news app that has the facts and sensationalism separated, and then a reference to a more relevant fact/story that relates more directly to what a particular spin was getting at. So I guess feed their bubble with more accurate stories.

I disagree since these days (And especially TV-based) MSM has taken it upon themselves to tell readers what should be important to them.

Re: Show HN: Python package to collect normalized news from almost any website

#178

I've been experimenting with a side project: www.glancereport.com, which pulls the top headline from a variety of news sources. You can also sort these headlines by neutral, progressive, or conservative sources. I'm still learning how to play with Python and Redis, and it's not perfect, but would love feedback.

I see that the Neutral/Progressive/Conservative filter is most applicable to Politics news, but I'd be interested in seeing if you can filter by topic like Business, Sports, Lifestyle etc.

Re: Show HN: Python package to collect normalized news from almost any website

#179
post #172

Earlier quoted context omitted.

>> “ Fox and MSNBC is they are entertainment programs” No, maybe to you, but to vast amounts of people, millions of people, they watch a singular source for news and to them, that is the news. In the US, since you’re referring to them, the news legally used to have to allow all sides of an issues to present their views. In the 1980s, the laws changed, and that is how news became so one-side.

They are news entertainment not just to him, pretty much all the mainstream sources are news entertainment. They're not objective. This argument seems like calling breakfast cereal breakfast whereas it's marketed as part of a complete breakfast. The differences are subtle, like the WHO is a political organization that covers medical topics. A decent write up of the broadcast transition: https://www.medialit.org/readi…

I would argue mainstream media is literally propaganda, or at least the US government is legally allowed to broadcast propaganda [1] — either directly via direct government intervention— or like what is now known to be the case in Turkey, for example, where parties buy out the media to gain favor from a given political group.

My point is that the majority of people actually watching these news outlets see it as news, not entertainment or propaganda.

[1] https://en.wikipedia.org/wiki/Voice_of_America#Smith–Mundt_A...

—- EDIT: Reviewed your CML link from spring of 1990, interesting read, but really fails to do critical analysis of the specific regulatory changes by name, what impact changes had, etc. Beyond that, stating obvious, it fails to cover all the material events since 1990.

Re: Show HN: Python package to collect normalized news from almost any website

#180
post #21

Depending on what you're trying to do, there's also newspaper3k: https://github.com/codelucas/newspaper It's quite easy to get "good" extraction for large numbers of outlets/articles without a massive amount of special-casing, as news articles are nearly universally marked up with RDF metadata (partly for Google News's benefit). Article discovery, and perfect parsing, is quite a bit harder. I ended up rolling a new S…

Hey, I used this for my newsbetting site - https://www.rashomonnews.com/

I haven't pulled any articles in a while, so it's a little outdated but I love newspaper3k.

Post reply on HN