Live data from Hacker News

Show HN: Python package to collect normalized news from almost any website

github.com

51–60 of 203 posts

Re: Show HN: Python package to collect normalized news from almost any website

#51
This looks great!

I read your blog post about how open-sourcing helped you find testers, which is a great step for such tools.

* Shameless plug *: Our web service, Feedity - https://feedity.com, helps create a custom feed for any news webpage, via a point-and-select feed builder and REST API.

Re: Show HN: Python package to collect normalized news from almost any website

#52

I'm not sure how to parse the following sentence: By newscatcherapi.com (this package is fully self-sufficient, you can just use it. No dependency on external services/API)

I interpret this as Created by but you do not need anything from us or from anyone else to get the software going, it just works out of the box.

Well the 'anyone else' part is wrong, someone has to provide the news.

Re: Show HN: Python package to collect normalized news from almost any website

#53
post #40

Earlier quoted context omitted.

Seems like a terrible idea to me. The two sides are at war, and if the way you sample them is by going 50-50, that encourages them to be more extreme because that will skew the average in their direction. We already see this in the media. You have the host and two people. Lets hear what person A says, lets hear what person B says. Who's right? Impossible to tell, otherwise you must be biased. And no mention that pers…

Educating yourself about every topic out there is absolutely impossible. Thats precisely why news businesses exist in the first place.

News categorically doesn't educate.

The Guardian (yes, ironically a provider of "News"), published an extract from the writings of "The Art of Thinking Clearly" author with some decent enough bullet points on this that are difficult to argue with:

https://www.theguardian.com/media/2013/apr/12/news-is-bad-ro...

Re: Show HN: Python package to collect normalized news from almost any website

#54

Earlier quoted context omitted.

Seems like a terrible idea to me. The two sides are at war, and if the way you sample them is by going 50-50, that encourages them to be more extreme because that will skew the average in their direction. We already see this in the media. You have the host and two people. Lets hear what person A says, lets hear what person B says. Who's right? Impossible to tell, otherwise you must be biased. And no mention that pers…

And the better alternative is...? What you say is correct but also worthless unless you provide a better way to do it.

> And the better alternative is...?

Actively researching both sources and stories, and not being a passive consumer who expects someone else to spoon-feed you a solution.

Re: Show HN: Python package to collect normalized news from almost any website

#55

For any news junkies heres, I've built https://maagnit.com which gathers both Left and Right leaning sources for any story and displays them altogether on one page. My approach has been, if we can't get neutral/objective coverage, getting comprehensive, 360 desgree coverage is a good alternative. These days, news bias is not only in the way a story is covered, but also which stories are covered. So, maagnit automatic…

[deleted]

Re: Show HN: Python package to collect normalized news from almost any website

#56

For any news junkies heres, I've built https://maagnit.com which gathers both Left and Right leaning sources for any story and displays them altogether on one page. My approach has been, if we can't get neutral/objective coverage, getting comprehensive, 360 desgree coverage is a good alternative. These days, news bias is not only in the way a story is covered, but also which stories are covered. So, maagnit automatic…

The thing about which stories to cover isn’t only about Left/Right. It’s mainly about what draws most attention.

I find most media biased towards conflict in that regard. The primary goal is to trigger emotions like rage and fear.

So for my self I find I’m happier not consuming “news” at all.

Re: Show HN: Python package to collect normalized news from almost any website

#57

For any news junkies heres, I've built https://maagnit.com which gathers both Left and Right leaning sources for any story and displays them altogether on one page. My approach has been, if we can't get neutral/objective coverage, getting comprehensive, 360 desgree coverage is a good alternative. These days, news bias is not only in the way a story is covered, but also which stories are covered. So, maagnit automatic…

a piece of feedback: please move the 'close' button on the pop-up video player to the top-right, where users usually expect it to be (ideally I would prefer no pop-up player at all, but I guess you had your reasons).

Re: Show HN: Python package to collect normalized news from almost any website

#58
post #44

This seems really cool! How does it work internally? Is it downloading the news from a RSS or is it crawling the content of the website? Or is the content coming from an external service? How are the feeds selected? Can we add more? who is maintaining them (in case the data is crawled)? Thanks!

hey, there is a sqlite DB that stores the RSS endpoints. Then we use feedparser python package to parse it.

Then why should I use this instead of a real Feedreader? What advantage has this?

Re: Show HN: Python package to collect normalized news from almost any website

#59

For any news junkies heres, I've built https://maagnit.com which gathers both Left and Right leaning sources for any story and displays them altogether on one page. My approach has been, if we can't get neutral/objective coverage, getting comprehensive, 360 desgree coverage is a good alternative. These days, news bias is not only in the way a story is covered, but also which stories are covered. So, maagnit automatic…

Seems like a terrible idea to me. The two sides are at war, and if the way you sample them is by going 50-50, that encourages them to be more extreme because that will skew the average in their direction. We already see this in the media. You have the host and two people. Lets hear what person A says, lets hear what person B says. Who's right? Impossible to tell, otherwise you must be biased. And no mention that pers…

[deleted]

Re: Show HN: Python package to collect normalized news from almost any website

#60
post #40

Earlier quoted context omitted.

Educating yourself about every topic out there is absolutely impossible. Thats precisely why news businesses exist in the first place.

News categorically doesn't educate. The Guardian (yes, ironically a provider of "News"), published an extract from the writings of "The Art of Thinking Clearly" author with some decent enough bullet points on this that are difficult to argue with: https://www.theguardian.com/media/2013/apr/12/news-is-bad-ro...

I've always found myself to very much agree with Jefferson's views [1] on the topic of news, and I agree with this piece as well. I observe in myself that I'm generally happier and more productive the less I expose myself to "the news".

I think there's a threshold of distance and size where it stops being useful to the average person. Too far away? Can't do anything about it? Better not weigh down your mind by getting stressed about it.

[1] http://press-pubs.uchicago.edu/founders/documents/amendI_spe...

Post reply on HN