Live data from Hacker News

Show HN: Python package to collect normalized news from almost any website

github.com

71–80 of 203 posts

Re: Show HN: Python package to collect normalized news from almost any website

#71

Earlier quoted context omitted.

Well, we hat is quite similar to what we are doing at newscatcherapi.com. We collect tons of news data and let you query it with an API

Not selfhosted, isn't it? By which I mean it costs money.

Yeah. Though. It will have a free plan. And our hosting cost quite a lot so (imho) it’s almost always must cheaper to buy a ready solution.

Re: Show HN: Python package to collect normalized news from almost any website

#72

Earlier quoted context omitted.

hey, there is a sqlite DB that stores the RSS endpoints. Then we use feedparser python package to parse it.

Then why should I use this instead of a real Feedreader? What advantage has this?

I think you mean feedparser. It knows how to parse the feed. So you have to give it the feed’s url

Re: Show HN: Python package to collect normalized news from almost any website

#73
post #36

Earlier quoted context omitted.

We use the MMP system in NZ and it seems to work quite well, though needs a bit of fine tuning as currently you need 5% to get into a coalition and that is slightly too high.

Since New Zealand passed MMP 30 years ago, every Prime Minister has come from the same two parties that have dominated NZ politics since 1935. Two party systems also are built on coalitions. It isn't as if "Democrat" or "Labor" is a unified ideology. I'm all for MMP but I don't think it will fix any problems in American politics. Just introducing MMP would add another veto point in an American political system that a…

*Accomplish anything good.

Re: Show HN: Python package to collect normalized news from almost any website

#74

Earlier quoted context omitted.

Then why should I use this instead of a real Feedreader? What advantage has this?

I think you mean feedparser. It knows how to parse the feed. So you have to give it the feed’s url

No, I mean feedreader. A Feedreader is a service which collects and parses rss-files, then makes them accessable in an interface for the user. Similar to a mailclient, but for rss.

This package seems to do the first part, collecting and parsing, but lacks the interface. So what is the point of it?

And if this is maintaining it's own config for sources, can I even add my own sources? Or is this just an elaborated OPML-file with attatched business-logic?

Re: Show HN: Python package to collect normalized news from almost any website

#75
Why did you choose to ship the list of RSS feeds as an SQL database? This makes it hard to keep it up to date and submit pull requests with additional sources. Would it not be better to keep that info in a json file or a dict / list in a python module?

Re: Show HN: Python package to collect normalized news from almost any website

#76
post #67

Earlier quoted context omitted.

Seems like a terrible idea to me. The two sides are at war, and if the way you sample them is by going 50-50, that encourages them to be more extreme because that will skew the average in their direction. We already see this in the media. You have the host and two people. Lets hear what person A says, lets hear what person B says. Who's right? Impossible to tell, otherwise you must be biased. And no mention that pers…

To be honest I don't find "verifiable fact" to be worth much these days. If coronavirus has done anything it has highlighted how easy it is to do wrong. Journalists and politicians alike getting drawing incorrect insights from data. Meanwhile so little of the data surrounding coronavirus is comparable. You have countries only recording cases if the patient was hospitalised (not if they tested positive) and cause of d…

You say that verifiable facts don't count for much and then as an example point to a model? A model isn't a fact.

That someone made assumptions and drew conclusions might be a fact. But the assumptions might or might not be facts, and the conclusions certainly aren't facts. As a general rule, if it's in the future, it's not a fact.

Re: Show HN: Python package to collect normalized news from almost any website

#78
post #67

Earlier quoted context omitted.

Seems like a terrible idea to me. The two sides are at war, and if the way you sample them is by going 50-50, that encourages them to be more extreme because that will skew the average in their direction. We already see this in the media. You have the host and two people. Lets hear what person A says, lets hear what person B says. Who's right? Impossible to tell, otherwise you must be biased. And no mention that pers…

To be honest I don't find "verifiable fact" to be worth much these days. If coronavirus has done anything it has highlighted how easy it is to do wrong. Journalists and politicians alike getting drawing incorrect insights from data. Meanwhile so little of the data surrounding coronavirus is comparable. You have countries only recording cases if the patient was hospitalised (not if they tested positive) and cause of d…

Just like bias by choosing which stories to cover, you can choose which facts to confirm and debunk. Snopes used to be where I went to debunk urban legends. It seems they’ve taken a more political bent now. Their fact verification is still true, but it does seem like they fact check with an agenda now.

Re: Show HN: Python package to collect normalized news from almost any website

#79

Earlier quoted context omitted.

And the better alternative is...? What you say is correct but also worthless unless you provide a better way to do it.

> And the better alternative is...? Actively researching both sources and stories, and not being a passive consumer who expects someone else to spoon-feed you a solution.

You have the time to dredge up sources and check their veracity every time you read an article? Often sources are private but verified by the journalist. This is why journalism exists and has a code of ethics. You can’t just look every claim up on Wikipedia.

Re: Show HN: Python package to collect normalized news from almost any website

#80

For any news junkies heres, I've built https://maagnit.com which gathers both Left and Right leaning sources for any story and displays them altogether on one page. My approach has been, if we can't get neutral/objective coverage, getting comprehensive, 360 desgree coverage is a good alternative. These days, news bias is not only in the way a story is covered, but also which stories are covered. So, maagnit automatic…

Looks like it’s getting hugged to death now, but I’ve been looking for an alternative to Google News for a while now. I want an aggregator that doesn’t “learn my preferences” and tries to collect balanced coverage. Thanks for building this and I can’t wait to check it out.
Post reply on HN