Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

You-get: Dumb downloader that scrapes the web

github.com

Post reply on HN
Print view View original

21–30 of 154 posts

Re: You-get: Dumb downloader that scrapes the web

#21

Post by chucksmash »

seneca wrote: post #16
thih9 wrote: post #15

Earlier quoted context omitted.

It’s relatively easy to write a failing test and it massively cuts down the work related to moderating issues. Also, reduces the danger of github issues turning into a support forum. If this results in the project being easier to maintain and being maintained longer, then I’m fine with this.

> It’s relatively easy to write a failing test and it massively cuts down the work related to moderating issues. Relative to what? Learning someone else's code base well enough to write a useful test is not trivial. It's not a bad method, but the vast majority of users won't be capable of writing a test that encapsulates their issue.

In the case of this tool, adding a failing test case looks trivial if you've got the URL of a page it fails on.

Provided the maintainer is willing to provide some minimal guidance to issue reporters who lack the necessary know-how, it even seems like a clever back door way of helping people learn to contribute to open source.

Re: You-get: Dumb downloader that scrapes the web

#22

Post by dotancohen »

thangngoc89 wrote: post #10
kylecazar wrote: post #7

Earlier quoted context omitted.

They want you to just submit a PR with a test that, if passed, would indicate the problem for you is fixed.

What happens if you don’t know Python? Python is a relatively easy language to learn but no way I’m gonna learn Python just to report an issue

If the bug is egregious enough, somebody else will find it. If the bug is important enough to you but esoteric, then ask on a forum or enlist the help of someone you know who does know Python.

How do you currently submit bug reports on e.g. MS Word or Adobe Photoshop? This way is certainly more open than those commonly-deployed software.

Re: You-get: Dumb downloader that scrapes the web

#23

Post by [deleted] »

papichulo2023 wrote: post #20
Filligree wrote: post #14

Earlier quoted context omitted.

Good chance you wouldn't be writing good bug reports either, then. Github issues have enough noise that a first-pass filter like this feels like a good idea, even if it has some false positives.

I fail to see the logic in your comment. Just another case of Goodhart's law.

[deleted]

Re: You-get: Dumb downloader that scrapes the web

#26

Post by achierius »

papichulo2023 wrote: post #20
Filligree wrote: post #14

Earlier quoted context omitted.

Good chance you wouldn't be writing good bug reports either, then. Github issues have enough noise that a first-pass filter like this feels like a good idea, even if it has some false positives.

I fail to see the logic in your comment. Just another case of Goodhart's law.

This isn't really a metric though. It's a formal existence proof that the bug exists. The key difference IMO is that you have to create a test which A) looks (to the maintainer) like it should pass, while simultaneously B) not passing. It's much harder to game.

There are other cases where Goodharts Law fails as well: consider quant firms, where the "metric" used to judge a trader is basically how much money you pull in. Seems to be working fine for them

Re: You-get: Dumb downloader that scrapes the web

#27

Post by epcoa »

thangngoc89 wrote: post #10
kylecazar wrote: post #7

Earlier quoted context omitted.

They want you to just submit a PR with a test that, if passed, would indicate the problem for you is fixed.

What happens if you don’t know Python? Python is a relatively easy language to learn but no way I’m gonna learn Python just to report an issue

Did you (or anyone) in this thread look to see exactly what they are looking for with their provided examples?

https://github.com/soimort/you-get/pull/2680/commits/313b8d2...

You do not need to know Python deeply to construct what they are expecting. They’re not actually looking for a unit test or something.

Re: You-get: Dumb downloader that scrapes the web

#28

Post by zufallsheld »

politelemon wrote: post #2

It seems they do not want you to report an issue without an accompanying fix for it. > If you would like to report a problem you find when using you-get, please open a Pull Request, which should include [snip] Can't say I've encountered this before.

Serverspec does the same: https://github.com/mizzy/serverspec?tab=readme-ov-file#maint...

Re: You-get: Dumb downloader that scrapes the web

#30

Post by tcsenpai »

I like this. I am imagining a companion extension for chrome/ff that uses you-get as a backend to implement it in a seamless way. Forward thinking idea: imagine going on youtube and have you-get extension bypass the youtube player and playing the content directly without ads. When I say youtube I might also say any other platform.
Post reply on HN