Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Gallery-dl – download images from several image hosting sites

github.com

Post reply on HN
Print view View original

41–50 of 68 posts

Re: Gallery-dl – download images from several image hosting sites

#41

Post by IngvarLynn »

DamnableNook wrote: post #39
IngvarLynn wrote: post #30

One obvious issue with both these downloaders is lack of proper modularization. Which greatly hinders adoption, I believe. I would expect some kind of plugin system. Naturally, there are attempts to fix that: https://github.com/un-def/dl-plus is one example. As a bonus that would help greatly with recent youtube-dl sort of situations and RIAA would have barely made a splash. Plenty of other features immediately come…

gallery-dl has almost all of these features, minus the GUI and desktop integration. Did you read the link?

Did you?

I did not find a single one.

Re: Gallery-dl – download images from several image hosting sites

#43

Post by ckharri »

NegativeLatency wrote: post #32
IngvarLynn wrote: post #30

One obvious issue with both these downloaders is lack of proper modularization. Which greatly hinders adoption, I believe. I would expect some kind of plugin system. Naturally, there are attempts to fix that: https://github.com/un-def/dl-plus is one example. As a bonus that would help greatly with recent youtube-dl sort of situations and RIAA would have barely made a splash. Plenty of other features immediately come…

As a former jdownlader user, it never stopped working but seems to be neglected. Not to mention the ability to pip install youtube-dl compared to getting jdownloder off of some software site with multiple dark patterns to dodge.

I still use jdownloader, it does it's job. It works on a wide range of sources, works on youtube very well. The install bit is true you literally need to google "jdowloader clean installers no adware" which is pretty bad

Re: Gallery-dl – download images from several image hosting sites

#44

Post by sneak »

dtien wrote: post #23
hprotagonist wrote: post #13

Earlier quoted context omitted.

ah, but i want a tarball of every photo/photogallery that i have liked . This seems to just be what I’ve ever posted.

not sure if this is sarcasm, but photos you liked aren't yours so this would be violating their privacy rules.

Your likes absolutely are your own interactions, and it's no violation of privacy to allow you access to data to which you already have access. You can't like it unless you can view it first. In fact (it's hidden but it's there) you can go back and view all of your past likes on Instagram.

This is not privacy, this is walled garden nonsense. Instagram thinks they own all your curation activity on the site, and they do not.

Re: Gallery-dl – download images from several image hosting sites

#45

Post by paulmd »

ckharri wrote: post #43
NegativeLatency wrote: post #32

Earlier quoted context omitted.

As a former jdownlader user, it never stopped working but seems to be neglected. Not to mention the ability to pip install youtube-dl compared to getting jdownloder off of some software site with multiple dark patterns to dodge.

I still use jdownloader, it does it's job. It works on a wide range of sources, works on youtube very well. The install bit is true you literally need to google "jdowloader clean installers no adware" which is pretty bad

the trick is to download the "other OS" version, that one is just a jar based application and doesn't have all the adware

Re: Gallery-dl – download images from several image hosting sites

#46

Post by DamnableNook »

IngvarLynn wrote: post #41
DamnableNook wrote: post #39

Earlier quoted context omitted.

gallery-dl has almost all of these features, minus the GUI and desktop integration. Did you read the link?

Did you? I did not find a single one.

I mean, proxy support is listed in the config docs[1]. Those docs also break down the functionality of gallery-do by module, leading me to believe you either didn’t read or didn’t understand the docs.

[1] https://github.com/mikf/gallery-dl/blob/master/docs/configur...

Re: Gallery-dl – download images from several image hosting sites

#47

Post by blt »

pbowyer wrote: post #15

Does anyone know of a downloader that works for private Facebook Groups? I'm a member of some local history groups and the material posted is amazing. I'd like to refer to it in the future, likely long after the posters are gone. I can't rely on Facebook being around then. Copying and pasting into a personal archive is slow when you want to capture everything (posts and comments) since you don't know which history yo…

Facebook actively wants to make this hard. I hope you figure out a way. If so, please post to HN. I think many Facebook group users and admins would be interested.

Re: Gallery-dl – download images from several image hosting sites

#48

Post by blt »

RamRodification wrote: post #20
pbowyer wrote: post #15

Does anyone know of a downloader that works for private Facebook Groups? I'm a member of some local history groups and the material posted is amazing. I'd like to refer to it in the future, likely long after the posters are gone. I can't rely on Facebook being around then. Copying and pasting into a personal archive is slow when you want to capture everything (posts and comments) since you don't know which history yo…

There are browser extensions that simply lets you save all (or some selection of) images that load on a website. Maybe that's good enough if you can't find one that has proper support for Facebook groups. I imagine you could quite quickly just click through the material and save it. Won't work for text or metadata like descriptions/titles I guess...

Scraping images is not enough. There's still pagination to deal with. It's also important to scrape the post text and comments.

Re: Gallery-dl – download images from several image hosting sites

#49

Post by IngvarLynn »

DamnableNook wrote: post #46
IngvarLynn wrote: post #41

Earlier quoted context omitted.

Did you? I did not find a single one.

I mean, proxy support is listed in the config docs[1]. Those docs also break down the functionality of gallery-do by module, leading me to believe you either didn’t read or didn’t understand the docs. [1] https://github.com/mikf/gallery-dl/blob/master/docs/configur...

[1] describes a very basic proxy support indeed. However I can't imagine a use case for that. What is useful is a support for rotation of proxy list with every download request together with auto-updating such list.

As for modules - splitting each site's support by file is an absolute minimum for sanity. Keeping up all that support in one project quickly becomes quite a chore for a single project maintainer. The whole process fetching the while project and initiating a PR on a github is also rather awkward for developer too. Hence the existence of https://github.com/un-def/dl-plus project.

Re: Gallery-dl – download images from several image hosting sites

#50

Post by skeletonjelly »

fireattack wrote: post #14
egeozcan wrote: post #6

Not to take anything from how great it is to have something like this, some of the supported sites have heavy rate limiting and bot detection and using this with your account can easily get you banned. For example, I had immense difficulty parsing my own saved posts from instagram (used a one-off script that runs in the browser).

There is instaloader [1] [1] https://instaloader.github.io/

I had an account rate limited with this, though maybe I was using it wrong. It ended up forcing me to give it a mobile number to confirm which I didn't want to do.

Not sure why they'd do this when a spammer (not me) would just create a new account. I was just archiving twice a day with a random sleep time between accounts

Post reply on HN