Live data from Hacker News

The curl-wget Venn diagram

daniel.haxx.se

51–60 of 159 posts

Re: The curl-wget Venn diagram

#51
In the olden times we used wget when we wanted to mirror a website. It is a specialized tool.

Curl is a general purpose request library with a cli frontend (also used embedded from other programs, or as a standard library API in PHP etc).

Re: The curl-wget Venn diagram

#52

I would also add at least "sane default options", "continues downloads" and "retries on error" to the Wget column. I recently had to write a script that downloads a very large file over a somewhat unreliable connection. The common wisdom among the engineers is that you need to use Wget for this job. I tried using curl but out of the box it could not resume or retry the download. I would have to study the manual and s…

Both tools have their use-cases. I think with the advent of LLMs like ChatGPT it has also become a lot easier to get the proper command line incantation for whatever tool you're using. Even if you've read the manual previously, it's easy to forget the exact flags you want to use, and validating the generated command line is usually less effort than having to build it up yourself from scratch by reading the manual. Wi…

I like tldr for quick examples. If it doesn't have what I need, then I fall back to phind or some other llm. Nice thing about tldr is there's an offline version.

https://tldr.inbrowser.app/pages/common/curl

https://tldr.inbrowser.app/pages/common/wget

Re: The curl-wget Venn diagram

#55
post #21

Seems maybe dated. For example, it excludes both of these from wget in the diagram > HTTP PUT wget --method=PUT --body-data= > proxies ... HTTPS wget --use-proxy=on --https_proxy= https://example.com Curl consistently has more options and flexibility, but there's several things on the right side of the venn diagram where wget does have some capability.

Looks like there's FTP support also (based on the man page).

Re: The curl-wget Venn diagram

#56

Earlier quoted context omitted.

I just look at my curl / wget note for some sane examples. i cant believe one needed chatgpt to be productive

You don't need much of anything, it's just another tool to help people figure stuff out. If you've already invested the time in reading through the manuals for these tools then maybe you don't get much out of something like ChatGPT, but consider that there's thousands of new people entering the industry every year and the number of tools which they're expected to learn to use has increased over time.

It's fine when you've read the man page at least once. If you just cowboy your way through every task, you'll never even be aware of what your tools can do. Which results in comments we've all seen: "I can't believe curl/Firefox/vim/readline/whatever can do something like that!" about something so trivial that every good poweruser/sysadmin has known it for decades (because it's in the man page).

Re: The curl-wget Venn diagram

#58

I would also add at least "sane default options", "continues downloads" and "retries on error" to the Wget column. I recently had to write a script that downloads a very large file over a somewhat unreliable connection. The common wisdom among the engineers is that you need to use Wget for this job. I tried using curl but out of the box it could not resume or retry the download. I would have to study the manual and s…

I would use GNU Wget2 for this. It's supposed to be a wget successor.

Re: The curl-wget Venn diagram

#59

I recently found [axel], which is very impressive wget-like tool for larger files. [axel]: https://github.com/axel-download-accelerator/axel

Used to use parallel downloading of axel a lot 20 years ago whe it’s long fat pipes, window scaling wasn’t always enabled, and it wasn’t on the corporate proxy I had to use.
Post reply on HN