Live data from Hacker News

Ever wondered how many open FTP servers there are?

github.com

61–70 of 100 posts

Re: Ever wondered how many open FTP servers there are?

#61

Good old archie... http://archie.icm.edu.pl/archie-adv_eng.html

Now this DOES bring on the nostalgia... :-) I recall there used to be a veronica too (Very Easy Rodent Oriented Network something or the other....), then a jughead too ...

I remember using the UI through telnet archie.mcgill.ca. It showed percent progress. The location used a 32-bit signed int. When the archive exceeded 2GB, the percentage became a negative count to 0% rather than count-up to 100%.

Re: Ever wondered how many open FTP servers there are?

#62

"All in all, there were exactly 18,454,087 things that responded to a banner fetch... The JSON file is about 4GiB." where can I download this JSON file? I only see the list of ips available.

I specifically left the mass scanning part out. If you want to experiment with scan data without scanning yourself, a good place to start is https://censys.io.

Re: Ever wondered how many open FTP servers there are?

#63
post #58

Earlier quoted context omitted.

Sure. Faster even with a better scheduler. I just wanted to show how the simplest and most redneck way still finishes in a reasonable amount of time. :-)

I was amazed how fast that went. Was fully expecting the story to unfold with how you rented out 100 AWS servers to complete the task, instead it was just one computer and only took hours.

It's all about reducing data offline before throwing the kitchen sink at the internet.

Re: Ever wondered how many open FTP servers there are?

#64
post #14

I got my first internet account on my high school's VAX in 1992 in order to download Dr. Dobb's code from ftp.mv.com. The VAX had a help file installed which was a list of thousands of anonymous FTP servers, most of which requested that you please not use anonymous FTP during business hours to avoid overloading them; shortly I was downloading all kinds of things from wuarchive.wustl.edu (which had a LOT of stuff) and…

"capitalizing Internet was still justifiable at the time"

Given the Internet is a particular thing, shouldn't it still be used as a proper noun?

Re: Ever wondered how many open FTP servers there are?

#65
post #14

I got my first internet account on my high school's VAX in 1992 in order to download Dr. Dobb's code from ftp.mv.com. The VAX had a help file installed which was a list of thousands of anonymous FTP servers, most of which requested that you please not use anonymous FTP during business hours to avoid overloading them; shortly I was downloading all kinds of things from wuarchive.wustl.edu (which had a LOT of stuff) and…

In my youth, I probably downloaded hundreds of gigabytes from wuarchive.wustl.edu, ftp.cdrom.com, metalab.unc.edu, and the like. Over a dial-up modem, no less. Before I had local Internet access (i.e., long distance calls), I used the various "FTP by e-mail" services with my free "Juno" e-mail account (they had toll-free numbers for access!).

"hundreds of gigabytes"? Do you mean megabytes? Don't know about you, but when I was downloading stuff from those sites, downloading "hundreds of gigabytes" would have literally have taken a few years at minimum, many decades more realistically.

Re: Ever wondered how many open FTP servers there are?

#66
post #64
post #14

I got my first internet account on my high school's VAX in 1992 in order to download Dr. Dobb's code from ftp.mv.com. The VAX had a help file installed which was a list of thousands of anonymous FTP servers, most of which requested that you please not use anonymous FTP during business hours to avoid overloading them; shortly I was downloading all kinds of things from wuarchive.wustl.edu (which had a LOT of stuff) and…

"capitalizing Internet was still justifiable at the time" Given the Internet is a particular thing, shouldn't it still be used as a proper noun?

AP Style Alert. Internet and web are no longer to be capitalized. Check the googles.

Re: Ever wondered how many open FTP servers there are?

#67
I used to leave a file called README on my public ftp directory, which contained only:

cat: README: No such file or directory

I'd occasionally get email from frustrated people who had trouble trying to read the README file, so I'd tell them to simply run "emacs README", and emacs would solve all of their problems. I don't know if my passive aggressive emacs evangelism ever worked, because I never heard back from them.

Re: Ever wondered how many open FTP servers there are?

#68
post #64

Earlier quoted context omitted.

"capitalizing Internet was still justifiable at the time" Given the Internet is a particular thing, shouldn't it still be used as a proper noun?

AP Style Alert. Internet and web are no longer to be capitalized. Check the googles.

I don't work for the AP so I will continue to capitalize it.

Re: Ever wondered how many open FTP servers there are?

#70

Earlier quoted context omitted.

This might be a useful starting point: https://blog.shodan.io/its-still-the-data-stupid/ Shodan crawls for most nosql/ queueing software including mongodb and redistribution. And related to OP: we also crawl for FTP and attempt anonymous as well as a few other things to better understand FTP deployments on the Internet.

Related to your related: Nice. Is this research public or commercial?

All the data is searchable for free on https://www.shodan.io
Post reply on HN