What technologies are under your site • Hacker News Board

Re: What technologies are under your site

#41

Post by tectonic » Sun, Jul 10, 2011, 4:56 AM UTC

mmaunder wrote: post #32

tectonic wrote: post #10

Hey guys, I made this site and just gave a talk about it at SHDH. Someone must have submitted it. Thanks for all your feedback, I really appreciate it!

Awesome! Suggestions: Do a reverse lookup on the site's IP and add matchers for the hostnames that show up. Mention if they're round robining their DNS. Add nmap OS fingerprinting. Do a traceroute and log the IP of the closest router (final hop) to the site and add matching for that. Add a wiki interface and build a crunchbase like app. Add archiving of data and monitoring over time (as netcraft did in their original…

Thanks for the great feedback!

Re: What technologies are under your site

#42

Post by tectonic » Sun, Jul 10, 2011, 4:57 AM UTC

suyash wrote: post #38

tectonic wrote: post #10

Hey guys, I made this site and just gave a talk about it at SHDH. Someone must have submitted it. Thanks for all your feedback, I really appreciate it!

I posted it buddy, I liked your demo a lot!

Thanks :)

Re: What technologies are under your site

#43

Post by tectonic » Sun, Jul 10, 2011, 4:59 AM UTC

bstar wrote: post #22

So yahoo.com is using jQuery now? There's like 10 references to YUI and zero for jQuery in the source... interesting algorithm.

It was found on yahoo.match.com, which is a bug because it shouldn't go off domain. I'll look into it.

http://underthesite.com/technologies/jQuery/matchers/5?site=...

Re: What technologies are under your site

#44

Post by MJR » Sun, Jul 10, 2011, 5:04 AM UTC

jbhelms wrote: post #30

tectonic wrote: post #10

Hey guys, I made this site and just gave a talk about it at SHDH. Someone must have submitted it. Thanks for all your feedback, I really appreciate it!

It incorrectly stated that my site uses cold fusion.

What's the site?

Re: What technologies are under your site

#45

Post by nbertram » Sun, Jul 10, 2011, 5:13 AM UTC

Nice site guys; reminds me of www.quarkbase.com in some ways. But I like the focus on what's under the hood - keep up the good work.

Re: What technologies are under your site

#46

Post by jf » Sun, Jul 10, 2011, 5:26 AM UTC

tectonic wrote: post #10

Hey guys, I made this site and just gave a talk about it at SHDH. Someone must have submitted it. Thanks for all your feedback, I really appreciate it!

Awww, I wish I didn't have to leave SHDH before the lightning talks started!

I wrote a Ruby program to do something similar to what you're doing: https://github.com/jpf/domain-profiler - If you ever start profiling sites using information from places other than what the server returns, perhaps what I've done can help inspire you?

Re: What technologies are under your site

#47

Post by tectonic » Sun, Jul 10, 2011, 5:26 AM UTC

jf wrote: post #46

tectonic wrote: post #10

Hey guys, I made this site and just gave a talk about it at SHDH. Someone must have submitted it. Thanks for all your feedback, I really appreciate it!

Awww, I wish I didn't have to leave SHDH before the lightning talks started! I wrote a Ruby program to do something similar to what you're doing: https://github.com/jpf/domain-profiler - If you ever start profiling sites using information from places other than what the server returns, perhaps what I've done can help inspire you?

Thanks, I'll check it out!

Re: What technologies are under your site

#48

Post by [deleted] » Sun, Jul 10, 2011, 5:29 AM UTC

JoshTriplett wrote: post #33

mmaunder wrote: post #32

Earlier quoted context omitted.

Awesome! Suggestions: Do a reverse lookup on the site's IP and add matchers for the hostnames that show up. Mention if they're round robining their DNS. Add nmap OS fingerprinting. Do a traceroute and log the IP of the closest router (final hop) to the site and add matching for that. Add a wiki interface and build a crunchbase like app. Add archiving of data and monitoring over time (as netcraft did in their original…

nmap OS fingerprinting seems a bit aggressive, but reverse-DNS checking seems like a great way to check which hosting platform a site uses.

[deleted]

Re: What technologies are under your site

#49

Post by aorshan » Sun, Jul 10, 2011, 5:42 AM UTC

Noticed that not a single website is using django. Am I missing something?

Re: What technologies are under your site

#50

Post by tectonic » Sun, Jul 10, 2011, 5:43 AM UTC

aorshan wrote: post #49

Noticed that not a single website is using django. Am I missing something?

I'm not sure that there is a django matcher yet. Django is hard to reliably detect. Do you know of a good signature (like a header or form token) that it always uses?