Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Sitebulb, a website crawler and auditor for SEOs

sitebulb.com

Post reply on HN
Print view View original

61–70 of 75 posts

Re: Show HN: Sitebulb, a website crawler and auditor for SEOs

#61

Post by cubano »

hathawayp wrote: post #37
cubano wrote: post #35

Avast free WebShield on Win7 is giving me a FileRepMalware error and is aborting the download and connection. I am not exactly an expert on Avast and this particular error but perhaps someone here would like to know about this.

That's frustrating, sorry. It's a 'reputation issue', that over-protective anti-virus software doles out to smaller software vendors like ourselves. Basically they don't know if it is good or bad because we haven't had millions of installations. i.e. it's a false positive

Sure no worries..of course I personally knew that, but I thought it might be useful for you guys to know its being blocked by the AV.

It's a really nice product BTW...good job.

Re: Show HN: Sitebulb, a website crawler and auditor for SEOs

#62

Post by hathawayp »

blacksmith_tb wrote: post #60

Hmm, I set it to crawl our little Ghost blog (e.g. blog.example.com) and it immediately jumped to spidering our main site (e.g. www.example.com). Now, I imagine if I had properly poked at the Advanced settings I could have limited it to the initial subdomain, but I would have expected that to be the default...

It should stick the subdomain you specify in the start URL, unless there is a redirect or something. Other subdomains won't be crawled, although it will HTTP status check links to subdomains. So possibly that is what you saw in the URL log on the crawl progress page?

If you want me to take a closer look send the subdomain over to support@sitebulb.com and I'll see what's going on.

Re: Show HN: Sitebulb, a website crawler and auditor for SEOs

#63

Post by hathawayp »

walshemj wrote: post #56
hathawayp wrote: post #2

Hey HN, Sitebulb is a desktop crawler for Windows and Mac, specifically designed for SEO consultants/agencies. Me and my business partner have been building it for the last 2 years or so, and we're finally launching it today. It's main differentiating factors: 1. Scale – it can comfortably crawl 500,000+ page websites despite being a desktop program. 2. Reporting – it does a lot of data manipulation and processing so…

The problem is for big crawls( and 500k is not large) you probably don't want to use your desktop for example my home adsl is only 3.5 as we are 6kyards from the exchange. And I would not want to get my works 100Mb banned by google. This is where services like deep crawl come in to play I can set up my sites to be crawled at night and look at the reports in the morning. And another problem I found is desktop crawlers…

Yeah for really big crawls your probably better off sticking it on a server or AWS, as much as anything so you don't need to leave your computer on for ages.

But Sitebulb is not resource hungry in the same was as other desktop crawlers. It saves to disk instead of using RAM, so you don't experience the same limitations.

I'm not sure what you mean about Google. There is no link between Sitebulb and Google - it doesn't visit Google at all, so there is no risk of banning. Using it on your 100 Mb work line would be ideal.

Re: Show HN: Sitebulb, a website crawler and auditor for SEOs

#64

Post by seano314 »

SnowingXIV wrote: post #36

What's this doing differently or better than screamingfrog? Which is also a desktop program and provides quite robust information. SF has been one of the standard industry tools for those doing SEO for years.

Agreed. This seems like SF + Gephi for 7x the price.

Re: Show HN: Sitebulb, a website crawler and auditor for SEOs

#65

Post by WA »

toss1 wrote: post #45
hashmal wrote: post #42

Earlier quoted context omitted.

In a sense, all software is service. After all, what you buy is a license, the right to use the software, you don't buy the software itself. I suppose the US doesn't view it this way, but it definitely varies from country to country.

Technically, that's correct, although it's a conceit that was foisted upon us by the software industry, partly as an artifact of copyright law and partly to gain more control over their product than others could gain. As futile as it is, I'd rather see the concept go away than see it further enshrined in subscription services.

The concept won’t go away, because users expect updates. The times when software actually was finished are over.

If we don’t expect software to have any updates at all, we can go back to one time fees.

Re: Show HN: Sitebulb, a website crawler and auditor for SEOs

#66

Post by gog »

seibelj wrote: post #19
throwaway2016a wrote: post #9

This looks really good. My only comment I have is that if I am purchasing a piece of desktop software I expect there to be at least the option of an annual license. Monthly feels more like a service than a product and I think of desktop software as a product. But I realize Desktop software pricing is evolving so this may just be old school thinking on my part. Also, if I'm a Mac user (I am) I expect to be able to buy…

I am personally fine with a monthly fee for desktop software. If I'm paying for software, it's up to the person who sells the software to decide how I should pay, and for me to decide if it's worth it.

I am definitively not fine with that. Of course it's up to the person selling the software to decide on the pricing model, but it's also up to the customers to voice their opinion.

I refuse to buy software that is subscription based. The closest to this that I find OK is PHPStorm which has a hybrid model where if you pay for a year you get to keep the version you installed at the beginning of your subscription (or after a year of monthly payments have been made).

I don't expect companies to work on the software for free, if there is an upgrade worth upgrading I am prepared to pay for it.

Re: Show HN: Sitebulb, a website crawler and auditor for SEOs

#67

Post by MattLeBlanc001 »

hathawayp wrote: post #13

Sorry, I meant to say, there's a free 14 day trial available to anyone once you download the software (no credit card required).

I keep trying to sign up, but it prompt me with: " you already have an account...", when in fact I don't.

Re: Show HN: Sitebulb, a website crawler and auditor for SEOs

#68

Post by hathawayp »

seano314 wrote: post #64
SnowingXIV wrote: post #36

What's this doing differently or better than screamingfrog? Which is also a desktop program and provides quite robust information. SF has been one of the standard industry tools for those doing SEO for years.

Agreed. This seems like SF + Gephi for 7x the price.

We should put that on our homepage.

Re: Show HN: Sitebulb, a website crawler and auditor for SEOs

#70

Post by lpasselin »

hathawayp wrote: post #57
chad_strategic wrote: post #55

Linux version?

I'm afraid not, at least not yet. It's something we'll work on if the demand appears to be there. Right now we are focused on other features that appear to be a higher priority to our users.

I'd also be interested
Post reply on HN