Right now I use urlwatch[0] with custom python scripts that will extract data from the websites. Why should I switch to JobFunnel? What are the biggest selling points? [0]: https://github.com/thp/urlwatch
JobFunnel, a job website search aggregator
31–40 of 41 posts
Re: JobFunnel, a job website search aggregator
#32Unfortunately, a job search aggregator assumes that companies religiously post new jobs. The reality is when a company wants to hire it 'may' post a job to cover it butt in case of an EEO complaint. Mostly they have internal candidates, internally referred candidates, retained recruiters, applicants from career website who all rank above an external job site. My guess is a very low percentage of jobs actually get fil…
The federal government can (and routinely does) ask mid-sized to large companies for records of their job applicants to "prove" they are not discriminating against protected categories (women, minorities, the disabled, etc).
So if the CEO/hiring exec wants to hire his good old boy friend to a position no matter what the job will still be posted and applicants will be collected even if they have no chance of being hired.
Obviously I have no data on how prevalent this practice is but I've witnessed it firsthand, so it happens.
Re: JobFunnel, a job website search aggregator
#33Earlier quoted context omitted.
As always, consult a lawyer. But, my understanding is that you are allowed to scrape sites as long as you don't impact their ability to deliver the site to other users. In other words, don't DDoS them. Sites tried to ban scraping but last I remember seeing it was not enforceable unless it was done at high rates or maliciously. As for content, certain things like recipes aren't protected content because they are "list…
I don't think the question was: "is it legal to scrape", rather: "do they like to be scraped". If they wanted to, I'm sure they could make scraping harder (more annoying). Which, I suppose, thus comes down to: is being aggregated a net plus or minus for their business. Probably "it depends" on what the aggregator does with the data. So, just to get this pun in: it then comes down to: is being aggregated a net plus or…
It would be easier for them to provide an RSS feed or a free API if they wanted to share their data.
Re: JobFunnel, a job website search aggregator
#34Re: JobFunnel, a job website search aggregator
#35This is essentially what large job sites like Indeed do themselves, but they have entire teams maintaining the scraping pipeline. I've worked for one of their competitors.
One pet peeve I have with sites like indeed is all of the subterfuge that goes on. For instance, the half-assed sort by date feature. Indeed adds in month old sponsored postings with new postings, and often repeats those old postings on consecutive pages. Many sites also shamelessly reset their posting dates so that nothing is ever more than a week old. Stripping away the middleman's ability to manipulate the present…
It would be interesting to search for ads that were posted a long time ago and are still unfilled.
And it would be intersting to see how that add "posted 12 hours ago" is the same one that was posted 6 months ago and is currently being posted by 5 different recruiters with almost identical wording apart from their boilerplate.
And it would also be interesting to see the different salaries/ranges that are mentioned on different copies of the same ad. I've noticed different recruiters sometimes post the same ad, but with a different salary ceiling. Guess which number I'd like to have when negotiating... And if I see a job whose salary has been creeping up for a few months, that's an interesting trend too.
Re: JobFunnel, a job website search aggregator
#36Earlier quoted context omitted.
When I look at your signup form I can't really find my profession. I had this problem for a while now but maybe I should simply ask: I do industrial software engineering (in my case in automotive) that targets a mixture of embedded, desktop and server environments. This is done mostly in C/C++ with some Python, Shell and maybe Rust. What is the proper profession name for me? Is this a full stack engineer? Not likely…
I agree and I'm not sure either. Maybe if you are interested I can modify your category in the backend and set it to a custom one and start sending your C/C++/Embedded development remote jobs.
I have the same issue at signup as the GP - I find myself rather unsure what categories make sense for me on your signup page.
Similar to the GP, a mixture of embedded, servers, and webdev, except I wouldn't say I do just industrial. Feel free to look at my LinkedIn profile (the link is in my HN profile) if you think it could give you some ideas for additional categories on your signup page.
Re: JobFunnel, a job website search aggregator
#37Earlier quoted context omitted.
I agree and I'm not sure either. Maybe if you are interested I can modify your category in the backend and set it to a custom one and start sending your C/C++/Embedded development remote jobs.
I just took a look. Nice looking site, by the way :-) I have the same issue at signup as the GP - I find myself rather unsure what categories make sense for me on your signup page. Similar to the GP, a mixture of embedded, servers, and webdev, except I wouldn't say I do just industrial. Feel free to look at my LinkedIn profile (the link is in my HN profile) if you think it could give you some ideas for additional cat…
Re: JobFunnel, a job website search aggregator
#38Earlier quoted context omitted.
This wouldnt be that hard to do, but is it illegal to automate those submissions?
May not be illegal, but all platforms don't like it. And it's only a problem that needs solving because the internet is full of shit content. There are N amount of job postings, but recruiters and other "middle-men" have made it so that there are N * X * Y places a candidate has to apply to. Where X are the amount of recruiters and Y are the recruitment platforms/boards. They literally take their clients' requirement…
Re: JobFunnel, a job website search aggregator
#39Earlier quoted context omitted.
When I look at your signup form I can't really find my profession. I had this problem for a while now but maybe I should simply ask: I do industrial software engineering (in my case in automotive) that targets a mixture of embedded, desktop and server environments. This is done mostly in C/C++ with some Python, Shell and maybe Rust. What is the proper profession name for me? Is this a full stack engineer? Not likely…
I agree and I'm not sure either. Maybe if you are interested I can modify your category in the backend and set it to a custom one and start sending your C/C++/Embedded development remote jobs.
I'm just wondering wether non-web dev jobs don't exist anymore or are just out of fashion/not mentioned that often