Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Posthook – Job Scheduling as a Service

posthook.io

Post reply on HN
Print view View original

51–60 of 76 posts

Re: Show HN: Posthook – Job Scheduling as a Service

#51

Post by cgenuity »

nickjj wrote: post #49

Just curious, why would I use this instead of Sidekiq, Celery or any other job / background worker service that runs along side my app? Almost all popular job processing libraries in all major frameworks support executing 1 off tasks with robust retry policies and even support recurring tasks. The operational complexity is really just running the sidekiq or celery command in another Docker container or if you don't u…

I understand Posthook may not be the best solution for everyone's scheduled tasks. It seems like for that project you had the expertise, time, and risk tolerance to set up that one DO server to handle all your needs. Other developers may be in a different situation and may find Posthook useful.

> How much would it cost to do 3 million requests per month?

If you want to use Posthook to schedule 3 million requests a month please email support [at] posthook.io and we can work out a special plan and support contract. Do keep in mind that background jobs and scheduled jobs are two different things and what I aim for Posthook to solve are scheduled jobs. I suspect a big part of those 3 million were background jobs.

> Also how would you set up custom retry policies?

The retry policy is fixed at the moment but it seems like this a common request so I want to roll that feature out soon.

Re: Show HN: Posthook – Job Scheduling as a Service

#52

Post by bloopernova »

paddy_m wrote: post #16

I would be really interested in a distributed job running system with a scheduler. I want a UI where I can set jobs via a schedule that run on one of many workers. In that same UI I want to be able to look at failed jobs and see all of the output from that job. I don't want to have to ssh over to the box where the job ran to retrieve a log file. I once had a job where we used Tidal Enterprise Scheduler which poorly i…

Rundeck, as others have indicated, will do just that.

I've used Tidal too, it's utterly horrible and universally hated by anyone I know who has used it. What took months to set up and debug in Tidal, took us hours in Rundeck.

Re: Show HN: Posthook – Job Scheduling as a Service

#53

Post by ralfhn »

baby_wipe wrote: post #22

Does anyone know of a free service that lets you run a few scheduled CURL requests each week?

You could leverage Zapier to do this. Their pricing suggests you can make two-step Zaps for free and that's all you'd need.

Step 1 - schedule Step 2 - outgoing webhook

It takes all of 5 minutes to set things up but we have a pro account so I haven't tried the free tier yet.

Re: Show HN: Posthook – Job Scheduling as a Service

#54

Post by wrs »

cgenuity wrote: post #51
nickjj wrote: post #49

Just curious, why would I use this instead of Sidekiq, Celery or any other job / background worker service that runs along side my app? Almost all popular job processing libraries in all major frameworks support executing 1 off tasks with robust retry policies and even support recurring tasks. The operational complexity is really just running the sidekiq or celery command in another Docker container or if you don't u…

I understand Posthook may not be the best solution for everyone's scheduled tasks. It seems like for that project you had the expertise, time, and risk tolerance to set up that one DO server to handle all your needs. Other developers may be in a different situation and may find Posthook useful. > How much would it cost to do 3 million requests per month? If you want to use Posthook to schedule 3 million requests a mo…

Once you have a retry policy, you pretty much by definition have scheduled jobs, so just slap an API on there and you’re all set. (jk)

Re: Show HN: Posthook – Job Scheduling as a Service

#55

Post by ralfhn »

This is neat, nice work OP.

I haven't seen this mentioned yet but you could leverage Zapier.com for this type of work. They have a "schedule" app you can pipe it into an outgoing webhook to achieve the same result.

It's pretty powerful. for example, at work, we wanted to run a specific task at different times: nightly, after deploys, and using a slack command. This was all achieved using 3 Zaps (Zapier apps) and it took no more than 30 minutes for the whole thing.

Re: Show HN: Posthook – Job Scheduling as a Service

#56

Post by kodablah »

baby_wipe wrote: post #22

Does anyone know of a free service that lets you run a few scheduled CURL requests each week?

For free on app engine, you can have a cron trigger a local URL which can then invoke a remote URL. I do this every 8 hours (I actually go one further and have that external URL be a Google Cloud function which does a bit of serverless work for me, also at no cost). See here: https://github.com/cretz/badads/tree/master/cron

Re: Show HN: Posthook – Job Scheduling as a Service

#57

Post by tazjin »

pbreit wrote: post #48
cgenuity wrote: post #2

Hello all! I built Posthook as a simple solution for web applications to schedule one-off tasks. It lets you schedule a request back to your application for a certain time, with an optional JSON payload. It can be an alternative to running your own systems like Sidekiq, Celery, or Quartz and the operational overhead that comes along with them. Cron jobs and cloud provider tools like CloudWatch Events are also used fo…

What is the absolute easiest way to do this on your own machine?

systemd timers most likely. You already have systemd and unit configurations are small.

For dynamic stuff using normal systemd templates should work.

Re: Show HN: Posthook – Job Scheduling as a Service

#59

Post by nickjj »

cgenuity wrote: post #51
nickjj wrote: post #49

Just curious, why would I use this instead of Sidekiq, Celery or any other job / background worker service that runs along side my app? Almost all popular job processing libraries in all major frameworks support executing 1 off tasks with robust retry policies and even support recurring tasks. The operational complexity is really just running the sidekiq or celery command in another Docker container or if you don't u…

I understand Posthook may not be the best solution for everyone's scheduled tasks. It seems like for that project you had the expertise, time, and risk tolerance to set up that one DO server to handle all your needs. Other developers may be in a different situation and may find Posthook useful. > How much would it cost to do 3 million requests per month? If you want to use Posthook to schedule 3 million requests a mo…

> I suspect a big part of those 3 million were background jobs.

Yep, almost all of them were tasks that should be executed as soon as possible, but Celery also allows for you to schedule tasks at a future date, and deal with running scheduled tasks at a repeated time (every Sunday at 3am, etc.).

As for the price, I was just curious for the sake of wanting to compare it to the $20 / month DO set up.

Thanks for the answers.

Re: Show HN: Posthook – Job Scheduling as a Service

#60

Post by jwilsco »

ben509 wrote: post #45
mcintyre1994 wrote: post #13

Earlier quoted context omitted.

Neat! We've been doing something like this at work, and another simple solution (curious if your Google cloud infrastructure is built on something similar) is Azure Service Bus queues with a function app trigger. Unlike AWS SQS, Azure SB queues can have items scheduled to be queued at an arbitrary time, see https://docs.microsoft.com/en-us/dotnet/api/microsoft.azure.... . SQS can only delay up to 15 minutes, so you h…

Interesting... AWS leaked that subscriptions to SQS are in the works, but it's good to see that Azure has that already.

> AWS leaked that subscriptions to SQS are in the works

Interesting, where did you hear that?

Post reply on HN