Live data from Hacker News

Red Engine: modern scheduling framework for Python applications

red-engine.readthedocs.io

51–55 of 55 posts

Re: Red Engine: modern scheduling framework for Python applications

#51
> Red Engine provides more features than Crontab and APScheduler and it is much easier to use than Airflow.

Correct me if I'm wrong, but the framework more powerful than Crontab and easier to use than Airflow is Celery. But Celery is not even mentioned here, why?

Re: Red Engine: modern scheduling framework for Python applications

#52
post #51

> Red Engine provides more features than Crontab and APScheduler and it is much easier to use than Airflow. Correct me if I'm wrong, but the framework more powerful than Crontab and easier to use than Airflow is Celery. But Celery is not even mentioned here, why?

I've never considered using Celery on it's own - it's part of my typical web app stack. Do you mind sharing some examples of how you're using celery?

Re: Red Engine: modern scheduling framework for Python applications

#53

This fits my use case so perfectly! I have a very small internal app taking care of organizing seminar talks, calendars, email announcements, recordings of the talks, and signups. It is a single python file of less than 1500 lines and an sqlite database. This library is so perfect for taking care of scheduled events. Everything else I have found is ridiculously over-complicated of a solution.

Can you share repo to your application?

I am a research scientist that knows how to write numerical code, but I do not trust myself to write secure web software. Which is the reason I regrettably keep the app in question internal and the source unreleased.

To give a more useful answer though: it just uses cherrypy as a web framework and the zoom python bindings and sqlite. Nothing sophisticated, just a CRUD app that occasionally needs to download a large file and transcoded it in the background (which is where this scheduler will be used).

Re: Red Engine: modern scheduling framework for Python applications

#54
post #27

Earlier quoted context omitted.

Other schedulers have a durable database of attempted runs. This doesn't seem to have anything like that.

Would you have a recommendation for an easy to use Python scheduler with such a feature for a personal project?

https://www.prefect.io/ is also pretty easy.

Re: Red Engine: modern scheduling framework for Python applications

#55
This is cool, you could provide resilience to Red Engine, by providing it a backend using Flyte.org. Checkout example of making a new API on top of Flyte which has similarish feel - https://unionml.readthedocs.io/en/latest/index.html#quicksta....

Thus users could continue using RED, and if they want to scale to multiple machines or want resilience, you could allow them to switch out the backend to Flyte.

Disclosure: I am maintainer of Flyte. This is just a suggestion. Great work!

Post reply on HN