Beefy Boxes and Bandwidth Generously Provided by pair Networks
XP is just a number

Minion as a job scheduler?

by 1nickt (Abbot)
on Aug 22, 2021 at 12:03 UTC ( #11136024=perlquestion: print w/replies, xml ) Need Help??

1nickt has asked for the wisdom of the Perl Monks concerning the following question:

Hello all,

At $work we have need of a job scheduler, and I am wondering whether Minion is the appropriate tool. We've never used it because we had our own job queue built before it arrived. From reading the doc it appears that Minion is intended to be used as a job queue rather than a job scheduler where jobs might be scheduled many days in the future ... but on the other hand there's nothing to indicate that there is a limit on the delay that can be set.

Anyone using it for this type of task? Or is there a better alternative?

(xposted to reddit)

The way forward always starts with a minimal test.

Replies are listed 'Best First'.
Re: Minion as a job scheduler?
by Perlbotics (Bishop) on Aug 23, 2021 at 17:32 UTC

    Sorry, I haven't used Minion in the past and cannot directly contribute. However, also at $work I am running a multi stage scheduler that spawns external processes and keeps track of the results. It is not too hard to implement this in Perl using lists (queues) of job-objects together with a specialised sort function. As one building block, I can recommend Proc::Simple to run external processes or callbacks. Worked here very reliable (Unix) for years with several 100k invocations per day and host.

Re: Minion as a job scheduler?
by karlgoethebier (Abbot) on Aug 22, 2021 at 13:20 UTC

    I guess you mean this, right?

    «The Crux of the Biscuit is the Apostrophe»

Re: Minion as a job scheduler?
by NERDVANA (Pilgrim) on Aug 23, 2021 at 16:39 UTC
    One thing to keep in mind about Minion is that the implementation is officially private, meaning that the only API they are maintaining is the perl front-end. You cannot officially add tasks to the queue with database triggers, for example, without risk of things breaking after an upgrade.

    It would be nice if someone published a task scheduler and worker pool that was defined in a more language-neutral manner, with public schema.

A reply falls below the community's threshold of quality. You may see it by logging in.
A reply falls below the community's threshold of quality. You may see it by logging in.

Log In?

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: perlquestion [id://11136024]
Front-paged by Corion
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others contemplating the Monastery: (4)
As of 2021-12-09 11:29 GMT
Find Nodes?
    Voting Booth?
    R or B?

    Results (36 votes). Check out past polls.