taskforest-discuss Mailing List for TaskForest Job Scheduler
Brought to you by:
enoor
Menu
▾
▴
taskforest-discuss — General discussion, questions, feature requests, etc. related to TaskForest
You can subscribe to this list here.
| 2009 |
Jan
|
Feb
|
Mar
(10) |
Apr
(10) |
May
(10) |
Jun
(6) |
Jul
(4) |
Aug
|
Sep
(4) |
Oct
|
Nov
|
Dec
|
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 2010 |
Jan
|
Feb
(10) |
Mar
(4) |
Apr
(9) |
May
|
Jun
|
Jul
|
Aug
|
Sep
(2) |
Oct
|
Nov
|
Dec
|
| 2011 |
Jan
|
Feb
|
Mar
|
Apr
|
May
(1) |
Jun
(1) |
Jul
|
Aug
|
Sep
|
Oct
(3) |
Nov
|
Dec
(1) |
| 2014 |
Jan
|
Feb
(2) |
Mar
|
Apr
|
May
|
Jun
|
Jul
|
Aug
|
Sep
|
Oct
|
Nov
|
Dec
|
|
From: Matthew E. S. <mat...@gm...> - 2014-02-17 11:47:23
|
We've found TaskForest quite useful in our organization, but there are some improvements we'd love to see/suggest. Is the project being actively maintained? The last news or updates I see on the website are from spring 2010. Thanks, Matt |
|
From: Teresia A. <Ter...@sa...> - 2014-02-07 14:22:05
|
For no apparent reason, the taskforest goes down. It can happen any time but seems to happen most frequently under one of the following 2 conditions: 1) I've used the web interface to rerun a few jobs 2) I've cleared the logs so the whole job stream reruns It has also gone down at other times but most frequently I see it under these two different conditions. We are running 1.37 Thank you, Teresia Arthur Principal Software Developer Central Applications Support Planning, Operations and Strategy SAS Institute |
|
From: Matthias T. <mat...@mt...> - 2011-12-31 14:15:12
|
Moin, is it possible to start taskforest with some job families offline? I have different jobs in different networks and it would be nice if i can enable them later from the cli. Thanks Matthias |
|
From: <dan...@th...> - 2011-10-04 17:42:55
|
I created an empty file in the jobs and families directories and that resolved the error... perhaps there needs to be a minimum of a single job. Dan From: aij...@gm... [mailto:aij...@gm...] On Behalf Of Aijaz Ansari Sent: Monday, October 03, 2011 8:49 PM To: Taylor, Daniel (M I and A) Cc: tas...@li... Subject: Re: [Taskforest-discuss] Web interface bug on default install I suspect the problem is a mismatch of the config files. Did you remember to edit both the taskforest config file (usually named taskforest.cfg) as well as the web server config file (usually named taskforestd.cfg) ? Make sure the values of job_dir and family_dir in taskforestd.cfg are correct. Please let me know if that helps. -- Aijaz On Mon, Oct 3, 2011 at 5:58 PM, <dan...@th...<mailto:dan...@th...>> wrote: Hi, Just installed TaskForest from scratch and get the following two errors when viewing the web interface "jobs" and "families" pages: <h1>**** CANNOT EXECUTE TaskForest::REST::JobList *****</h1><pre>Can't use an undefined value as an ARRAY reference at /home/USERNAME/TaskForest/lib/perl5/site_perl/5.8.8//TaskForest/REST.pm line 221. </pre> Any assistance would be appreciated. Thanks, Dan ------------------------------------------------------------------------------ All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity and more. Splunk takes this data and makes sense of it. Business sense. IT sense. Common sense. http://p.sf.net/sfu/splunk-d2dcopy1 _______________________________________________ Taskforest-discuss mailing list Tas...@li...<mailto:Tas...@li...> https://lists.sourceforge.net/lists/listinfo/taskforest-discuss |
|
From: Aijaz A. <en...@us...> - 2011-10-04 03:48:52
|
I suspect the problem is a mismatch of the config files. Did you remember to edit both the taskforest config file (usually named taskforest.cfg) as well as the web server config file (usually named taskforestd.cfg) ? Make sure the values of job_dir and family_dir in taskforestd.cfg are correct. Please let me know if that helps. -- Aijaz On Mon, Oct 3, 2011 at 5:58 PM, <dan...@th...> wrote: > Hi,**** > > ** ** > > Just installed TaskForest from scratch and get the following two errors > when viewing the web interface “jobs” and “families” pages:**** > > ** ** > > <h1>**** CANNOT EXECUTE TaskForest::REST::JobList *****</h1><pre>Can't use > an undefined value as an ARRAY reference at > /home/USERNAME/TaskForest/lib/perl5/site_perl/5.8.8//TaskForest/REST.pm line > 221.**** > > </pre>**** > > ** ** > > Any assistance would be appreciated.**** > > ** ** > > Thanks,**** > > Dan**** > > > ------------------------------------------------------------------------------ > All the data continuously generated in your IT infrastructure contains a > definitive record of customers, application performance, security > threats, fraudulent activity and more. Splunk takes this data and makes > sense of it. Business sense. IT sense. Common sense. > http://p.sf.net/sfu/splunk-d2dcopy1 > _______________________________________________ > Taskforest-discuss mailing list > Tas...@li... > https://lists.sourceforge.net/lists/listinfo/taskforest-discuss > > |
|
From: <dan...@th...> - 2011-10-03 23:13:07
|
Hi, Just installed TaskForest from scratch and get the following two errors when viewing the web interface "jobs" and "families" pages: <h1>**** CANNOT EXECUTE TaskForest::REST::JobList *****</h1><pre>Can't use an undefined value as an ARRAY reference at /home/USERNAME/TaskForest/lib/perl5/site_perl/5.8.8//TaskForest/REST.pm line 221. </pre> Any assistance would be appreciated. Thanks, Dan |
|
From: Saravanan S. P. <ss...@gm...> - 2011-06-17 07:09:53
|
Hi, I am scheduling two jobs J1 and J2, i want this jobs to repeat every 2 min and and i want only one job to run at a time. i have used this option in my family file. start => '00:00', tz => 'Asia/Hong_Kong', calendar => 'daily' J1(token=>'T', every=>'1') J2(token=>'T', every=>'1') though both the jobs run successfully, they do not run parallel only during the first time, after that when rerun sequence kicks in they run parallel at times though i have only one instance of Token T. Why is this happening? How can i make two jobs run on a repeat sequence and they should not run at the same time? Thanks, Saravanan S. |
|
From: Fredrik E. <fe...@ds...> - 2011-05-12 14:45:43
|
Dear TaskForest users and developers, I've been evaluating TaskForest as a solution for one of our clients and the down to basics approach really appeals to me. However, I have a question that I haven't been able to answer during my evaluation. This case concerns a very frequent job with a family that looks like this: ---FAM1 | start => '00:01', tz => 'Europe/Stockholm', days => 'Mon,Tue,Wed,Thu,Fri,Sat,Sun' | | myfrequentjob(every => '5', until => '23:59') --- I want the job to run every five minutes, always. This one is a bit extreme but we have a few of these jobs but which will have a lesser frequency and a different until time. My problem is that if, for some reason (maybe the machine was down), TaskForest has not been running for half a day and is then started, I would like recurring jobs like this to pick up where we are now and just start running every five minutes. This is not the way TaskForest handles it, I find that my "myfrequentjob" might run a hundred times (depending on when I start TaskForest of course), to catch up for missed runs, until it settles into the five minute frequency. My questions to you are: 1) Have I missed something, is it possible to suppress job with a passed run time, for a recurring job (one that uses "every")? 2) Is there another way of handling this situation within TaskForest? Of course I could use cron, but that would mean I had to monitor these jobs separately and I wouldn't see the full picture in TaskForest. Thanks for your time. Regards Fredrik Engberg |
|
From: Aijaz A. <ai...@en...> - 2010-09-09 00:56:30
|
Brian: Thank you very much for sharing. I appreciate it. I'll incorporate your fixes into the next release. Aijaz. On Sat, Sep 4, 2010 at 12:08 PM, Brian Roach <ro...@mo...>wrote: > Howdy! > > We found a problem with recurring jobs not sending failure emails. The only > time you would get a fail email is if the very first occurrence of the job > failed. This is caused by the way the recurring jobs are created in > Family.pm. > > I've included a patch that moves the chunk of code that sets up emailing to > a function (TaskForest::Family::_configureEmail()) allowing for it to be > called from TaskForest::Family::_createRecurringJobs() > > The same problem exists with tokens, I just noticed. > > Anyway, this solved the problem so I thought I'd share. Thanks! > - Brian Roach > > > ------------------------------------------------------------------------------ > This SF.net Dev2Dev email is sponsored by: > > Show off your parallel programming skills. > Enter the Intel(R) Threading Challenge 2010. > http://p.sf.net/sfu/intel-thread-sfd > _______________________________________________ > Taskforest-discuss mailing list > Tas...@li... > https://lists.sourceforge.net/lists/listinfo/taskforest-discuss > > |
|
From: Brian R. <ro...@mo...> - 2010-09-04 17:36:21
|
Howdy! We found a problem with recurring jobs not sending failure emails. The only time you would get a fail email is if the very first occurrence of the job failed. This is caused by the way the recurring jobs are created in Family.pm. I've included a patch that moves the chunk of code that sets up emailing to a function (TaskForest::Family::_configureEmail()) allowing for it to be called from TaskForest::Family::_createRecurringJobs() The same problem exists with tokens, I just noticed. Anyway, this solved the problem so I thought I'd share. Thanks! - Brian Roach |
|
From: Aijaz A. <en...@us...> - 2010-04-28 17:11:58
|
Denis: Thanks for your email and the patches. I appreciate the follow-up. I'll work on incorporating them over the weekend. Aijaz. On Wed, Apr 28, 2010 at 10:54 AM, Denis Benoit <den...@gm...>wrote: > Hi! > > When running some of the scripts from the command line, I encountered a few > problems. > > ... > The modification and use of Options.pm may not be the best solution to the > problem, but it works. > > The releaseHold is not in the release, altough documented. I created it, it > is similar to release. > > The last two patches are nice to have only. I modified to *status* web > service so it auto-refresh, I use it as a monitoring tool, leaving it always > open in a web browser tab. The only modification is that status2.html uses > the head_status.hml instead of the regular status.html, and the only > difference between head_status.hml and status.html is that head_status.html > adds this statement: > > <meta http-equiv="refresh" content="30" > > > Thanks for the nice work on Taskforest, it's a great scheduler! > > Denis Benoit > > > ------------------------------------------------------------------------------ > > _______________________________________________ > Taskforest-discuss mailing list > Tas...@li... > https://lists.sourceforge.net/lists/listinfo/taskforest-discuss > > |
|
From: Denis B. <den...@gm...> - 2010-04-28 15:55:12
|
Hi! When running some of the scripts from the command line, I encountered a few problems. First, when trying to release a job, I have this message: /usr/local/bin/release --log_dir=/var/log/ema/scheduler/logs --family_dir=/usr/local/taskforest/families --job=ema_cds::cds_loader Use of uninitialized value in concatenation (.) or string at /usr/local/share/perl/5.10.0/TaskForest/Family.pm line 1003, <GEN0> line 1. Calendar /tue_fri does not exist Use of uninitialized value in concatenation (.) or string at /usr/local/share/perl/5.10.0/TaskForest/Release.pm line 91, <GEN0> line 1. Cannot release job ema_cds::cds_loader since it is not in the 'Waiting' or 'Hold' state - it's in the state I found that from the command line, the calendar directory is not set. I propose a patch where the command line simply use the same &TaskForest::Options::getOptions(...) call to parse its argument, I modified Options.pm to accept a new argument for the job name. Hold has the same problem: /usr/local/bin/hold --log_dir=/var/log/ema/scheduler/logs --family_dir=/usr/local/taskforest/families --job=ema_address::address_loader Use of uninitialized value in concatenation (.) or string at /usr/local/share/perl/5.10.0/TaskForest/Family.pm line 1003, <GEN0> line 1. Calendar /tue_fri does not exist Use of uninitialized value in concatenation (.) or string at /usr/local/share/perl/5.10.0/TaskForest/Hold.pm line 91, <GEN0> line 1. Cannot hold job ema_address::address_loader since it is not in the 'Waiting' state - it's in the state. at /usr/local/bin/hold line 61 I used the same solution as release. Status also has this problem, I again used the same solution. Use of uninitialized value in concatenation (.) or string at /usr/local/share/perl/5.10.0/TaskForest/Family.pm line 1003, <GEN0> line 1. Use of uninitialized value in concatenation (.) or string at /usr/local/share/perl/5.10.0/TaskForest/Family.pm line 1003, <GEN1> line 1. ... Calendar /tue_fri does not exist Calendar /tue_fri does not exist ... Job Status Code Zone Start Start Time ema_address::wait_address Failure 256 America/Chicago --:-- 20:01 04:01 ema_alt_security::wait_alt_security Failure 256 America/Chicago --:-- 20:01 04:01 ... The modification and use of Options.pm may not be the best solution to the problem, but it works. The releaseHold is not in the release, altough documented. I created it, it is similar to release. The last two patches are nice to have only. I modified to *status* web service so it auto-refresh, I use it as a monitoring tool, leaving it always open in a web browser tab. The only modification is that status2.html uses the head_status.hml instead of the regular status.html, and the only difference between head_status.hml and status.html is that head_status.html adds this statement: <meta http-equiv="refresh" content="30" > Thanks for the nice work on Taskforest, it's a great scheduler! Denis Benoit |
|
From: Rosco R. <Ros...@sa...> - 2010-04-19 19:36:10
|
It's a good idea; but I don't see it as something that would improve the local application that is based on Task Forest. The only folks that pay any attention to the TF website are the few that administer the application, so we'd all be defined into one role anyway. R ________________________________________ From: Aijaz Ansari [en...@us...] Sent: Sunday, April 18, 2010 9:21 PM To: tas...@li... Subject: [Taskforest-discuss] I would like your opinion on features planned for TaskForest 1.38 Hello everyone. I have one quick announcement I would like to get out of the way first: I've modified the taskforest.com<http://taskforest.com> website a bit. It now includes an RSS feed. I plan on posting news and entries pertaining to job scheduling and TaskForest on that feed. The location of the feed is http://www.taskforest.com/feed.xml - if you would like to subscribe to it. Now on to the main reason for this email: I'm planning on releasing version 1.38 in a week or two. The main addition in this release will be support for 'roles' for the taskforest website. A user who authenticates into the TaskForest website can be a member of one or more roles. Each role can have specific permissions for reading and writing family files, reading and writing job files, and performing actions on jobs (rerun, mark, hold and release). I'm sorting out the config file syntax right now. My question is: Is this something that you think you would like to see sooner rather than later? Thanks, Aijaz. |
|
From: Aijaz A. <en...@us...> - 2010-04-19 01:21:42
|
Hello everyone. I have one quick announcement I would like to get out of the way first: I've modified the taskforest.com website a bit. It now includes an RSS feed. I plan on posting news and entries pertaining to job scheduling and TaskForest on that feed. The location of the feed is http://www.taskforest.com/feed.xml - if you would like to subscribe to it. Now on to the main reason for this email: I'm planning on releasing version 1.38 in a week or two. The main addition in this release will be support for 'roles' for the taskforest website. A user who authenticates into the TaskForest website can be a member of one or more roles. Each role can have specific permissions for reading and writing family files, reading and writing job files, and performing actions on jobs (rerun, mark, hold and release). I'm sorting out the config file syntax right now. My question is: Is this something that you think you would like to see sooner rather than later? Thanks, Aijaz. |
|
From: Aijaz A. <en...@us...> - 2010-04-15 02:53:48
|
You're welcome. The whitespace is not significant. It's only for readability. Feel free to ask if you have further questions at all Thanks, Aijaz. On Wed, Apr 14, 2010 at 9:08 PM, Jay Hannah <jh...@om...> wrote: > That is extremely helpful. Thank you. > > > > So the whitespace in any given line (how far anything is indented) is not > significant? (Staring at the examples I was beginning to wonder if you were > enforcing Python-style whitespace logic...) > > > > I'm hoping to give TaskForest a try on a project at @work soon. Looks like > a great platform for some of the recurring job management currently hassling > me. :) > > > > j > > > ------------------------------------------------------------------------------ > Download Intel® Parallel Studio Eval > Try the new software tools for yourself. Speed compiling, find bugs > proactively, and fine-tune applications for parallel performance. > See why Intel Parallel Studio got high marks during beta. > http://p.sf.net/sfu/intel-sw-dev > _______________________________________________ > Taskforest-discuss mailing list > Tas...@li... > https://lists.sourceforge.net/lists/listinfo/taskforest-discuss > > |
|
From: Jay H. <jh...@om...> - 2010-04-15 02:10:12
|
That is extremely helpful. Thank you. So the whitespace in any given line (how far anything is indented) is not significant? (Staring at the examples I was beginning to wonder if you were enforcing Python-style whitespace logic...) I'm hoping to give TaskForest a try on a project at @work soon. Looks like a great platform for some of the recurring job management currently hassling me. :) j |
|
From: Aijaz A. <en...@us...> - 2010-04-15 01:45:10
|
Jay:
Wow. I can't believe I left that out! You're right, there's a lot of
explanation of the basic case that's missing. Thanks for pointing it out.
Coming back to your question:
A job is dependent on any job that appears on a line above it.
In the example below, J_RESOLVE_DNS is dependent on J_ROTATE_LOGS.
Delete_Old_Logs() is also dependent on J_ROTATE_LOGS. Since both are on the
same line, the will start at the same time, and run in parallel. Both these
jobs will only run if J_ROTATE_LOGS runs succesfully (or is marked
successful after a failed run).
Similarly, J_WEB_REPORTS will only run after both J_RESOLVE_DNS and
Delete_Old_Logs both complete successfully.
Finally, job dependencies are only valid for the section that the jobs are
in (a section is a section of text in the family file delimited by a line of
dashes ("-----------------")). See Example 4 for more details - There are 3
sections in that example.
Does this help? Please let me know if my explanation isn't clear.
Thanks for your offer to patch the docs. I don't have SVN set up on
SourceForge yet, but if you can submit the patch via SourceForge or email me
the text, I'll put it in with the appropriate attribution.
Thanks again,
Aijaz.
On Wed, Apr 14, 2010 at 7:03 PM, Jay Hannah <jh...@om...> wrote:
> http://www.taskforest.com/docs/configuring/families.html
>
>
>
> "EXAMPLE 2 - Job Dependencies" seems to skip over explaining the basics of
> what this means:
>
>
>
> 03 | J_ROTATE_LOGS()
>
> 04 |
>
> 05 | J_RESOLVE_DNS() Delete_Old_Logs()
>
> 06 |
>
> 07 | J_WEB_REPORTS()
>
> 08 |
>
> 09 | J_EMAIL_WEB_RPT_DONE() # send me a notification
>
>
>
> Is a job dependent on another job if it's listed on a line below the first?
> On the same line, but to the right? Both? Neither?
>
>
>
> Which of the jobs above are dependent on the others?
>
>
>
> If someone can explain that and give me a commit bit to your version
> control I'd be happy to attempt patches to your docs for your consideration.
>
>
>
>
> Thanks,
>
>
>
> j
>
>
>
>
>
>
> ------------------------------------------------------------------------------
> Download Intel® Parallel Studio Eval
> Try the new software tools for yourself. Speed compiling, find bugs
> proactively, and fine-tune applications for parallel performance.
> See why Intel Parallel Studio got high marks during beta.
> http://p.sf.net/sfu/intel-sw-dev
> _______________________________________________
> Taskforest-discuss mailing list
> Tas...@li...
> https://lists.sourceforge.net/lists/listinfo/taskforest-discuss
>
>
|
|
From: Jay H. <jh...@om...> - 2010-04-15 00:50:45
|
http://www.taskforest.com/docs/configuring/families.html "EXAMPLE 2 - Job Dependencies" seems to skip over explaining the basics of what this means: 03 | J_ROTATE_LOGS() 04 | 05 | J_RESOLVE_DNS() Delete_Old_Logs() 06 | 07 | J_WEB_REPORTS() 08 | 09 | J_EMAIL_WEB_RPT_DONE() # send me a notification Is a job dependent on another job if it's listed on a line below the first? On the same line, but to the right? Both? Neither? Which of the jobs above are dependent on the others? If someone can explain that and give me a commit bit to your version control I'd be happy to attempt patches to your docs for your consideration. Thanks, j |
|
From: Aijaz A. <en...@us...> - 2010-04-02 21:14:55
|
Hello everyone: The SourceForge.net blog has a nice entry today on TaskForest, and I'd like to share it with you: https://sourceforge.net/blog/robust-job-scheduling-lives-in-taskforest/ Aijaz. |
|
From: Aijaz A. <en...@us...> - 2010-03-24 04:49:13
|
Hello. TaskForest 1.37 has been released. You can now configure TaskForest to automatically retry running a job if it fails. The number of times it retries, as well as the amount of time between retries is configurable on a per-job basis. TaskForest now also features a very powerful email system. You can configure TaskForest to email you when a job fails, when a job is retried, and when a job suceeds after failing and being retried. Each kind of email can be sent to a different email address, and these email addresses can be configured system-wide, or for each job, or for anything in the middle. Please see the taskforest website at http://www.taskforest.com/ for more details. Thanks, Aijaz. |
|
From: Aijaz A. <en...@us...> - 2010-03-06 02:14:19
|
Jay: We have a SVN repository that we've been using since before we made TaskForest open source. We just continued our own internal repository. I suppose I should use sourceforge's services. Since I'm already familiar with svn, I'll likely just use that. And no, sorry, we're not on IRC. I try to answer questions sent to this mailing list promptly. Aijaz. On Fri, Mar 5, 2010 at 5:49 PM, Jay Hannah <ja...@ja...> wrote: > On 3/5/2010 5:42 PM, Jay Hannah wrote: > > Is TaskForest in Subversion or git somewhere? The sourceforge SVN and > > CVS are empty. Thanks, > > Also, are you guys in IRC somewhere? > > j > jhannah on irc.perl.org > deafferret on Freenode > > > ------------------------------------------------------------------------------ > Download Intel® Parallel Studio Eval > Try the new software tools for yourself. Speed compiling, find bugs > proactively, and fine-tune applications for parallel performance. > See why Intel Parallel Studio got high marks during beta. > http://p.sf.net/sfu/intel-sw-dev > _______________________________________________ > Taskforest-discuss mailing list > Tas...@li... > https://lists.sourceforge.net/lists/listinfo/taskforest-discuss > |
|
From: Jay H. <ja...@ja...> - 2010-03-06 00:10:40
|
On 3/5/2010 5:42 PM, Jay Hannah wrote: > Is TaskForest in Subversion or git somewhere? The sourceforge SVN and > CVS are empty. Thanks, Also, are you guys in IRC somewhere? j jhannah on irc.perl.org deafferret on Freenode |
|
From: Jay H. <ja...@ja...> - 2010-03-06 00:07:15
|
Howdy, Is TaskForest in Subversion or git somewhere? The sourceforge SVN and CVS are empty. Thanks, j |
|
From: Aijaz A. <en...@us...> - 2010-02-23 05:45:16
|
Hello: TaskForest version 1.36 has been released. The following are the changes in this release: o Added a button to the logs form on the website that pops up a calendar window to help you select a date. Many thanks to Steve Hulet for providing the patch. o The logs display page on the website now has links to navigate to the previous and next days. Many thanks to Steve Hulet for providing the patch. o Fixed some more test cases that wouldn't run properly during certain times of the day. For more details, please see the website at http://www.taskforest.com/ Thanks, Aijaz. |
|
From: Aijaz A. <en...@us...> - 2010-02-12 06:21:46
|
Hello, everyone. TaskForest version 1.35 is now available. Please go to http://www.taskforest.com for more details. There are a few improvements over the unofficial version 1.34 that I released earlier this week. 1.35 is currently the 'official' latest version. Thanks again to Steve Hulet for helping me debug a problem with the test cases. Thanks, Aijaz. |
