Hi, what is the relationship between workers defined in universe and job_conf.xml? e.g.: [server:handler0] use = egg:Paste#http port = 9092 host = 127.0.0.1 use_threadpool = true threadpool_workers = 5 <plugins workers="4"> <!-- "workers" is the number of threads for the runner's work queue. The default from <plugins> is used if not defined for a <plugin>. --> <plugin id="local" type="runner" load="galaxy.jobs.runners.local:LocalJobRunner"/> <plugin id="drmaa" type="runner" load="galaxy.jobs.runners.drmaa:DRMAAJobRunner" workers="10"/> </plugins> a) do I have to specify the sum of the workers in job_conf.xml in universe? e.g. 4 local, 10 drmaa => 14 threadpool_workers per handler? Or is universe overridden by job_conf.xml? b) How many concurrent jobs can I then expect to have concurrently? 14 per handler? thank you very much, ido
use_threadpool and threadpool_workers specify the number of threads for handling web requests and have nothing to do with job running. -- James Taylor, Assistant Professor, Biology/CS, Emory University On Wed, Jul 24, 2013 at 11:02 AM, Ido Tamir <tamir@imp.ac.at> wrote:
Hi,
what is the relationship between workers defined in universe and job_conf.xml? e.g.:
[server:handler0] use = egg:Paste#http port = 9092 host = 127.0.0.1 use_threadpool = true threadpool_workers = 5
<plugins workers="4"> <!-- "workers" is the number of threads for the runner's work queue. The default from <plugins> is used if not defined for a <plugin>. --> <plugin id="local" type="runner" load="galaxy.jobs.runners.local:LocalJobRunner"/> <plugin id="drmaa" type="runner" load="galaxy.jobs.runners.drmaa:DRMAAJobRunner" workers="10"/> </plugins>
a) do I have to specify the sum of the workers in job_conf.xml in universe? e.g. 4 local, 10 drmaa => 14 threadpool_workers per handler? Or is universe overridden by job_conf.xml?
b) How many concurrent jobs can I then expect to have concurrently? 14 per handler?
thank you very much, ido
___________________________________________________________ Please keep all replies on the list by using "reply all" in your mail client. To manage your subscriptions to this and other Galaxy lists, please use the interface at: http://lists.bx.psu.edu/
To search Galaxy mailing lists use the unified search at: http://galaxyproject.org/search/mailinglists/
Ah yes, this was local_job_queue_workers and cluster_job_queue_workers in universe.ini thank you very much, ido On Jul 24, 2013, at 5:10 PM, James Taylor <james@jamestaylor.org> wrote:
use_threadpool and threadpool_workers specify the number of threads for handling web requests and have nothing to do with job running.
-- James Taylor, Assistant Professor, Biology/CS, Emory University
On Wed, Jul 24, 2013 at 11:02 AM, Ido Tamir <tamir@imp.ac.at> wrote:
Hi,
what is the relationship between workers defined in universe and job_conf.xml? e.g.:
[server:handler0] use = egg:Paste#http port = 9092 host = 127.0.0.1 use_threadpool = true threadpool_workers = 5
<plugins workers="4"> <!-- "workers" is the number of threads for the runner's work queue. The default from <plugins> is used if not defined for a <plugin>. --> <plugin id="local" type="runner" load="galaxy.jobs.runners.local:LocalJobRunner"/> <plugin id="drmaa" type="runner" load="galaxy.jobs.runners.drmaa:DRMAAJobRunner" workers="10"/> </plugins>
a) do I have to specify the sum of the workers in job_conf.xml in universe? e.g. 4 local, 10 drmaa => 14 threadpool_workers per handler? Or is universe overridden by job_conf.xml?
b) How many concurrent jobs can I then expect to have concurrently? 14 per handler?
thank you very much, ido
___________________________________________________________ Please keep all replies on the list by using "reply all" in your mail client. To manage your subscriptions to this and other Galaxy lists, please use the interface at: http://lists.bx.psu.edu/
To search Galaxy mailing lists use the unified search at: http://galaxyproject.org/search/mailinglists/
participants (2)
-
Ido Tamir
-
James Taylor