On Fri, Feb 6, 2015 at 9:59 AM, Roberto Alonso CIPF <ralonso@cipf.es> wrote:
> Hello,
>
> Postgres did it perfectly, but as I would like to enable this option in my
> production servers I changed two configs in galaxy.ini:
>
> # This enables splitting of jobs into tasks, if specified by the particular
> tool config.
> # This is a new feature and not recommended for production servers yet.
> use_tasked_jobs = True
> local_task_queue_workers = 4
>
> So I have two questions,
> 1. Why is this not appropriate for productions server yet?

At a practical level, I believe this setting is not used on the main
usegalaxy.org instance, and thus has not been stress tested by
the Galaxy developers.

Also (see below), it has little documentation.

> 2. What is local_task_queue_workers doing?
>

I'm not entiruely sure, but I think it is how many task-splitters
would be run at once (e.g. several splittable jobs are submitted
together). We use local_task_queue_workers = 4 but I forget
why exactly.

> I think I misunderstand something
> because I put this parameter in the tool config file:
>    <parallelism method="basic" split_size="20"
> split_mode="number_of_parts"></parallelism>
> on ther other hand, I don't see any documentation about parallelism tag, is
> there any?

I don't think there is anything explicit on the wiki about how
to use the parallelism tag :(

Peter