Hi,
I am routinely running hundreds of pair-end sequencing runs and find that STARTING a workflow on all of these can easily take hours since it seems each workflow preparation takes about 3 minutes, so for doing 128 fastq pairs like this it will take over 3 hours just to get all workflows running….
Is there any way for me to speed up this process, maybe by adding more handlers (although I am suspecting the WEB server is the bottleneck here)?
I already run 8 handlers but only one web server…
I could loadbalance the webservers through my proxy server…Will that speed up the submissions or are we stuck with this linear process?
Thanks,
Thon