[galaxyproject/galaxy] 85ef86: Improvements to workflow scaling performance testi...
Branch: refs/heads/dev Home: https://github.com/galaxyproject/galaxy Commit: 85ef86ab2ee904c62d00f84e7220c661bd31e58c https://github.com/galaxyproject/galaxy/commit/85ef86ab2ee904c62d00f84e7220c... Author: John Chilton <jmchilton@gmail.com> Date: 2016-03-21 (Mon, 21 Mar 2016) Changed paths: M lib/galaxy/workflow/scheduling_manager.py M scripts/summarize_timings.py A test/functional/tools/for_workflows/create_input_collection.xml A test/functional/tools/for_workflows/split.xml M test/functional/tools/samples_tool_conf.xml A test/manual/launch_and_run.sh A test/manual/workflow_job_conf.xml M test/manual/workflows_scaling.py Log Message: ----------- Improvements to workflow scaling performance testing scripts. - Implement a wrapper script for launching a docker-galaxy-stable setup a many ways for this task including: - Configure container's Galaxy with outer Galaxy's lib and test directory. - Collect log files. - Log a statement for interacting with the container easily while the test is running. - Disable unneeded services. - Implement a fan-in-fan-out style workflow for performance testing. - Add an option to test performance of scheduling workflows without actually running jobs. - Sample tool for creating large collections easily at beginning of tests (much faster than uploads). - Sample tool for splitting a file into a collection for fan in and out workflow test. - Assume Python 2.7 in scripts to simplify things. - Add documentation. Commit: da1f1bd8b2ae1ce7910b14c3dab0791dc0a67050 https://github.com/galaxyproject/galaxy/commit/da1f1bd8b2ae1ce7910b14c3dab07... Author: John Chilton <jmchilton@gmail.com> Date: 2016-03-21 (Mon, 21 Mar 2016) Changed paths: M test/functional/tools/for_workflows/create_input_collection.xml Log Message: ----------- Fixes to create_input_collection.xml based on comments from @nsoranzo. Commit: c093c793b7ba589c41e7df3041585922ddc840d8 https://github.com/galaxyproject/galaxy/commit/c093c793b7ba589c41e7df3041585... Author: Martin Cech <cech.marten@gmail.com> Date: 2016-03-25 (Fri, 25 Mar 2016) Changed paths: M lib/galaxy/workflow/scheduling_manager.py M scripts/summarize_timings.py A test/functional/tools/for_workflows/create_input_collection.xml A test/functional/tools/for_workflows/split.xml M test/functional/tools/samples_tool_conf.xml A test/manual/launch_and_run.sh A test/manual/workflow_job_conf.xml M test/manual/workflows_scaling.py Log Message: ----------- Merge pull request #1958 from jmchilton/workflow_scheduling_testing Improvements to workflow scaling performance testing scripts. Compare: https://github.com/galaxyproject/galaxy/compare/d9177a81e548...c093c793b7ba
participants (1)
-
GitHub