November 2017 - galaxy-dev - lists.galaxyproject.org

Monitoring Dashboard for Galaxy
by evan clark 03 Sep '18

03 Sep '18

I remember there previously being an additional tool that ran on a different port from galaxy that allowed for monitoring of performance and jobs running. Is this tool still packaged with galaxy and if so how can it be activated.

3 3

Job Script Integrity
by John Letaw 04 Jun '18

04 Jun '18

Hi all, I’m installing via GalaxyKickStart… I’m getting the following error: galaxy.jobs.runners ERROR 2017-11-06 19:14:05,263 (19) Failure preparing job Traceback (most recent call last): File "/home/exacloud/lustre1/galaxydev/galaxyuser/lib/galaxy/jobs/runners/__init__.py", line 175, in prepare_job modify_command_for_container=modify_command_for_container File "/home/exacloud/lustre1/galaxydev/galaxyuser/lib/galaxy/jobs/runners/__init__.py", line 209, in build_command_line container=container File "/home/exacloud/lustre1/galaxydev/galaxyuser/lib/galaxy/jobs/command_factory.py", line 84, in build_command externalized_commands = __externalize_commands(job_wrapper, external_command_shell, commands_builder, remote_command_params) File "/home/exacloud/lustre1/galaxydev/galaxyuser/lib/galaxy/jobs/command_factory.py", line 143, in __externalize_commands write_script(local_container_script, script_contents, config) File "/home/exacloud/lustre1/galaxydev/galaxyuser/lib/galaxy/jobs/runners/util/job_script/__init__.py", line 112, in write_script _handle_script_integrity(path, config) File "/home/exacloud/lustre1/galaxydev/galaxyuser/lib/galaxy/jobs/runners/util/job_script/__init__.py", line 147, in _handle_script_integrity raise Exception("Failed to write job script, could not verify job script integrity.") Exception: Failed to write job script, could not verify job script integrity. galaxy.model.metadata DEBUG 2017-11-06 19:14:05,541 Cleaning up external metadata files galaxy.model.metadata DEBUG 2017-11-06 19:14:05,576 Failed to cleanup MetadataTempFile temp files from /home/exacloud/lustre1/galaxydev/galaxyuser/database/jobs/000/19/metadata_out_HistoryDatasetAssociation_16_I8bhLX: No JSON object could be decoded I would like to further understand what it means to not verify integrity of a job script. Does this just mean there is a permissions error? Ownership doesn’t match up? Thanks, John

2 1

tool dependencies
by Matthias Bernt 19 Mar '18

19 Mar '18

Hi all, I tried to install velvetoptimizer (for the assembly tutorial in the GTN). It lists velvetoptimiser as requirement in the main xml and the tool_dependencies.xml (listing the installation steps). Now there seems to be a conda package perl-velvetoptimiser. What would be the steps to to update the tool (I would happily create a PR)? Is the tool_dependencies.xml intended to be kept and I just need to update the names of the requirements (I guess the name in the tool_dependencies.xml does not matter)? Furthermore the tool_dependencies.xml includes the package_velvet which is listed as missing dependency in the management pages. Shouldn't this be ignored if there is a conda package? Last question: Is it possible to update an installed package by editing the xml files? It seemed to me that changes do not have an effect. Cheers, Matthias -- ------------------------------------------- Matthias Bernt Bioinformatics Service Molekulare Systembiologie (MOLSYB) Helmholtz-Zentrum für Umweltforschung GmbH - UFZ/ Helmholtz Centre for Environmental Research GmbH - UFZ Permoserstraße 15, 04318 Leipzig, Germany Phone +49 341 235 482296, m.bernt(a)ufz.de, www.ufz.de Sitz der Gesellschaft/Registered Office: Leipzig Registergericht/Registration Office: Amtsgericht Leipzig Handelsregister Nr./Trade Register Nr.: B 4703 Vorsitzender des Aufsichtsrats/Chairman of the Supervisory Board: MinDirig Wilfried Kraus Wissenschaftlicher Geschäftsführer/Scientific Managing Director: Prof. Dr. Dr. h.c. Georg Teutsch Administrative Geschäftsführerin/ Administrative Managing Director: Prof. Dr. Heike Graßmann -------------------------------------------

2 1

Re: [galaxy-dev] Shiny in Galaxy
by Yvan Le Bras 14 Mar '18

14 Mar '18

Dear Mohamed, Karim, galaxy-dev list, A rapid e-mail to inform you that we plan to work on this task in the upcoming weeks with Thimothée and Valentin, copied. We have had some exchanges with Eric (Rasche) and Björn (Grüning) and it seems that using the Galaxy "interactive environment" functionality is a good way to proceed. Don't hesitate to give us more informations to collaborate on it... Wishing you a good week end. Cheers, Yvan -------- Message d'origine -------- De : "Md. Rezaul Karim" <rezaul.karim(a)insight-centre.org> Date : 26/05/2017 15:45 (GMT+01:00) À : Mohamed Kassam <k.mamoud(a)gmail.com> Cc : Galaxy Dev List <galaxy-dev(a)lists.galaxyproject.org> Objet : Re: [galaxy-dev] Shiny in Galaxy +1 On May 26, 2017 2:44 PM, "Mohamed Kassam" <k.mamoud(a)gmail.com> wrote: Dear all, I have a shiny application working in my RStudio, but I would like to integrate it to Galaxy that the users can call my application via Galaxy . Thanks in Advance, Mohamed ___________________________________________________________ Please keep all replies on the list by using "reply all" in your mail client. To manage your subscriptions to this and other Galaxy lists, please use the interface at: https://lists.galaxyproject.org/ To search Galaxy mailing lists use the unified search at: http://galaxyproject.org/search/

3 5

Dynamic Tool UI based on script
by Evan Clark 07 Dec '17

07 Dec '17

Is it possible to execute a script within a tool xml confit to retrieve some data and append to the ui depending on the requested data. I.e if I wanted to get a list of files and provide them as select options before hitting the execute button. --- Sent from VMware Boxer

4 7

Galaxy moves files form job directory but attempts to look for them at original path
by Evan Clark 30 Nov '17

30 Nov '17

Below is an error obtained from our galaxy install. We have custom directories sets for the files directory and the jobs directory. Galaxy appears to move the files but then attempts to look for them at the original path. I have tried unsetting these options but it still persists. galaxy.jobs DEBUG 2017-11-24 17:53:19,057 finish(): Moved /var/web_services/galaxy/database/jobs_directory/000/320/galaxy_dataset_431.dat to /mnt/ceph/home/galaxy/galaxy/files_directory/000/dataset_401.dat galaxy.model.metadata DEBUG 2017-11-24 17:53:19,128 setting metadata externally failed for HistoryDatasetAssociation 431: [Errno 2] No such file or directory galaxy.jobs.runners ERROR 2017-11-24 17:53:19,319 (320/179084) Job wrapper finish method failed Traceback (most recent call last): File "/var/web_services/galaxy/lib/galaxy/jobs/runners/__init__.py", line 630, in finish_job job_state.job_wrapper.finish( stdout, stderr, exit_code ) File "/var/web_services/galaxy/lib/galaxy/jobs/__init__.py", line 1266, in finish dataset.datatype.set_meta( dataset, overwrite=False ) File "/var/web_services/galaxy/lib/galaxy/datatypes/binary.py", line 391, in set_meta exit_code = subprocess.call( args=command, stderr=open( stderr_name, 'wb' ) ) File "/usr/lib64/python2.7/subprocess.py", line 524, in call return Popen(*popenargs, **kwargs).wait() File "/usr/lib64/python2.7/subprocess.py", line 711, in __init__ errread, errwrite) File "/usr/lib64/python2.7/subprocess.py", line 1327, in _execute_child raise child_exception OSError: [Errno 2] No such file or directory galaxy.jobs ERROR 2017-11-24 17:53:19,337 fail(): Missing output file in working directory: [Errno 2] No such file or directory: '/var/web_services/galaxy/database/jobs_directory/000/320/galaxy_dataset_431.dat'

2 1

TR: Close cluster
by Arnaud Cheuk 29 Nov '17

29 Nov '17

Hi, I would like to close my cluster, but when click on delete permanently, I see the cluster is still active. Could you help me to close the cluster? cduanra-galaxy-cloud-17-11-28t22-14 Appliance: Galaxy CloudMan Version: 17.05 Cloud: amazon-us-east-n-virginia RUNNING http://52.202.138.61/cloud Best, Arnaud

2 1

external display and data editing
by Nils Paulhe 22 Nov '17

22 Nov '17

Dear list, I'm working on data visualization / display in galaxy. I'm wondering if it's possible to save a resource edited from the viewer plugin or an external display in the current history. In my opinion the easier / proper way is to use an external display to show / edit the resources and upload the edited files in the current history using galaxy API. Does anyone have tried something similar? Cheers Nils

4 4

GMOD hackathon before PAG San Diego in January
by Scott Cain 20 Nov '17

20 Nov '17

Hi all, This January before PAG on the Wednesday and Thursday before PAG (January 10-11) in San Diego we are planning a GMOD hackathon. We expect that participants will be interested in solving problems/creating solutions related to Tripal, JBrowse, Apollo, and Galaxy but if you're interested in another GMOD project, by all means, let us know! We expect this hackathon to overlap with the Tripal hackathon that is on January 11 (I'm pretty sure; right Stephen?) If you are interested in attending this hackathon, please let me know so I can be sure we have an appropriately sized space. And if you're coming for the pre-PAG hackathon, consider staying for PAG, since there is always a lot of GMOD-related content at the meeting! Thanks, Scott -- ------------------------------------------------------------------------ Scott Cain, Ph. D. scott at scottcain dot net GMOD Coordinator (http://gmod.org/) 216-392-3087 Ontario Institute for Cancer Research

1 1

broken after upgrade to 17.09 : uploading files via the API
by Hans-Rudolf Hotz 20 Nov '17

20 Nov '17

Dear All If I execute the following command: python import_with_dbkey.py *** file.bam hg19sub the bam files will be added to the user's history the code (import_with_dbkey.py) is as follows: import sys sys.path.append('***/bioblend-0.10.0-py2.7.egg') sys.path.append('***/requests_toolbelt-0.7.0-py2.7.egg') from bioblend.galaxy import GalaxyInstance from bioblend.galaxy.tools import ToolClient url = "http://galaxy-dev.fmi.ch" key = "***" history_id = sys.argv[1] file_path = sys.argv[2] dbkey= sys.argv[3] gi = GalaxyInstance(url=url, key=key) toolClient = ToolClient(gi) uploadedFile = toolClient.upload_file(file_path, history_id, dbkey=dbkey) Now, if I use the virtual environment from Galaxy, I get: (.venv)-bash-4.2$ python import_with_dbkey.py *** file.bam hg19sub Traceback (most recent call last): File "/***/galaxy/tools/fmi__api_helpers/import_with_dbkey.py", line 40, in <module> uploadedFile = toolClient.upload_file(file_path, history_id, dbkey=dbkey) File "/***/galaxy/.venv/lib/python2.7/site-packages/bioblend/galaxy/tools/__init__.py", line 148, in upload_file return self._tool_post(payload, files_attached=True) File "/***/galaxy/.venv/lib/python2.7/site-packages/bioblend/galaxy/tools/__init__.py", line 218, in _tool_post return Client._post(self, payload, files_attached=files_attached) File "/***/galaxy/.venv/lib/python2.7/site-packages/bioblend/galaxy/client.py", line 171, in _post files_attached=files_attached) File "/***/galaxy/.venv/lib/python2.7/site-packages/bioblend/galaxyclient.py", line 131, in make_post_request r.status_code, body=r.text) bioblend.galaxy.client.ConnectionError: Unexpected response from galaxy: 400: <!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN"> <html><head> <title>400 Bad Request</title> </head><body> <h1>Bad Request</h1> <p>Your browser sent a request that this server could not understand.<br /> </p> </body></html> (.venv)-bash-4.2$ ...and the file does not get uploaded. I will continue investigating the difference between the python modules used, but maybe someone has a clue and could help me Thank you very much Hans-Rudolf

2 2