April 2012 - galaxy-dev - lists.galaxyproject.org

run_functional_tests.sh -sid option
by Peter 11 Feb '13

11 Feb '13

Hi, I'm trying to use run_functional_tests.sh to run all the tests for a section (group of tools). I've read the output from: ./run_functional_tests.sh help For example, from the tools_conf.xml.sample we have <section name="ENCODE Tools" id="EncodeTools"> <tool file="encode/gencode_partition.xml" /> <tool file="encode/random_intervals.xml" /> </section> And looking at these tools' XML files, <tool id="gencode_partition1" name="Gencode Partition"> and: <tool id="random_intervals1" name="Random Intervals"> I'd like to run the functional tests for the ENCODE tools, Using the switch for an individual tool id (-id) works, ./run_functional_tests.sh -id gencode_partition1 ... Ran 1 test in 22.302s ... and so does this (well, it say the tool doesn't have any tests which is true in this example): ./run_functional_tests.sh -id random_intervals1 ... Ran 1 test in 0.027s ... However, I also tried using the section id switch (-sid), ./run_functional_tests.sh -sid EncodeTools ... Ran 0 tests in 0.000s ... I also tried using the section name, /run_functional_tests.sh -sid "ENCODE Tools" Is this (-sid not working) a known issue, or am I using it wrong? Thanks, Peter

4 5

Problems with Internet Explorer 9?
by Peter Cock 19 Dec '12

19 Dec '12

Hello all, Are there (or were there) any known problems with Galaxy under Microsoft Internet Explorer 9? One of our biologists is now having problems with our local Galaxy server, probably after updating his browser. Specifically new history entries do not seem to automatically update from queued to running to done, and also the "peep" functionality to expand/collapse a history entry had stopped working. This was on a large history of about 100 entries. We installed Firefox 10, logged into Galaxy, and it was fine with this same history. A quick test on the public Galaxy with a single history entry seemed to work in both browsers, so perhaps this is something you've already fixed in the latest Galaxy - or perhaps it depends on the size of the history. Any ideas? Has anyone else seen something similar? Thanks, Peter

2 1

producing HTML output with images
by Nikhil Joshi 19 Dec '12

19 Dec '12

Hi all, I am having trouble producing HTML output with images. In the past I have been able to produce HTML files with no images and it seemed to work fine. However, now I am writing a script that produces diagnostic images and I want to display all of the images on one page using HTML. I am using the "files_path" variable to create the plots in the working directory, and then I am using the "extra_files_path" variable to access the final plot from the html file. I look at the resulting HTML files and it points to the proper plot full path, and the plot DOES exist... but when I click to view the output, the plot doesn't render. It just shows an empty box with a "broken image" icon, however, the text does render. I copy the plot file, and I can view it fine by itself. I copy the plot and the html and I can view the page just fine offline, but galaxy doesn't want to render the image for some reason. What am I doing wrong? - Nik. -- Nikhil Joshi Bioinformatics Programmer UC Davis Genome Center Davis, CA

3 4

Auto delete dataset after workflow run?
by Praveen Raj Somarajan 03 Dec '12

03 Dec '12

Hello All, Is there a way to set "auto delete" some datafiles at the end of workflow run? I'm asking this because it is sometimes useful to delete some outputs (say intermediate files, .logs, etc), for example "auto delete" .sam file after executing sam-to-bam tool, which would free-up lot of space. This is especially useful when work with large number of samples. Look forward to any comments/suggestions. Best, Raj. ________________________________ This e-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended solely for the use of the addressee(s). If you are not the intended recipient, please notify the sender by e-mail and delete the original message. Further, you are not to copy, disclose, or distribute this e-mail or its contents to any other person and any such actions that are unlawful. This e-mail may contain viruses. Ocimum Biosolutions has taken every reasonable precaution to minimize this risk, but is not liable for any damage you may sustain as a result of any virus in this e-mail. You should carry out your own virus checks before opening the e-mail or attachment. The information contained in this email and any attachments is confidential and may be subject to copyright or other intellectual property protection. If you are not the intended recipient, you are not authorized to use or disclose this information, and we request that you notify us by reply mail or telephone and delete the original message from your mail system. OCIMUMBIO SOLUTIONS (P) LTD

3 4

Hiding a tool via tool_conf.xml
by Peter Cock 30 Oct '12

30 Oct '12

Hi all, I'm aware that in an individual tool's XML wrapper you can add hidden="true" to the <tool> element to hide the tool from the listing shown in Galaxy's left hand panel (but the tool is still loaded and can be called by old workflows etc). Can this be done via the tool_conf.xml file as well? This would seem useful from a system configuration point of view where it seems wrong to edit the tool wrappers themselves. In fact, it might also be nice to add hidden="true" support to <section> as well as <tool> in tool_conf.xml - although I'm not so sure how useful that would be. Peter

1 2

Re: [galaxy-dev] Sample tracking data transfer hangs "in queue" forever
by TerAvest, Emily 27 Jul '12

27 Jul '12

Hi Leandro, I am also experiencing the same problem with the latest version of galaxy. I just attempted to connect our sequencer for the first time yesterday. I do not have an older version of galaxy to test and compare to see if it works in earlier versions. I am able to transfer data from the sequence to the import directory, however it is not moved to the data library. My data_transfer.log also has the same error. "The server could not comply with the request since it is either malformed or otherwise incorrect." Does anyone have a solution for this? Thanks Emily ------------------------------ Message: 17 Date: Wed, 28 Mar 2012 13:15:47 +0200 From: Leandro Hermida <softdev(a)leandrohermida.com> To: Luobin Yang <yangluob(a)isu.edu> Cc: Galaxy Dev <galaxy-dev(a)bx.psu.edu> Subject: Re: [galaxy-dev] Sample tracking data transfer hangs "in queue" forever Message-ID: <CAOhzmPJ67udRQBhfChgyxNrXsm3QcY1c7jna1kR0aJBNKEKJxA(a)mail.gmail.com> Content-Type: text/plain; charset=ISO-8859-1 Dear Galaxy Dev, Ok I have gotten further found out what was going on, in my data_transfer.log I was getting HTTP 404 Not Authorized when the data transfer was trying to access Galaxy API URLs http://galaxyserver/api/... This is because we are using external user authentication as documented in http://wiki.g2.bx.psu.edu/Admin/Config/Apache%20Proxy and this puts all of Galaxy behind this authentication. Since the Galaxy API uses API keys to essentially authenticate you have to change you <Location /> ... </Location> container to not match URLs starting with /api. To do this you have to change it to <LocationMatch "^/(?!api)"> .... </LocationMatch>. best, leandro On Mon, Mar 26, 2012 at 6:10 PM, Luobin Yang <yangluob(a)isu.edu> wrote: > I've got the same problem and when I looked at the data_transfer.log, I saw > the following message: > > 2012-03-01 15:12:27,338 - datatx_13870 - > (u'9c17d84742cd2acb63d88b5bd41d968f', > u'http://xxx.xxx.xxx.xxx/api/samples/2d9035b3fc152403', > {'sample_dataset_ids': ['a799d38679e985db', '33b43b4e7093c91f'], > 'error_msg': '', 'update_type': 'sample_dataset_transfer_status', > 'new_status': 'Adding to data library'}) > 2012-03-01 15:12:27,342 - datatx_13870 - Error. <!DOCTYPE HTML PUBLIC > "-//IETF//DTD HTML 2.0//EN"> > <html><head> > <title>405 Method Not Allowed</title> > </head><body> > <h1>Method Not Allowed</h1> > <p>The requested method PUT is not allowed for the URL > /api/samples/2d9035b3fc152403.</p> > <hr> > > Using Galaxy instead of Apache as the web server changed the sample status > from "in queue" to complete but didn't add the downloaded files to the data > library. > > Luobin > > On Mon, Mar 26, 2012 at 9:54 AM, Leandro Hermida > <softdev(a)leandrohermida.com> wrote: >> >> Dear Galaxy Dev, >> >> I've set up the Galaxy sample tracking system data transfer >> functionality exactly as specified here >> https://main.g2.bx.psu.edu/u/rkchak/p/data-transfer, but when I >> attempt to transfer datasets it puts them into the queue and then >> never seems to transfer anything. >> >> The galaxy_listener.log shows: >> >> 2012-03-26 17:16:24,515 - GalaxyAMQP - GALAXY LISTENER PID: 8738 - >> {'config_file': 'universe_wsgi.ini', 'http_server_section': >> 'server:main'} >> 2012-03-26 17:16:24,518 - GalaxyAMQP - {'exchange': 'galaxy_exchange', >> 'rabbitmqctl_path': >> >> '/gpfshpc/software/pmrdcdb/galaxy/rabbitmq/rabbitmq_server-2.8.1/sbin/rabbitmqctl', >> 'userid': 'galaxy_dev', 'routing_key': 'bar_code_scanner', 'queue': >> 'galaxy_queue', 'host': '127.0.0.1', 'virtual_host': >> 'galaxy_dev_messaging_engine', 'password': 'mypassword', 'port': >> '5672'} >> 2012-03-26 17:16:24,565 - GalaxyAMQP - Connected to rabbitmq server - >> 127.0.0.1:5672 >> 2012-03-26 17:31:23,393 - GalaxyAMQP - MESSAGE RECVD: data_transfer >> 2012-03-26 17:31:23,393 - GalaxyAMQP - DATA TRANSFER >> 2012-03-26 17:31:23,401 - GalaxyAMQP - Started process (25406): python >> >> "/gpfshpc/software/pmrdcdb/galaxy/galaxy_dist_dev/scripts/galaxy_messaging/server/data_transfer.py" >> " <data_transfer> >> <galaxy_host>rd-galaxydev.app.pmi</galaxy_host> >> <api_key>69bbd1a9b18eda2a888e9963820d8ef0</api_key> >> <data_host>chp723</data_host> >> <data_user>galaxy</data_user> >> <data_password>mypassword</data_password> >> <request_id>12</request_id> >> <sample_id>12</sample_id> >> <library_id>15</library_id> >> <folder_id>52</folder_id> ? ? ? ? ? ? ? ? ? ?<dataset> >> ?<dataset_id>10</dataset_id> >> <name>ttt_2.fastq.gz</name> >> <file>/gpfshpc/data/pmrdcdb/RNA-Seq/datasets/ttt-2.fastq.gz</file> >> ? ? ? ? ?</dataset><dataset> >> <dataset_id>9</dataset_id> >> <name>ttt_1.fastq.gz</name> >> <file>/gpfshpc/data/pmrdcdb/RNA-Seq/datasets/ttt-1.fastq.gz</file> >> ? ? ? ? ?</dataset> ? ? ? ? ? ? ? ?</data_transfer>" >> "universe_wsgi.ini" >> >> The FASTQ files are for testing and aren't very big (7.6 MB), what >> could be going wrong? >> >> regards, >> Leandro >> ___________________________________________________________ >> Please keep all replies on the list by using "reply all" >> in your mail client. ?To manage your subscriptions to this >> and other Galaxy lists, please use the interface at: >> >> ?http://lists.bx.psu.edu/ > > ************ This email message and any electronic files transmitted with it relating to the official business of Codexis, Inc. and its affiliates are proprietary, strictly confidential, and may be legally privileged. This email message is intended solely for the use of the individual(s) to whom it is addressed. If you believe you have received this email in error, please delete this email from your system and notify the sender immediately. If you are not the intended recipient, you should not disclose, distribute, use or copy this email or take any action in reliance on its contents.

4 9

HMMER wrappers
by Peter Cock 26 Jul '12

26 Jul '12

Hello all, Has anyone done a wrapper for HMMER2 or HMMER3? http://hmmer.janelia.org/software I can't find anything in the Tool Shed http://toolshed.g2.bx.psu.edu/ so we are likely to look into doing this ourselves - starting with hmmerscan. Thanks, Peter

4 16

Interested in speaking with other institutions deploying Galaxy locally?
by Ann Black-Ziegelbein 06 Jul '12

06 Jul '12

Hi everyone - Here at the University of Iowa we are working on deploying Galaxy locally for campus wide access. I am interested in forming a community of other institutions trying to deploy Galaxy locally and mange/operate it on a broad level. Is anyone else? If there is enough interest, possibly we could have a community conference call every other month to have an open discussion on how we are all deploying galaxy, customizations we are making, problems we are encountering, bugs, and any add-on operations management for galaxy being developed, etc. Would love to hear from others operating Galaxy or in process of standing up a local deployment. Thanks! Ann Black-Ziegelbein

22 32

Looking for recommendations: How to run galaxy workflows in batch
by Dave Lin 05 Jul '12

05 Jul '12

Hi All, I'm looking to batch process 40 large data sets with the same galaxy workflow. This obviously can be done in a brute-force manual manner. However, is there a better way to schedule/invoke these jobs in batch 1) from the UI with a plugin 2) command-line 3) web-service Thanks in advance for any pointers. Dave

5 8

Exporting histories through API
by Martin Dahlö 25 Jun '12

25 Jun '12

Hello there As the subject hints, I am trying to export histories through the API. Doing it through the web interface is a breeze, but has it been implemented in the API yet? I could not find anything about it in the examples or by searching the web/this list. I am planning to only use Galaxy through the API to import my data and run some workflows on it, and then export the results. Preferably specific files from the history, but a bundled history like the one you get from the web interface 'Export history' would be ok as well. Has anyone done something like this, and can point me in the right direction? :) Mvh Martin Dahlö --- Bioinformatic support martin.dahlo(a)scilifelab.uu.se +46 18 611 59 59 +46 706 70 79 55 http://www.scilifelab.uu.se/ http://www.uppnex.uu.se ---

3 3