January 2016 - galaxy-dev - lists.galaxyproject.org

error loading files into galaxy
by Hakeem Almabrazi 04 Mar '16

04 Mar '16

Hi, I started getting the following error whenever I try to load a file into Galaxy local. Traceback (most recent call last): File "/usr/local/galaxy/galaxy-dist/tools/data_source/upload.py", line 8, in <module> from galaxy import eggs ImportError: cannot import name eggs I will appreciate if someone can tell me what could happen to cause such issue and how to resolve it. Regards,

2 1

BED12 Data Format
by Lance Parsons 27 Feb '16

27 Feb '16

Does anyone know of any efforts to create a BED12 datatype for Galaxy? Since some tools require BED12 and the automatic convertion from GFF-to-BED does not seem to generate a BED12, it seems it might be a worthwhile addition. If not, what would be the best way to go about doing this? Making it part of the core galaxy (which would allow multiple tools to share the same data type definitions) or making it part of a toolshed tool (which I'm not sure how to do)? BTW, I'm thinking about RSeQC at the moment, but I know other tools use/require this format. -- Lance Parsons - Scientific Programmer Carl C. Icahn Laboratory - Room 141 (Temporary) Lewis-Sigler Institute for Integrative Genomics Princeton University

2 5

Multiple web servers and handlers Galaxy failed
by Makis Ladoukakis 25 Feb '16

25 Feb '16

Hello everyone, I am trying to setup a Galaxy instance for a multi-user production environment and I tried to follow the instructions here: https://wiki.galaxyproject.org/Admin/Config/Performance/Scaling https://wiki.galaxyproject.org/Admin/Config/Performance/ProductionServer https://wiki.galaxyproject.org/Admin/Config/ApacheProxy but when I tried to start my galaxy instance (GALAXY_RUN_ALL=1 sh run.sh --daemon) I got the following error in my browser:Bad Gateway The proxy server received an invalid response from an upstream server. I don't get any errors from the paster.log files so I am guessing the error is somewhere in my apache configuration although I can't see where it could be. Has anyone encountered this problem before? Kind regards, Makis P.S. My apache configuration is as follows: I added that to my apache httpd.conf file: #for galaxy #RewriteRule ^/galaxy(.*) http://localhost:8091$1 [P] RewriteRule ^/galaxy$ /galaxy/ [R] RewriteRule ^/galaxy/static/style/(.*) /home/galaxy/galaxy/static/june_2007_style/blue/$1 [L] RewriteRule ^/galaxy/static/scripts/(.*) /home/galaxy/galaxy/static/scripts/packed/$1 [L] RewriteRule ^/galaxy/static/(.*) /home/galaxy/galaxy/static/$1 [L] RewriteRule ^/galaxy/favicon.ico /home/galaxy/galaxy/static/favicon.ico [L] RewriteRule ^/galaxy/robots.txt /home/galaxy/galaxy/static/robots.txt [L] LoadModule uwsgi_module /etc/httpd/modules/mod_uwsgi.so <Location "/galaxy"> Sethandler uwsgi-handler uWSGISocket 127.0.0.1:4001 uWSGImaxVars 512 </Location> I am also attaching my job_conf.xml and galaxy.ini file.

5 15

bx-python issue with intersect and subtract tools
by Poole, Richard 12 Feb '16

12 Feb '16

Hi all, I just used the subtract tool (installed under Operate on Genomic Intervals) on my own Galaxy server for the first time in a very long time and got this error message from the tool: Traceback (most recent call last): File "/Users/galaxy/shed_tools/toolshed.g2.bx.psu.edu/repos/devteam/subtract/c19a2a29c561/subtract/gops_subtract.py<http://toolshed.g2.bx.psu.edu/repos/devteam/subtract/c19a2a29c561/subtract/…>", line 16, in <module> from bx.intervals.io import GenomicInterval, NiceReaderWrapper ImportError: No module named bx.intervals.io So I uninstalled the intersect and subtract tools, plus the bx-python 0.7.1 package plus the galaxy-ops package and reinstalled both tools from the toolshed using the latest revisions of each from devteam. I now get this error message: /Users/galaxy/galaxy-dist/lib/galaxy/__init__.py:63: UserWarning: Module bx was already imported from /Users/galaxy/galaxy-dist/tool-dependencies/bx-python/0.7.1/devteam/package_bx_python_0_7/2d0c08728bca/venv/lib/python2.7/site-packages/bx/__init__.pyc, but /Users/galaxy/galaxy-dist/eggs/bx_python-0.7.2-py2.7-macosx-10.6-intel-ucs2.egg is being added to sys.path self.check_version_conflict() Traceback (most recent call last): File "/Users/galaxy/shed_tools/toolshed.g2.bx.psu.edu/repos/devteam/subtract/c19a2a29c561/subtract/gops_subtract.py<http://toolshed.g2.bx.psu.edu/repos/devteam/subtract/c19a2a29c561/subtract/…>", line 21, in <module> from utils.gff_util import GFFFeature, GFFReaderWrapper, convert_bed_coords_to_gff ImportError: No module named utils.gff_util Does this suggest an incompatibility somehow with the the egg which is installed at startup and is versions 0.7.2 - I tried manually editing the egg file but could not switch that to 0.7.1 I also then tried updating Galaxy to latest release 15.07 and even 15.10 which appeared in the git tag list as I writing this email, but no fix there - my Galaxy is running on a Mac OS X 10.10.5 Yosemite. Any thoughts on how to resolve this problem? Cheers, Rich Richard J Poole PhD Wellcome Trust Fellow Department of Cell and Developmental Biology University College London 518 Rockefeller 21 University Street, London WC1E 6DE Office (518 Rockefeller): +44 20 7679 6577 (int. 46577) Lab (529 Rockefeller): +44 20 7679 6133 (int. 46133)

2 1

A Report Calc tool which provides a scripting language and interpreter for text mining and quality control
by Dooley, Damion 09 Feb '16

09 Feb '16

Folks, we're testing out a basic scripting language and interpreter for report writing and quality control that is meant to provide both command-line programmers and Galaxy platform researchers and admins with ways to tweak workflow quality control behaviour without having to be programmers themselves. I wanted to sound-out the community about whether or not there are any basic objections to our approach, described briefly below? Currently the interpreter provides all the built-in Python operator and math functions (as well as some particular named group regular expression functions for text mining) so that users can examine given input log or data datasets for fields that need to be reported or compared with QC metric rules. The Report Calc tool takes in a file of statements (each being a function(parameter1 parameter2 ...) syntax) that look like this: set(4857000 report/contigs/reference_genome_size) set("serovar Typhimurium LT2" report/contigs/reference_genome) set(0.1 report/contigs/good_genome_size_ratio) set( statisticN(report/contigs/contig_lengths 50) report/contigs/N50) if( lt(/N50 200000) set(report/job/status FAIL)) Math is accomplished by python built-in math functions (I.e. Ignore the "/" - that's a namespace syntax character). set( truediv( abs( sub( /sampleGenomeSize /referenceGenomeSize)) /referenceGenomeSize) report/contigs/sample_genome_size_ratio ) And writes any output as desired to a standard tool output folder: writeFile( pageHtml( getHtml(report) "My Report Widget") report.html ) It allows users to build a ruleset (file containing statements like the above), and process text, json, tabular datasets in their history, and it can manipulate variables, arrays and dictionaries in the tools in-memory temporary data structure namespace. It doesn't touch Galaxy's inner workings or interact with a workflow except by way of app exit codes. One can even write little text-mining programs in it: iterate( readFileByName(contigs-all.fasta) if( eq( getitem(iterator/0/value 0) ">") append( regexp(iterator/0/value "length_(?P<value>\\d+)_") report/contigs/contig_lengths ) ) ) I'll release it shortly for review/play, with lots of documentation that describes in detail what it can/can't do, and an argument for why one might want to bother using/learning it. There are one or two irrelevant python built-in functions we might filter out (e.g. isCallable() ); so far we haven't spotted any security issues, and we've limited the flow control to only accomplish loops by iterables so there's no evident way to create infinite loops. One only iterates through files or in-memory arrays. As well suggested functionality for the wish-list now accepted! Regards, Damion

2 4

EMBOSS 6.6.0 + NCBI-BLAST+ integration
by Floreline TOUCHARD 09 Feb '16

09 Feb '16

Hi, I would like to add some tools of the EMBOSS suite (6.6.0) to my Galaxy instance. It seems that the only wrapper available for Galaxy is for the 5.0.0 version ( http://dev.list.galaxyproject.org/Galaxy-with-EMBOSS-5-or-EMBOSS-6-td465804…) I would like to know if someone has already tried (successfully or not) to wrap this tools base on the old wrappers to estimate the workload that awaits me (for prettyseq and water mostly). Could there be an invalid datatype format for example ? I have another question regarding the NCBI BLAST+ suite : is there a way to edit the XML file to enable the selection of multiple databases as proposed by the command lines tool ? Thanks in advance, F.T

4 8

Removing set_metadata_externally from wiki documentation?
by Peter Cock 06 Feb '16

06 Feb '16

Hello all, We're currently looking at changing our Galaxy setup to link user accounts with Linux user accounts for better cluster integration (running jobs as the actual user on SGE). As part of this, we've tried setting up a fresh installation on a new VM which has thrown up some issues. First of all, what is the status of the old set_metadata_externally setting? This is described on the legacy documentation page as required under "Submitting Jobs as the Real User", https://wiki.galaxyproject.org/Admin/Config/Performance/Cluster/Legacy Unfortunately, the same text is still present on the current page: https://wiki.galaxyproject.org/Admin/Config/Performance/Cluster/ According to the GitHub search, set_metadata_externally no longer exists in the code or default settings files: https://github.com/galaxyproject/galaxy/search?q=set_metadata_externally I eventually tracked this down to the following commit, first included in Galaxy v13.06, back when the config file was universe_wsgi.ini rather than config/galaxy.ini, https://github.com/galaxyproject/galaxy/commit/68065e123800a5a2e700d636db93… So, can we assume that metadata is now always set externally, and should the wiki be updated accordingly? Thanks, Peter

2 2

Upload issue in local installation
by Batsal Devkota 05 Feb '16

05 Feb '16

I installed galaxy locally in a linux server. However, I cannot upload the files (no matter how small, I have tried few kb size fasta files). When I try to upload, the link to the file shows up in the History and gets a new number (purple box). When I click on the link I get 'Dataset is uploading' forever. In the terminal window where I start galaxy, I get the following error report: 92.17.41.13 - - [02/Aug/2012:15:33:32 -0400] "GET / HTTP/1.1" 200 - "-" "Mozilla/5.0 (Windows NT 5.2; rv:13.0) Gecko/20100101 Firefox/13.0.1" 92.17.41.13 - - [02/Aug/2012:15:33:32 -0400] "GET /root/tool_menu HTTP/1.1" 200 - "http://redhat:8080/" "Mozilla/5.0 (Windows NT 5.2; rv:13.0) Gecko/20100101 Firefox/13.0.1" 92.17.41.13 - - [02/Aug/2012:15:33:32 -0400] "GET /history HTTP/1.1" 200 - "http://redhat:8080/" "Mozilla/5.0 (Windows NT 5.2; rv:13.0) Gecko/20100101 Firefox/13.0.1" 92.17.41.13 - - [02/Aug/2012:15:33:33 -0400] "POST /root/user_get_usage HTTP/1.1" 200 - "http://redhat:8080/history" "Mozilla/5.0 (Windows NT 5.2; rv:13.0) Gecko/20100101 Firefox/13.0.1" 92.17.41.13 - - [02/Aug/2012:15:33:40 -0400] "GET /tool_runner?tool_id=upload1 HTTP/1.1" 200 - "http://redhat:8080/root/tool_menu" "Mozilla/5.0 (Windows NT 5.2; rv:13.0) Gecko/20100101 Firefox/13.0.1" 92.17.41.13 - - [02/Aug/2012:15:33:59 -0400] "POST /tool_runner/upload_async_create HTTP/1.1" 200 - "http://redhat:8080/" "Mozilla/5.0 (Windows NT 5.2; rv:13.0) Gecko/20100101 Firefox/13.0.1" 92.17.41.13 - - [02/Aug/2012:15:33:59 -0400] "GET /tool_runner/upload_async_message HTTP/1.1" 200 - "http://redhat:8080/" "Mozilla/5.0 (Windows NT 5.2; rv:13.0) Gecko/20100101 Firefox/13.0.1" 92.17.41.13 - - [02/Aug/2012:15:33:59 -0400] "GET /history HTTP/1.1" 200 - "http://redhat:8080/tool_runner/upload_async_message" "Mozilla/5.0 (Windows NT 5.2; rv:13.0) Gecko/20100101 Firefox/13.0.1" 92.17.41.13 - - [02/Aug/2012:15:33:59 -0400] "POST /root/user_get_usage HTTP/1.1" 200 - "http://redhat:8080/history" "Mozilla/5.0 (Windows NT 5.2; rv:13.0) Gecko/20100101 Firefox/13.0.1" 92.17.41.13 - - [02/Aug/2012:15:34:04 -0400] "POST /root/history_item_updates HTTP/1.1" 200 - "http://redhat:8080/history" "Mozilla/5.0 (Windows NT 5.2; rv:13.0) Gecko/20100101 Firefox/13.0.1" 92.17.41.13 - - [02/Aug/2012:15:34:08 -0400] "POST /root/history_item_updates HTTP/1.1" 200 - "http://redhat:8080/history" "Mozilla/5.0 (Windows NT 5.2; rv:13.0) Gecko/20100101 Firefox/13.0.1" The last line keeps going for ever... writes new line every 4 secs. I am stuck and don't know where to look. Please help. Batsal.

6 7

planemo reports test failure when test succeeds
by Peter van Heusden 04 Feb '16

04 Feb '16

Hi there When testing the latest trimmomatic tool (from https://github.com/fls-bioinformatics-core/galaxy-tools/tree/master/trimmom…, planemo test reports an error on the last test, but according to the test report the test has succeeded (see attached HTML and JSON). For the test setup you need to set some environment variables: TRIMMOMATIC_DIR - the location of the trimmomatic jar TRIMMOMATIC_JAR - the name of the jar file TRIMMOMATIC_ADAPTERS_DIR - location of adapters This is with planemo 0.22.2 and a fresh $HOME/.planemo. Any ideas? Peter

2 2

Trimmomatic doesn't recognise pair collection
by Peter van Heusden 04 Feb '16

04 Feb '16

Hi there I've got Trimmomatic installed (from the toolshed) into our local Galaxy server (server is latest commit on the dev branch from GitHub). It refuses to see a dataset pair as a valid input, however. I've tested this with two types: firstly a pair made out of 2 individual datasets (both fastqsanger) and then also a list of pairs. I've tested this with 'planemo serve' and the tool works, but for some reason it is not working on our server. Any ideas? Thanks, Peter

2 3