- galaxy-dev - lists.galaxyproject.org

maximum recursion depth exceeded while calling a Python object
by Liisa Koski 30 Jan '13

30 Jan '13

Hi, I'm running a local instance of Galaxy and no matter what tool I run I get the following error: Error executing tool: maximum recursion depth exceeded while calling a Python object In the log file: galaxy.tools ERROR 2013-01-25 14:06:54,375 Exception caught while attempting tool execution: Traceback (most recent call last): File "/Galaxy/galaxy_dist/lib/galaxy/tools/__init__.py", line 1776, in handle_input _, out_data = self.execute( trans, incoming=params, history=history ) File "/Galaxy/galaxy_dist/lib/galaxy/tools/__init__.py", line 2103, in execute return self.tool_action.execute( self, trans, incoming=incoming, set_output_hid=set_output_hid, history=history, **kwargs ) File "/Galaxy/galaxy_dist/lib/galaxy/tools/actions/__init__.py", line 203, in execute chrom_info = build_fasta_dataset.get_converted_dataset( trans, 'len' ).file_name File "/Galaxy/galaxy_dist/lib/galaxy/model/__init__.py", line 1161, in get_converted_dataset new_dataset = self.datatype.convert_dataset( trans, self, target_ext, return_output=True, visible=False, deps=deps, set_output_history=False ).values()[0] File "/Galaxy/galaxy_dist/lib/galaxy/datatypes/data.py", line 467, in convert_dataset converted_dataset = converter.execute( trans, incoming=params, set_output_hid=visible, set_output_history=set_output_history)[1] File "/Galaxy/galaxy_dist/lib/galaxy/tools/__init__.py", line 2103, in execute return self.tool_action.execute( self, trans, incoming=incoming, set_output_hid=set_output_hid, history=history, **kwargs ) File "/Galaxy/galaxy_dist/lib/galaxy/tools/actions/__init__.py", line 203, in execute chrom_info = build_fasta_dataset.get_converted_dataset( trans, 'len' ).file_name File "/Galaxy/galaxy_dist/lib/galaxy/model/__init__.py", line 1161, in get_converted_dataset new_dataset = self.datatype.convert_dataset( trans, self, target_ext, return_output=True, visible=False, deps=deps, set_output_history=False ).values()[0] File "/Galaxy/galaxy_dist/lib/galaxy/datatypes/data.py", line 467, in convert_dataset converted_dataset = converter.execute( trans, incoming=params, set_output_hid=visible, set_output_history=set_output_history)[1] File "/Galaxy/galaxy_dist/lib/galaxy/tools/__init__.py", line 2103, in execute return self.tool_action.execute( self, trans, incoming=incoming, set_output_hid=set_output_hid, history=history, **kwargs ) File "/Galaxy/galaxy_dist/lib/galaxy/tools/actions/__init__.py", line 203, in execute chrom_info = build_fasta_dataset.get_converted_dataset( trans, 'len' ).file_name File "/Galaxy/galaxy_dist/lib/galaxy/model/__init__.py", line 1161, in get_converted_dataset new_dataset = self.datatype.convert_dataset( trans, self, target_ext, return_output=True, visible=False, deps=deps, set_output_history=False ).values()[0] File "/Galaxy/galaxy_dist/lib/galaxy/datatypes/data.py", line 467, in convert_dataset converted_dataset = converter.execute( trans, incoming=params, set_output_hid=visible, set_output_history=set_output_history)[1] File "/Galaxy/galaxy_dist/lib/galaxy/tools/__init__.py", line 2103, in execute return self.tool_action.execute( self, trans, incoming=incoming, set_output_hid=set_output_hid, history=history, **kwargs ) thousands of lines here...ending with... File "/Galaxy/galaxy_dist/eggs/SQLAlchemy-0.5.6_dev_r6498-py2.6.egg/sqlalchemy/schema.py", line 760, in _make_proxy selectable.columns.add(c) File "/Galaxy/galaxy_dist/eggs/SQLAlchemy-0.5.6_dev_r6498-py2.6.egg/sqlalchemy/sql/expression.py", line 1668, in add self[column.key] = column File "/Galaxy/galaxy_dist/eggs/SQLAlchemy-0.5.6_dev_r6498-py2.6.egg/sqlalchemy/sql/expression.py", line 1671, in __setitem__ if key in self: File "/Galaxy/galaxy_dist/eggs/SQLAlchemy-0.5.6_dev_r6498-py2.6.egg/sqlalchemy/sql/expression.py", line 1702, in __contains__ return util.OrderedProperties.__contains__(self, other) File "/Galaxy/galaxy_dist/eggs/SQLAlchemy-0.5.6_dev_r6498-py2.6.egg/sqlalchemy/util.py", line 652, in __contains__ return key in self._data RuntimeError: maximum recursion depth exceeded while calling a Python object Any help would be much appreciated, Thanks in advance, Liisa

2 1

rerun tool in a workflow
by Hagai Cohen 30 Jan '13

30 Jan '13

Hi, is it possible that when I rerun a tool it will also rerun the tools that depends on it?

2 1

Different behavior of select tag in the tool configuration file when the number of options is different.
by Luobin Yang 30 Jan '13

30 Jan '13

Hi, I have a 'select' tag in a tool's XML file, I would like to have a default option, which is choosing nothing. So the drop down menu of the web interface will be empty and when a user clicks the drop down menu, the list contains an empty entry with other options. So I basically have an option tag like the following <option value=""></option> together with other options. This works fine when I have up to 19 options including the default options. A user can submit the job without selecting any options and the program will use the default option. However, when the number of options exceeds 20, then drop down menu of the web interface displays "Click to Select or Search" instead of empty. And the user has to select one of the options in order to submit the job, otherwise, a question mark is displayed in the drop down menu and then an error message shows up under the drop down menu with the message "An invalid option was selected, please verify". Why the behavior changed when there are 20 options or more for a drop down menu? Thanks, Luobin

3 2

extract DNA sequences
by Solorzano, Eleanne 30 Jan '13

30 Jan '13

Hi, I am trying to extract my sequences from a fasta file in my galaxy account based on the start and end positions of a gff file. However, this is not working here. How do I specify that the strands I am extracting are in the fasta file in my account in Galaxy? Should I be using another tool, please? Thank you. Eleanne

1 0

Reloading tool's configuration not working
by Joachim Jacob |VIB| 30 Jan '13

30 Jan '13

Hi, In the 'Admin' menu, reloading a tool's xml file does not update the tool's interface. Thanks for any assistance, Joachim -- Joachim Jacob Rijvisschestraat 120, 9052 Zwijnaarde Tel: +32 9 244.66.34 Bioinformatics Training and Services (BITS) http://www.bits.vib.be @bitsatvib

2 2

Best way to work with one directory and many files as 1 input
by Pierre Pericard 30 Jan '13

30 Jan '13

Hi all, We've just added some new tools based on R scripts to our local Galaxy instance. Most of these tools need to work at the root of the directory containing the input files (up to hundreds of XML files) spread among two or more sub-directories. The directory structure need to be kept since the R tools recursively search for files and use the subdirectories names as classes. To solve this problem we added a "dummy" datatype to our instance so we can upload the input directory as a zip file without Galaxy decompressing it. <datatype extension="dummy_zip" type="galaxy.datatypes.data:Data" mimetype="application/zip" display_in_upload="true" subclass="true" /> However, since our tools can be runned as a workflow and that most of them need this input directory we need to unzip it with R in the job working directory for each tool (about 5 times for the entire workflow). Furthermore, this solution doesn't seem very "clean" if we want to share our tools via the ToolShed. Is there a smart way to handle this kind of input directory that can be achieved with Galaxy default datatypes and/or that doesn't require to unzip a file each time we use a tool ? Any update on a behavior change about zip files (http://lists.bx.psu.edu/pipermail/galaxy-dev/2011-June/005631.html) ? Thanks in advance for any input, Pierre -- Pierre Pericard IE CDD - Projet Peptisan Service Informatique et Bio-informatique (SIB) Station Biologique de Roscoff CNRS-UPMC Place Georges Teissier CS 90074 29688 Roscoff CEDEX FRANCE http://abims.sb-roscoff.fr/

3 6

Re: [galaxy-dev] Reloading tool's configuration not working
by Joachim Jacob |VIB| 30 Jan '13

30 Jan '13

Unfortunately, no. Joachim Jacob Rijvisschestraat 120, 9052 Zwijnaarde Tel: +32 9 244.66.34 Bioinformatics Training and Services (BITS) http://www.bits.vib.be @bitsatvib On 01/30/2013 10:56 AM, Peter Cock wrote: > On Wed, Jan 30, 2013 at 9:54 AM, Joachim Jacob |VIB| > <joachim.jacob(a)vib.be> wrote: >> Hi, >> >> >> In the 'Admin' menu, reloading a tool's xml file does not update the tool's >> interface. >> >> >> Thanks for any assistance, >> >> Joachim > I had a 'funny' recently where I had to do the xml reload twice, then it worked. > Same for you? > > Peter > >

1 0

workflows stop prematurely
by mark.rose＠syngenta.com 30 Jan '13

30 Jan '13

Hi All On my local install of galaxy I'm having problems executing workflows. I will upload data into a new history and then select to run a saved workflow. This initiates fine but, after the completion of a variable number of steps, the workflow just stops after the successful completion of a step. No errors appear in the web interface and all I can see in the paster.log is something like 90 HTTP/1.1" 200 - "http://127.0.0.1:8081/history" "Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:18.0) Gecko/20100101 Firefox/18.0" 127.0.0.1 - - [28/Jan/2013:12:29:07 -0400] "GET /api/histories/82b264d8c3d11790 HTTP/1.1" 200 - "http://127.0.0.1:8081/history" "Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:18.0) Gecko/20100101 Firefox/18.0" galaxy.jobs.runners.local DEBUG 2013-01-28 12:29:08,621 execution finished: python /home/rosema1/Projects/galaxy-dist/tools/fastq/fastq_trimmer_by_quality.py '/home/rosema1/Projects/galaxy-dist/database/files/000/dataset_590.dat' '/home/rosema1/Projects/galaxy-dist/database/files/000/dataset_592.dat' -f 'sanger' -s '5' -t '1' -e '53' -a 'mean' -x '0' -c '>=' -q '20.0' galaxy.jobs DEBUG 2013-01-28 12:29:08,838 Tool did not define exit code or stdio handling; checking stderr for success galaxy.tools DEBUG 2013-01-28 12:29:09,135 Error opening galaxy.json file: [Errno 2] No such file or directory: '/home/rosema1/Projects/galaxy-dist/database/job_working_directory/000/418/galaxy.json' galaxy.jobs DEBUG 2013-01-28 12:29:09,439 job 418 ended galaxy.jobs DEBUG 2013-01-28 12:29:10,041 (420) Working directory for job is: /home/rosema1/Projects/galaxy-dist/database/job_working_directory/000/420 galaxy.jobs.handler DEBUG 2013-01-28 12:29:10,042 dispatching job 420 to local runner galaxy.jobs.handler INFO 2013-01-28 12:29:10,200 (420) Job dispatched galaxy.jobs.runners.local DEBUG 2013-01-28 12:29:10,385 Local runner: starting job 420 galaxy.jobs.runners.local DEBUG 2013-01-28 12:29:10,759 executing: python /home/rosema1/Projects/galaxy-dist/tools/fastq/fastq_filter.py /home/rosema1/Projects/galaxy-dist/database/files/000/dataset_592.dat /home/rosema1/Projects/galaxy-dist/database/job_working_directory/000/420/tmph0Ll2V /home/rosema1/Projects/galaxy-dist/database/files/000/dataset_594.dat /home/rosema1/Projects/galaxy-dist/database/job_working_directory/000/420/dataset_594_files 'sanger' 127.0.0.1 - - [28/Jan/2013:12:29:12 -0400] "GET /api/histories/82b264d8c3d11790 HTTP/1.1" 200 - "http://127.0.0.1:8081/history" "Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:18.0) Gecko/20100101 Firefox/18.0" 127.0.0.1 - - [28/Jan/2013:12:29:12 -0400] "GET /api/users/f2db41e1fa331b3e HTTP/1.1" 200 - "http://127.0.0.1:8081/history" "Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:18.0) Gecko/20100101 Firefox/18.0" 127.0.0.1 - - [28/Jan/2013:12:29:12 -0400] "GET /api/histories/82b264d8c3d11790/contents?ids=3da459a26c8f00b4%2C736af8f0a76a2e71 HTTP/1.1" 200 - "http://127.0.0.1:8081/history" "Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:18.0) Gecko/20100101 Firefox/18.0" 127.0.0.1 - - [28/Jan/2013:12:29:16 -0400] "GET /api/histories/82b264d8c3d11790 HTTP/1.1" 200 - "http://127.0.0.1:8081/history" "Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:18.0) Gecko/20100101 Firefox/18.0" Though I seem to see this even when a step completes and the workflow proceeds. Moreover, if I then begin executing the next steps in the workflow, they work, but create new entries in the history. So, some questions: Why is this happening and what can I do to get workflows to run to completion? Also, is it possible to reinitiate the workflow from the premature stopping point without having to launch each step individually and point each at new inputs rather than the ones dictated in the workflow? Thanks Mark This message may contain confidential information. If you are not the designated recipient, please notify the sender immediately, and delete the original and any copies. Any use of the message by you is prohibited.

1 1

Only custom genomes for uploads in data libraries
by Carlos Borroto 29 Jan '13

29 Jan '13

Hi, I'm running latest galaxy-dist locally. When I try to upload a dataset to a data library through Admin, I only get the two custom genomes I have created for visualizations. If I use the regular upload tool under "Get data", I do get to choose any of the genomes in: tool-data/shared/ucsc/builds.txt I tried deleting the custom genomes and then the dropbox menu in the data libraries upload form is empty. Is there something I'm missing? I would like to be able to select any genome available, custom or not. Thanks, Carlos

2 4

Re: [galaxy-dev] Error trying to add tools from tool shed respository
by Waldron, Michael H 29 Jan '13

29 Jan '13

I had stopped the Galaxy server before running the update, then started it afterward. Mike Waldron Systems Specialist ITS - Research Computing Center University of North Carolina at Chapel Hill ________________________________ From: Greg Von Kuster [greg(a)bx.psu.edu] Sent: Tuesday, January 29, 2013 9:12 AM To: Waldron, Michael H Cc: galaxy-dev(a)bx.psu.edu Subject: Re: [galaxy-dev] Error trying to add tools from tool shed respository Hi Michael, Did you restart your Galaxy server after updating from Galaxy central? Your paster log shows the following: File '/nas02/apps/galaxy-prod/galaxy-dist/lib/galaxy/webapps/galaxy/controllers/admin_toolshed.py', line 1201 in prepare_for_install description, repository_clone_url, changeset_revision, ctx_rev, repository_owner, tool_dependencies = repo_info_tuple However, that line no longer exists in the revision to which you've updated, and line 1201 of the admin_toolshed.py file is now: status = kwd.get( 'status', 'done' ) Greg Von Kuster On Jan 29, 2013, at 9:03 AM, Waldron, Michael H wrote: Here is the output from hg heads. [galaxy@galaxy galaxy-dist]$ hg heads changeset: 8677:22788c1262a2 tag: tip user: jeremy goecks <jeremy.goecks(a)emory.edu<mailto:jeremy.goecks@emory.edu>> date: Mon Jan 28 16:36:02 2013 -0500 summary: Language improvements for tophat wrappers. changeset: 7987:966a9b393b85 branch: add_requirement_tags_for_plink parent: 7472:06b31a61793c user: Dannon Baker <dannonbaker(a)me.com<mailto:dannonbaker@me.com>> date: Mon Aug 13 13:23:54 2012 -0400 summary: Branch close changeset: 7152:ffc20445b35e branch: split_blast2 parent: 7058:22f545c0d412 user: Dannon Baker <dannonbaker(a)me.com<mailto:dannonbaker@me.com>> date: Wed Apr 18 07:59:38 2012 -0400 summary: Branch close. changeset: 7151:c94957ac5454 branch: workflow_import_menu_api parent: 6834:1a3d01b09f7a user: Dannon Baker <dannonbaker(a)me.com<mailto:dannonbaker@me.com>> date: Wed Mar 21 09:50:44 2012 -0400 summary: Branch close for pull request. changeset: 7150:314a10ae112d branch: split_blast parent: 6757:ebf65c0b1e26 user: Dannon Baker <dannonbaker(a)me.com<mailto:dannonbaker@me.com>> date: Tue Feb 28 12:32:54 2012 -0500 summary: Close split_blast branch changeset: 7149:1327f2219423 branch: meme_requirement_on_fimo parent: 6662:8ba74c17e809 user: Daniel Blankenberg <dan(a)bx.psu.edu<mailto:dan@bx.psu.edu>> date: Fri Feb 03 11:15:29 2012 -0500 summary: close branch Mike Waldron Systems Specialist ITS - Research Computing Center University of North Carolina at Chapel Hill ________________________________ From: Greg Von Kuster [greg(a)bx.psu.edu] Sent: Tuesday, January 29, 2013 9:00 AM To: Waldron, Michael H Cc: galaxy-dev(a)bx.psu.edu<mailto:galaxy-dev@bx.psu.edu> Subject: Re: [galaxy-dev] Error trying to add tools from tool shed respository Hi Michael, The previous post you mention is outdated. The main Galaxy tool shed from which you are pulling has been tracking Galaxy dist for some time now, so you should only have to update to that. However, the communication layer between Galaxy and the tool shed is backward compatible to the December 20, 2012 Galaxy release, so whether you have updated from Galaxy central or Galaxy dist, you should not be seeing the behavior you describe. If you do, in fact, track Galaxy central though, and use the main Galaxy tool shed, you may experience some strange behavior because the the development code may include new features that are not available on the main tool shed since it tracks Galaxy dist. What is the result of typing the following in your Galaxy installation directory? hg heads Thanks, Greg Von Kuster On Jan 29, 2013, at 8:38 AM, Waldron, Michael H wrote: Users are getting the following error when trying to add a tool from the tool shed repository on our local galaxy instance. "An error occurred. See the error logs for more information. (Turn debug on to display exception reports here)" The galaxy server log shows the message included below. The main error is "ValueError: too many values to unpack ". From a similar previous post, the resolution was to use the latest code from Galaxy central. I just ran an "hg pull -u" pointing to galaxy-central (we had been pointing to galaxy-dist), but we still get the same error. Any ideas? (server log) [29/Jan/2013:08:19:05 -0400] "GET /admin_toolshed/prepare_for_install?tool_shed_url=http://toolshed.g2.bx.psu.edu/&repository_ids=f19bc86bac946438&changeset_revisions=2d6671b10919 HTTP/1.1" 500 - "http://toolshed.g2.bx.psu.edu/repository/preview_tools_in_changeset?reposit…" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_6_8) AppleWebKit/534.57.2 (KHTML, like Gecko) Version/5.1.7 Safari/534.57.2" Error - <type 'exceptions.ValueError'>: too many values to unpack URL: https://galaxy.its.unc.edu/admin_toolshed/prepare_for_install?tool_shed_url… File '/nas02/apps/galaxy-prod/galaxy-dist/eggs/Paste-1.6-py2.6.egg/paste/exceptions/errormiddleware.py', line 143 in __call__ app_iter = self.application(environ, start_response) File '/nas02/apps/galaxy-prod/galaxy-dist/eggs/Paste-1.6-py2.6.egg/paste/recursive.py', line 80 in __call__ return self.application(environ, start_response) File '/nas02/apps/galaxy-prod/galaxy-dist/lib/galaxy/web/framework/middleware/remoteuser.py', line 91 in __call__ return self.app( environ, start_response ) File '/nas02/apps/galaxy-prod/galaxy-dist/eggs/Paste-1.6-py2.6.egg/paste/httpexceptions.py', line 632 in __call__ return self.application(environ, start_response) File '/nas02/apps/galaxy-prod/galaxy-dist/lib/galaxy/web/framework/base.py', line 160 in __call__ body = method( trans, **kwargs ) File '/nas02/apps/galaxy-prod/galaxy-dist/lib/galaxy/web/framework/__init__.py', line 206 in decorator return func( self, trans, *args, **kwargs ) File '/nas02/apps/galaxy-prod/galaxy-dist/lib/galaxy/webapps/galaxy/controllers/admin_toolshed.py', line 1201 in prepare_for_install description, repository_clone_url, changeset_revision, ctx_rev, repository_owner, tool_dependencies = repo_info_tuple ValueError: too many values to unpack Mike Waldron Systems Specialist ITS - Research Computing Center University of North Carolina at Chapel Hill ___________________________________________________________ Please keep all replies on the list by using "reply all" in your mail client. To manage your subscriptions to this and other Galaxy lists, please use the interface at: http://lists.bx.psu.edu/

5 21