- galaxy-dev - lists.galaxyproject.org

Error when changing default permissions for new histories
by Sarah Diehl 08 Jul '11

08 Jul '11

Hello, when I go to the user preferences and try to change the default permissions for new histories, I always get the following error (full message in attachment): Error - <type 'exceptions.TypeError'>: set_default_permissions() takes exactly 3 non-keyword arguments (2 given) URL: http://solweb2.immunbio.mpg.de/user/set_default_permissions File '/galaxy/galaxy_server/eggs/Paste-1.6-py2.6.egg/paste/exceptions/errormiddleware.py', line 143 in __call__ app_iter = self.application(environ, start_response) File '/galaxy/galaxy_server/eggs/Paste-1.6-py2.6.egg/paste/recursive.py', line 80 in __call__ return self.application(environ, start_response) File '/galaxy/galaxy_server/eggs/Paste-1.6-py2.6.egg/paste/httpexceptions.py', line 632 in __call__ return self.application(environ, start_response) File '/galaxy/galaxy_server/lib/galaxy/web/framework/base.py', line 145 in __call__ body = method( trans, **kwargs ) TypeError: set_default_permissions() takes exactly 3 non-keyword arguments (2 given) I would greatly appreciate any help to solve this problem. Thanks in advance! Best regards, Sarah

2 2

Galaxy <-> UCSC Authentication issues
by Federico De Masi 08 Jul '11

08 Jul '11

Dear list, I have recently finished to set local installations of both Galaxy and UCSC servers. Because of the required set-up, access to these is password protected. Galaxy uses the Apache authentication system (as by instructions in galaxy pages) and the username:password combos are the same used by our local UCSC server. Now, whenever I try to export tables to Galaxy from the UCSC hgTables tool, I get the following error on Galaxy: "Dataset generation errors Dataset 33: UCSC Main on Mouse: Rbbp5_Ang2011 (genome) Tool execution generated the following error message: The remote data source application may be off line, please try again later. Error: EOF when reading a line The tool produced the following additional output: Enter username for UCSC-Galaxy at ucsc.cbs.dtu.dk" Similarly, if I try to use UCSC to visualise a track I just created on Galaxy, no track will appear on UCSC I will get this error "Expected 200 http://galaxy.cbs.dtu.dk/display_application/48916fac0de9a85d/ucsc_bigwig/m…: 401 Authorization Required" Did anyone have this issue? How can I solve this? Thanks a lot, Fred -- Federico De Masi, PhD, Assistant Professor The Technical University of Denmark - DTU Center for Biological Sequence Analysis - CBS Kemitorvet 208/002 DK-2800 KGS. LYNGBY, DENMARK Telephone: (+45) 45 25 24 21 Fax: (+45) 45 93 15 85 http://rg.cbs.dtu.dk

1 0

problems with 'Profile Annotations' tool UI
by Hans-Rudolf Hotz 08 Jul '11

08 Jul '11

Hi we are looking into different methods to display dynamic contents in the tool user interface. To start, we looked at the 'Operate on Genomic Intervals:Profile Annotations' tool. We turned it on in a local installation (May 20, "8c11dd28a3cf" release), but we struggled to get the interface to work. On 'http://main.g2.bx.psu.edu/', the tables to choose from are only displayed if there is a history item with: "format: bed, database: hg18". But in our local test installation, we don't get the list of tables, no matter whether we have a ('hg18') bed file in our history or not. It looks like as if the 'from_file="annotation_profiler_options.xml"' statement in the "annotation_profiler.xml" is ignored. I know, the file 'annotation_profiler_options.xml' is read, since I get an error during restart, if I provide invalid xml. Is there anything else, I have to enable, in order to get this interface to work? Currently, I don't care about the tools functionality, I just want the (cool) interface to work. Thank you very much for your help. Regards, Hans PS: this question is connected to Tim's question yesterday - I just should have sent mine first - sorry.

2 2

New <version_string> tag in tool XML
by Peter Cock 08 Jul '11

08 Jul '11

Hi all, This new feature looks very exciting for tracking reproducibility - now in theory both the tool wrapper version (explicit in the XML) and any underlying tool version will both be recorded: https://bitbucket.org/galaxy/galaxy-central/changeset/84b20f29dfdf I have updated the NCBI BLAST+ wrappers to use the new feature, please merge/transplant this branch/commit: https://bitbucket.org/peterjc/galaxy-central/src/blast_2011_07_07 https://bitbucket.org/peterjc/galaxy-central/changeset/11f425f4e137 I hope the new tool version string will get its own field in the database soon (and be viewable via the web interface). Note that string may well be multi-line, e.g. $ blastp -version blastp: 2.2.25+ Package: blast 2.2.25, build Apr 6 2011 13:59:28 Unless that is you go for more fragile solutions like these to ensure a single line: $ samtools 2>&1 | grep -i "^Version" Version: 0.1.16 (r963:234) $ bwa 2>&1 | grep -i "^Version" Version: 0.5.9-r16 Thanks, Peter P.S. I would say the name <version_string> is a bit confusing, I'd have picked <version_cmd> or <version_command> instead.

2 1

Re: [galaxy-dev] [galaxy-user] Fwd: deleting datasets from history
by Hans-Rudolf Hotz 08 Jul '11

08 Jul '11

Hi Sergei This is a question better asked on 'galaxy-dev(a)bx.psu.edu' since you refer to your local Galaxy installation. In order to remove the data from your file system, you need to run the 'cleanup scripts', as described on this wiki page: https://bitbucket.org/galaxy/galaxy-central/wiki/Config/PurgeHistoriesAndDa… Regards, Hans On 07/06/2011 03:33 PM, Sergei Ryazansky wrote: > > > -------- Исходное сообщение -------- > Тема: deleting datasets from history > Дата: Tue, 5 Jul 2011 19:58:45 +0300 > От: Sergei Ryazansky <s.ryazansky(a)gmail.com> > Кому: galaxy-user-request(a)lists.bx.psu.edu > > > > Hello all, > > > After the deleating datasets from the history panel in our Galaxy mirror > the indicator at the top right corner shows the same amount of used > space as before deleting. Also, the files corresponded to the datasets > remains in the Galaxy database/files/000 directory. It seems, that > deleting of datasets from history is only delete the launch to file but > not the file itself. How to configure the Galaxy mirror to delete not > only records in history panel but also the corresponed files? > Thank you in advance! > > > > ___________________________________________________________ > The Galaxy User list should be used for the discussion of > Galaxy analysis and other features on the public server > at usegalaxy.org. Please keep all replies on the list by > using "reply all" in your mail client. For discussion of > local Galaxy instances and the Galaxy source code, please > use the Galaxy Development list: > > http://lists.bx.psu.edu/listinfo/galaxy-dev > > To manage your subscriptions to this and other Galaxy lists, > please use the interface at: > > http://lists.bx.psu.edu/

4 6

error showing errors
by Assaf Gordon 08 Jul '11

08 Jul '11

Hi, I've encountered a strange error when trying to view a failed job/dataset. I'm using the latest stable revision ( june 23rd, 720455407d1c ). A user executed a job and it failed (bad parameters, so no problem here). The program (bowtie) failed, returned information in STDERR. The "peek" field in the "history_dataset_association" table contains the STDERR message from bowtie (can be seen in the red rectangle in the history pane). So far, so good. But: 1. when the user clicked on the green "bug" icon, the following python exception occured: ========== URL: http://genomics.cshl.edu/galaxy/dataset/errors File '/localdata1/galaxy/galaxy_prod/eggs/WebError-0.8a-py2.6.egg/weberror/evalexception/middleware.py', line 364 in respond app_iter = self.application(environ, detect_start_response) File '/localdata1/galaxy/galaxy_prod/eggs/Paste-1.6-py2.6.egg/paste/debug/prints.py', line 98 in __call__ environ, self.app) File '/localdata1/galaxy/galaxy_prod/eggs/Paste-1.6-py2.6.egg/paste/wsgilib.py', line 539 in intercept_output app_iter = application(environ, replacement_start_response) File '/localdata1/galaxy/galaxy_prod/eggs/Paste-1.6-py2.6.egg/paste/recursive.py', line 80 in __call__ return self.application(environ, start_response) File '/localdata1/galaxy/galaxy_prod/lib/galaxy/web/framework/middleware/remoteuser.py', line 112 in __call__ return self.app( environ, start_response ) File '/localdata1/galaxy/galaxy_prod/eggs/Paste-1.6-py2.6.egg/paste/httpexceptions.py', line 632 in __call__ return self.application(environ, start_response) File '/localdata1/galaxy/galaxy_prod/lib/galaxy/web/framework/base.py', line 145 in __call__ body = method( trans, **kwargs ) TypeError: errors() takes exactly 3 arguments (2 given) ========== I guess this is because the "ID=XXXX" CGI parameter is missing from the URL. It happened couple of times (using Chrome), then never happened again. 2. The user shares the history with me (for me to debug it). Cloning the history isn't useful (because the job information like STDERR and STDOUT is lost). When viewing the shared history (without cloning), the "bug" icon has the following URL: http://genomics.cshl.edu/galaxy/dataset/errors?id=2218&use_panels=True and gives the following exception: === URL: http://genomics.cshl.edu/galaxy/dataset/errors?id=2218&use_panels=True File '/localdata1/galaxy/galaxy_prod/eggs/WebError-0.8a-py2.6.egg/weberror/evalexception/middleware.py', line 364 in respond app_iter = self.application(environ, detect_start_response) File '/localdata1/galaxy/galaxy_prod/eggs/Paste-1.6-py2.6.egg/paste/debug/prints.py', line 98 in __call__ environ, self.app) File '/localdata1/galaxy/galaxy_prod/eggs/Paste-1.6-py2.6.egg/paste/wsgilib.py', line 539 in intercept_output app_iter = application(environ, replacement_start_response) File '/localdata1/galaxy/galaxy_prod/eggs/Paste-1.6-py2.6.egg/paste/recursive.py', line 80 in __call__ return self.application(environ, start_response) File '/localdata1/galaxy/galaxy_prod/lib/galaxy/web/framework/middleware/remoteuser.py', line 112 in __call__ return self.app( environ, start_response ) File '/localdata1/galaxy/galaxy_prod/eggs/Paste-1.6-py2.6.egg/paste/httpexceptions.py', line 632 in __call__ return self.application(environ, start_response) File '/localdata1/galaxy/galaxy_prod/lib/galaxy/web/framework/base.py', line 145 in __call__ body = method( trans, **kwargs ) TypeError: errors() got an unexpected keyword argument 'use_panels' === regards, -gordon

1 0

Error when viewing data in GeneTrack
by Lewis, Brian Andrew 08 Jul '11

08 Jul '11

I'm seeing the following error in the log when clicking on the "View in GeneTrack" link for a specific dataset: Error - <type 'exceptions.Exception'>: A data display parameter is in the error state: genetrack_file URL: http://localhost:8081/galaxy/display_application/cbbbf59e8f08c98c/genetrack… File '/usr/local/galaxy-dist/eggs/Paste-1.6-py2.6.egg/paste/exceptions/errormiddleware.py', line 143 in __call__ app_iter = self.application(environ, start_response) File '/usr/local/galaxy-dist/eggs/Paste-1.6-py2.6.egg/paste/recursive.py', line 80 in __call__ return self.application(environ, start_response) File '/usr/local/galaxy-dist/eggs/Paste-1.6-py2.6.egg/paste/httpexceptions.py', line 632 in __call__ return self.application(environ, start_response) File '/usr/local/galaxy-dist/lib/galaxy/web/framework/base.py', line 145 in __call__ body = method( trans, **kwargs ) File '/usr/local/galaxy-dist/lib/galaxy/web/controllers/dataset.py', line 607 in display_application display_link = display_app.get_link( link_name, data, dataset_hash, user_hash, trans ) File '/usr/local/galaxy-dist/lib/galaxy/datatypes/display_applications/application.py', line 176 in get_link return PopulatedDisplayApplicationLink( self.links[ link_name ], data, dataset_hash, user_hash, trans ) File '/usr/local/galaxy-dist/lib/galaxy/datatypes/display_applications/application.py', line 116 in __init__ self.ready, self.parameters = self.link.build_parameter_dict( self.data, self.dataset_hash, self.user_hash, trans ) File '/usr/local/galaxy-dist/lib/galaxy/datatypes/display_applications/application.py', line 57 in build_parameter_dict if param.ready( other_values ): File '/usr/local/galaxy-dist/lib/galaxy/datatypes/display_applications/parameters.py', line 120 in ready raise Exception( 'A data display parameter is in the error state: %s' % ( self.name ) ) Exception: A data display parameter is in the error state: genetrack_file This is happening on a local instance of Galaxy, which has been updated to the most recent revision. Before updating The specific data came from the UCSC table browser. ~ Brian

2 1

Re: [galaxy-dev] New galaxy tool shed
by Greg Von Kuster 07 Jul '11

07 Jul '11

Hello Marcel, http://usegalaxy.org/community On Jul 7, 2011, at 8:14 AM, Marcel Schumann wrote: > Hi Greg, hi Dave, > > just a short&trivial question today: ;-) > > I would like to put a link to the galaxy tool shed on my ISMB poster ... wouldn't it perhaps make sense to setup a (forwarding) address that people can remember more easily than the current one (http://toolshed.g2.bx.psu.edu/)? > How about toolshed.getgalaxy.org, for example? If you could setup something like this and send me the address, I would put that one on my poster ... > > > Cheers & thanks, > Marcel > > > On 06/30/2011 08:58 PM, Marcel Schumann wrote: >> Ah, just by the way, I just got an idea for another metadata field: some >> more detailed author and contact infos. That is, some fields where the >> user (if he/she wants to) can enter his/her full name/affiliation and a >> contact email-address ... the latter perhaps protected in some way to >> ward off spam (http://www.google.com/recaptcha/mailhide/, or something >> similar). >> >> Just an idea ... and just in case you weren't planning this feature yet ;-) >> >> >> cu, >> Marcel >> >> On 06/30/2011 08:21 PM, Marcel Schumann wrote: >>> Hi Greg, >>> >>> great! Thanks! >>> The description looks much better this way and the new metadata features >>> will certainly be very helpful as well ... >>> >>> >>> Cheers, >>> Marcel >>> >>> >>> On 06/30/2011 07:55 PM, Greg Von Kuster wrote: >>>> >>>> This issue has been fixed - thanks for pointing it out. >>>> >>>> >>>> Yes, attributes like tool_id, version, etc, fall into the category of >>>> repository metadata, a new feature which I am currently implementing. >>>> It should be available fairly soon. >>>> >>>> >>>> >>>> Greg Von Kuster >>>> Galaxy Development Team >>>> greg(a)bx.psu.edu >>>> >>>> >>>> >>> >>> >> >> > > > -- > Marcel Schumann > > University of Tuebingen > Wilhelm Schickard Institute for Computer Science > Division for Applied Bioinformatics > Room C304, Sand 14, D-72076 Tuebingen > > phone: +49 (0)7071-29 70437 > fax: +49 (0)7071-29 5152 > email: schumann(a)informatik.uni-tuebingen.de Greg Von Kuster Galaxy Development Team greg(a)bx.psu.edu

1 0

Re: [galaxy-dev] How to set java heap size in Galaxy?
by liu bo 07 Jul '11

07 Jul '11

Hi Roman, Thanks for your explanation. I'm sorry for this late reply. I think the problem is on my app. I'll further check that. Thanks, Bo Date: Thu, 30 Jun 2011 14:53:08 +0200 From: Roman Valls <brainstorm(a)nopcode.org> To: galaxy-dev(a)lists.bx.psu.edu Subject: Re: [galaxy-dev] How to set java heap size in Galaxy? Message-ID: <4E0C71B4.2010308(a)nopcode.org> Content-Type: text/plain; charset=ISO-8859-1 Hello Liu, I'm keeping our mail thread in the mailing list, as advised by its guidelines on the footer of each mail. Now, galaxy runs on top of paster, a minimal python webserver, but it has nothing to do with Java, looks like your out of memory error comes from your app then. Have you tried the suggested settings from Marco ? Namely: java -Xmx512m I bet there's an environment variable or config setting for Tomcat too if you're unsure about where your jar's are called. Hope that helps ! Roman On 2011-06-29 12:02, liu bo wrote: > Thank you, Roman. > Our app invoke a workflow server. > I guess Galaxy has a self container like Tomcat, that is why we can > access it via 127.0.0.1 from browser. > I know in Tomcat, there is a file "catalina.sh" for setting JAVA_OPTS. > Is there a similiar file in Galaxy to set JAVA_OPTS? > Thank you very much. > > Regards, > Bo > > On Tue, Jun 28, 2011 at 4:18 AM, Roman Valls <brainstorm(a)nopcode.org> wrote: >> Hi Liu, >> >> Does your app execute Picard/GATK at some point ? In that case those >> would be the ones triggering your Java OOM error, in that case Bo's >> suggestion is the way to go. That's my best guess since Galaxy itself >> doesn't use java either (only python AFAIK). >> >> Regards, >> Roman >> >> On 2011-06-27 18:44, liu bo wrote: >>> Hi Marco, >>> >>> Thanks for your kind reply. >>> My app is a python file, and there's not an explicit command to run java. >>> I just wonder whether there is a file to configure Galaxy, in order to >>> set the Java heap size. >>> Thank you. >>> >>> Best wishes, >>> Bo >>> >>> On Mon, Jun 27, 2011 at 7:51 PM, Marco Moretto <marco.moretto(a)gmail.com> wrote: >>>> Hi Liu, >>>> if you set up your application in the XML to run with Java, like java -jar >>>> yourapplication.jar, it is sufficient to add the -Xmx parameter. Something >>>> like >>>> java -Xmx512m -jar yourapplication.jar >>>> Greets >>>> --- >>>> Marco >>>> >>>> >>>> On 27 June 2011 12:15, liu bo <liubo03(a)gmail.com> wrote: >>>>> >>>>> Dear all, >>>>> >>>>> I have added an application to Galaxy's Tools. >>>>> Now there occurs an error "java.lang.OutOfMemoryError: Java heap space". >>>>> Do you know how to set java heap size in Galaxy? >>>>> Thank you very much. >>>>> >>>>> Best regards, >>>>> Bo >>>>> ___________________________________________________________ >>>>> Please keep all replies on the list by using "reply all" >>>>> in your mail client. To manage your subscriptions to this >>>>> and other Galaxy lists, please use the interface at: >>>>> >>>>> http://lists.bx.psu.edu/ >>>> >>>> >>> >>> ___________________________________________________________ >>> Please keep all replies on the list by using "reply all" >>> in your mail client. To manage your subscriptions to this >>> and other Galaxy lists, please use the interface at: >>> >>> http://lists.bx.psu.edu/ >> ___________________________________________________________ >> Please keep all replies on the list by using "reply all" >> in your mail client. To manage your subscriptions to this >> and other Galaxy lists, please use the interface at: >> >> http://lists.bx.psu.edu/ >>

1 0

From NCBI SRA to UCSC viewer pipeline.
by colin molter 07 Jul '11

07 Jul '11

Hi all, i am trying to use a local instance of my galaxy to pre-format data stored at sra-ncbi. Does anyone has a working pipeline that (s)he could share. Here is the pipeline I am using, with some questions. 1/ download sra files to my server. 2/ transform them in fastq using the sra toolbox. 3/ upload them in galaxy, by using the 'add to data library' 4/ use the fastq groomer to enable to use the fast q in galaxy. Note: i guess that the data at sra are already in the fastq sanger format. So it could be nice to be able to skip that point (it took 10 hours to groom a fastq of 25Gb). 5/ MAP with Bowtie --> fastq to SAM 6/ filter SAM 7/ SAM to BAM problems: * sra data i got are RNAseq. I heard that bowtie is not good because can't deal with the splicing (so bowtie is ok for genome but not for RNAseq) ==> what is the best way to align RNAseq? Tophat? The problem is that i heard that if tophat can deal with gaps, it looses information about deletions. Someone told me that it could be better to use BWA and then to add a further step to deal with the splicing and the gaps. Any information? * to see my data in the IGV, an index (BAI) should be created. Normally, IGV could create it itself, but it didn't work. I heard that data should be ordered. The SAM i got from Bowtie is ordered by name and it should be ordered by chromosom and position. Is it right? In that case i could use the sort tool of galaxy and apply it on the SAM before to transform it in a BAM. Is it right? any other/related hints. Is there not a simple tutorial/screencast about this process that i guess most of the galaxy users have already did? thx colin -- Colin Molter University of Brussels - InSilico Team - http://insilico.ulb.ac.be/

2 2