- galaxy-dev - lists.galaxyproject.org

Re: [galaxy-dev] custom builds as tool in toolbox panel?
by Michal Stuglik 02 Aug '11

02 Aug '11

Dannon, "Extract Genomic DNA" tool demands that intervals had set genome build. In my case interval dataset is not persistent, I generate this in "meantime", so after generating this I set genome build to dataset by hand. It's not a problem if you do this in "history pane mode" but in workflow mode it is, basically because it is not possible to set custom genome build as a parameter (external?) for intervals ( can I ?). all the best, michal ps. Sorry for late answer, It's Summer time :) W dniu 13.07.2011 05:32, Dannon Baker pisze: > Could you elaborate on how you'd see this working, and perhaps give a use case? I'm not sure I follow what you mean. > > Thanks! > > -Dannon > > On Jul 7, 2011, at 3:57 AM, Michal Stuglik wrote: > >> hi, >> >> >> Would it be possible to build in a "Custom builds" form user menu to toolbox panel as a tool? >> Now it is not possible to use this feature in workflow ( as a part of pipeline)... >> >> >> all the best, >> michal >> >> ___________________________________________________________ >> Please keep all replies on the list by using "reply all" >> in your mail client. To manage your subscriptions to this >> and other Galaxy lists, please use the interface at: >> >> http://lists.bx.psu.edu/

1 0

approximate line numbers shown in history items can be very imprecise
by Chaolin Zhang 02 Aug '11

02 Aug '11

Hi, I noticed that the current version of galaxy shows approximate number of lines for history items, when it is relatively big. I guess this is due to a consideration of performance, but it is quite annoying, because the exact line numbers provide a very easy way for users to get simple statistics. Sometimes the approximation can be really off. For instance, for one file with > 1 M lines, it shows ~850,000 lines. Any thought? Chaolin

3 5

[API] Apache error?
by Louise-Amélie Schmitt 02 Aug '11

02 Aug '11

Hello everyone, I'm working on a script that uploads files and launchs workflows on them, but I keep getting errors that appear more or less randomly when the display() and submit() functions are called. In a nutshell, there is a 1/3 chance the calls fail this way. Nevertheless, the actions are properly triggered in Galaxy, surprisingly. Here is an example: When I launch a workflow, I get the following traceback even though the workflow is properly executed: http://localhost/galaxy-dev/api/workflows?key=273c7b4e3aaffd3884ef715aaf780… File "automated_preprocessing.py", line 61, in expandFile result = submit( api_key, api_url + 'workflows', wf_data, return_formatted=False) File "common.py", line 100, in submit r = post( api_key, url, data ) File "common.py", line 44, in post return simplejson.loads( urllib2.urlopen( req ).read() ) File "/g/steinmetz/collaboration/software/CentOS5/opt/Python-2.6.5/lib/python2.6/socket.py", line 329, in read data = self._sock.recv(rbufsize) File "/g/steinmetz/collaboration/software/CentOS5/opt/Python-2.6.5/lib/python2.6/httplib.py", line 518, in read return self._read_chunked(amt) File "/g/steinmetz/collaboration/software/CentOS5/opt/Python-2.6.5/lib/python2.6/httplib.py", line 561, in _read_chunked raise IncompleteRead(''.join(value)) Failed to expand file A: Type: <class 'httplib.IncompleteRead'> IncompleteRead(118 bytes read) Therefore, I cannot get the results within the script. Any idea? Best, L-A

1 1

minor bug: double-quotes in dataset name
by Assaf Gordon 01 Aug '11

01 Aug '11

Hello, There's a small bug when entering a double-quote character in a dataset name: The double-quote confuses some later-on processing (templates and Display-Application XML), resulting in some problems. Example: This history has one BAM dataset with a name of: Hello "world" http://main.g2.bx.psu.edu/u/foobar/h/double-quotes-bug If you try to rename it (by clicking the "pencil" icon), you'll see only the "hello" part. If you try to load the BAM to the UCSC Genome browser, it will fail with this error message: Missing bigDataUrl setting from track of type=bam (Hello ) -gordon

2 1

visual cue for <conditional> group parameters
by Assaf Gordon 01 Aug '11

01 Aug '11

Hi, The following tiny patch adds a light-gray visual cue in the html form, to give a better idea as to which parameters go together. It looks acceptable even with nested <conditional> parameters. See it in action here: http://cancan.cshl.edu/publicgalaxy/root?tool_id=cshl_bowtie_pe1 http://cancan.cshl.edu/publicgalaxy/root?tool_id=cshl_tophat_pe1 It might not be the prettiest thing, but it works nicely with minimal code changes. Patch is here: http://cancan.cshl.edu/labmembers/gordon/files/conditional-group-css2.patch Comments are welcomed, -gordon

2 1

wrong static image URL when clicking re-run
by Assaf Gordon 01 Aug '11

01 Aug '11

Hi, A small bug: When clicking "re-run" to view a tool form, and the tool has embedded images, the URL of the images is not working. When viewing a tool that has embedded images, the relative <img> URL is "./static/images/histogram2.png". The tool's URL comes from: "http://main.g2.bx.psu.edu/tool_runner?tool_id=histogram_rpy" and so the absolute image URL becomes: "http://main.g2.bx.psu.edu/./static/images/histogram2.png" which works OK. But when viewing a tool by clicking "re-run", the tool's URL is: "http://main.g2.bx.psu.edu/galaxy/tool_runner/rerun?id=56" ("rerun" being a method in the "tool_runner" controller), which in turns makes the image absolute URL: "http://main.g2.bx.psu.edu/tool_runner/./static/images/XXXXX.png" - and it doesn't work. Note that the solution of changing all the images URLs in the XML files to start at the root (e.g. "/static/images/XXXX.png") is not optimal, because it will bypass the "prefix" URL that some people use (e.g. with "http://rave.cshl.edu/galaxy" instead of "http://rave.cshl.edu/"). a workaround (when using apache) is to add the following rewrite_rule: RewriteRule ^/tool_runner/static/(.*) /localdata1/galaxy/galaxy_prod/static/$1 [L] Or if using a "/galaxy" prefix: RewriteRule ^/galaxy/tool_runner/static/(.*) /localdata1/galaxy/galaxy_prod/static/$1 [L] -gordon

2 1

samtools question
by Luciano Cosme 01 Aug '11

01 Aug '11

Hi Everyone, I am running galaxy locally (ubuntu 11.04) and I am having problem with samtools. When I am running TopHat I get an error message saying that could not locate samtools. Of course I did everything described in http://wiki.g2.bx.psu.edu/Admin/NGS%20Local%20Setup Here is the error message: Error in tophat: [Mon Aug 1 13:03:53 2011] Beginning TopHat run (v1.3.1) ----------------------------------------------- [Mon Aug 1 13:03:53 2011] Preparing output location ./tophat_out/ [Mon Aug 1 13:03:53 2011] Checking for Bowtie index files [Mon Aug 1 13:03:53 2011] Checking for reference FASTA file Warning: Could not find FASTA file /tmp/tmpkcZN3L/dataset_26.dat.fa [Mon Aug 1 13:03:53 2011] Reconstituting reference FASTA file from Bowtie index Executing: /bin/bowtie-inspect /tmp/tmpkcZN3L/dataset_26.dat > ./tophat_out/tmp/dataset_26.dat.fa [Mon Aug 1 13:04:41 2011] Checking for Bowtie Bowtie version: 0.12.7.0 [Mon Aug 1 13:04:42 2011] Checking for Samtools Error locating program: samtools When I run "make" in the samtools directory I also get an error message: koala2@aedes:~/Desktop/galaxy/samtools$ make make[1]: Entering directory `/home/koala2/Desktop/galaxy/samtools' make[2]: Entering directory `/home/koala2/Desktop/galaxy/samtools' gcc -c -g -Wall -O2 -D_FILE_OFFSET_BITS=64 -D_USE_KNETFILE -D_CURSES_LIB=1 -I. bgzf.c -o bgzf.o In file included from bgzf.c:36:0: bgzf.h:30:18: fatal error: zlib.h: No such file or directory compilation terminated. make[2]: *** [bgzf.o] Error 1 make[2]: Leaving directory `/home/koala2/Desktop/galaxy/samtools' make[1]: *** [lib-recur] Error 1 make[1]: Leaving directory `/home/koala2/Desktop/galaxy/samtools' make: *** [all-recur] Error 1 I also followed the installation guide from samtools, but did not work either. Unfortunately I found myself spending more time installing tools than using it. Yes I am a newbie. Thank you. Luciano

3 2

3 ideas to improve the user experience for GALAXY
by 孙翰菲 01 Aug '11

01 Aug '11

Hi, I'm a user of Galaxy, I think Galaxy is a good idea except some small parts. 1. Progress Bar for uploading file I know that implement a progress bar for every tool is quite hard. But maybe it's not so hard for displaying the current percent of uploading, it's really helpful and comfortable for users (a countdown timer will be better). 2. Drag and Drop I've used gmail on my firefox, and I really like the function of "Drag & Drop" when I upload attachments. With this function, I can drag multiple small files (for example,'bed' files) in the special region of the page, which is easy to use. 3.Start automatically when uploading finished Some large files, need quite a long time before the uploading finished. We need to wait until the uploading is done because we cannot assign a task to an unfinished uploading file. Maybe we can pre-assign tasks for them, and we can go to other works when we finish doing this, because the operation will automatically apply to them when they have been uploading completely. I can imagine a story like this: I am quite tired after a whole day's busy work, but some sequencing data still need to be analyzed because I will show it to my boss tommorow. Then I think of GALAXY can do it well. I open the GALAXY, drag in several sequencing data, and assign a workflow to deal with the data in 2 minutes. Then I can go to sleep safely because GALAXY will run the workflow automatically when uploading is finished. When I get to GALAXY the next day, all the preliminary results are show on the page of GALAXY. I think it's really cool because it will reduce a lot of repetitive works for the user, and in my opinion, that is the REAL biology analysis platform. Best Wishes, Hanfei Sun

2 1

GALAXY-GBROWSE : setting up incoming/outcomming functionalities (sharing data)
by BM 01 Aug '11

01 Aug '11

Hi, I am trying to set up the galaxy outgoing and incoming funtionalities in GBROWSE and GALAXY to send data between these applications. I have local instances of GALAXY and GBROWSE and I wonder how should I configure these. How this should look in the GBROWSE user interface (in the "share this track" section) ? How this should look in the GALAXY user interface ? My GBROWSE version : 2.38 and my GALAXY version : galaxy-galaxy-central-fd3391bcd903 Here the conf I set up : ------MY GALAXY SETTINGS------ I saw in a previous topic posted by nicki (http://gmod.827538.n3.nabble.com/Send-data-to-GBrowse-td2446346.html) that some files must be edtited : 1. universe_wsgi.ini I edited it as follows : GBrowse servers: tool-data/shared/gbrowse/gbrowse_build_sites.txt gbrowse_display_sites = wormbase,tair,modencode_worm,modencode_fly,yeast_sgd,perso 2. tool-data/shared/gbrowse/gbrowse_build_sites.txt I edited it as follows : #perso perso http://my_host.com/Gbrowse/cgi-bin/gbrowse_details/specie specie 3. datatypes_conf.xml I edited it as follows :  <display file="gbrowse/gbrowse_gff.xml" inherit="True" />  <display file="gbrowse/gbrowse_wig.xml" /> I have got the following files in "display_applications/gbrowse/" : gbrowse_gff.xml gbrowse_interval_as_bed.xml gbrowse_wig.xml ------MY GBROWSE SETTINGS------ I have edited the general section of "/var/www/GBROWSE/conf/specie.conf" according to the documentation http://gmod.org/wiki/GBrowse_Configuration_HOWTO#Track_Sharing_Options: [GENERAL] galaxy outgoing = http:/my_host.com:8080/tool_runner?tool_id=ncbi_blastn_wrapper galaxy incoming = https://my_host.com/Gbrowse/cgi-bin/gbgff ------------- First, I would like to look for the outgoing functionality from GBROWSE to GALAXY. Then, the incoming functionnality : from GALAXY to GBROWSE I hope someone can help me, I'm new to GALAXY. Thanks, greetings Ben

4 3

job status when SGE kills/aborts job
by Shantanu Pavgi 30 Jul '11

30 Jul '11

We are using SGE cluster with our galaxy install. We have specified resource and run-time limits for certain tools using tool specific drmaa URL configuration, e.g.: - run-time (h_rt, s_rt) - memory (vf, h_vmem). This helps scheduler in submitting jobs to an appropriate node and also prevent node from crashing because of excessive memory consumption. However, sometimes a job needs more resources and/or run-time than specified in the drmaa URL configuration. In such cases SGE kills particular job and we get email notification with appropriate job summary. However, the galaxy web interface doesn't show any error for such failures. The job table doesn't contain any related state/info as well. The jobs are shown in green-boxes meaning they completed without any failure. In reality these jobs have been killed/aborted by the scheduler. This is really confusing as there is inconsistency between job status indicated by the galaxy and SGE/drmaa. Has anyone else experienced and/or addressed this issue? Any comments or suggestions will be really helpful. Thanks, Shantanu.

5 6