- galaxy-dev - lists.galaxyproject.org

Workflow post-actions?
by Jesse Erdmann 25 Aug '10

25 Aug '10

With the new(-ish) post task workflow actions, if a particular task has multiple outputs is it correct that you may only apply an action to only one of the datasets. E.G., I can hide one dataset, but not another from a specific task? The interface allows me to specify an action on multiple outputs, but when I select a different task, then select the task with multiple actions it will only keep one of each type. Is this the expected behavior? Thanks! -- Jesse Erdmann Bioinformatics Analyst Masonic Cancer Center University of Minnesota jerdmann(a)umn.edu 612-626-3123 jesse(a)jesseerdmann.com Twitter: http://twitter.com/jesseerdmann

2 1

integrating Galaxy with a relational data warehouse?
by Yury Bukhman 25 Aug '10

25 Aug '10

Dear Galaxy developers, we are planning to build a data warehouse for a research center that utilizes multiple high-throughput experimental platforms, e.g. plate-based HTS assays, microarrays of several different types, ChIP-seq, RNA-seq. We have been thinking of managing the data in a relational database. Galaxy looks attractive to us for its workflow management and data provenance features, e.g. to keep track of how raw data are analyzed to produce normalized & summarized datasets and/or final sets of statistics such as p values. We wonder how amenable would Galaxy be to integration with a relational data store. One possible scenario might be to have Galaxy import a dataset from a relational database, run a workflow, then submit the results back to the database with the associated history or link thereto. Another possibility is to forgo the relational database altogether and do all our data management within Galaxy. Any thoughts? We don't have much experience with Galaxy and would appreciate insights from those who do. Many thanks. Yury -- Yury V. Bukhman, Ph.D. Associate Scientist, Bioinformatics Great Lakes Bioenergy Research Center University of Wisconsin - Madison 445 Henry Mall, Rm. 513 Madison, WI 53706, USA Phone: 608-890-2680 Fax: 608-890-2427 Email: ybukhman(a)glbrc.wisc.edu

1 0

search tools
by Davide Cittaro 25 Aug '10

25 Aug '10

Hi, I've noticed that one tool adde by me to a local galaxy can't be searched in the search tools... are there some tips on how enabling this (default tools can be searched) d /* Davide Cittaro Cogentech - Consortium for Genomic Technologies via adamello, 16 20139 Milano Italy tel.: +39(02)574303007 e-mail: davide.cittaro(a)ifom-ieo-campus.it */

2 1

sort broken
by Isabelle Phan 25 Aug '10

25 Aug '10

Hello, I installed galaxy-dev using hg clone -r 60448575467f http://bitbucket.org/galaxy/galaxy-central galaxy-dist since http://www.bx.psu.edu/hg/galaxy seems down. I started galaxy, uploaded a fasta file, computed sequence lengths, then sorted on c2. The sort fails with the error: Tool execution generated the following error message: sort: multi-character tab `$\t' I created a tab-delimited test file with 2 column, one letter in the first, one digit in the second, then sorted on c1: got the same error. The sorter.py is doing a system call to the unix sort function (I have sort (GNU coreutils) 7.4). I tested my shell by running this on the command line /usr/bin/sort -f -t $'\t' test-file and it worked. I modified sorter.py to use /usr/bin/sort, restarted galaxy... and still get the same error. So there is something wrong in the way the shell escapes the $'\t' in the sorter.py line: os.system(cmd) Any help greatly appreciated. Isabelle

2 2

Stalled data set imports, where should I be looking?
by Ry4an Brase 25 Aug '10

25 Aug '10

I've created a new data library and have added two datasets using the admin interface to provide file paths to two large-ish files. In the admin interface they're still showing up as "Information: This job is queued" but no jobs show up in the admin job list, system load is zero, and I see no mention of the files in the log past the initial web-requests that kicked off the process. I do have "track_jobs_in_database = True" and "enable_job_recovery = True", and I have previously killed off some data-set-addition jobs that seemed stalled and _were_ using CPU. Where should I be looking for blocked data set import jobs? Do load jobs make it into the database too? Is there I table I can clear out to remove the import jobs that I interrupted by deleting their library previously? Is there anything I should be looking for in the logs Is there a handle I can jiggle? I'm running rev 2c7acb546d6d. Thanks! -- Ry4an Brase 612-626-6575 University of Minnesota Supercomputing Institute for Advanced Computational Research http://www.msi.umn.edu

2 8

Galaxy: problem with job status update
by Tanguy Le Carrour 25 Aug '10

25 Aug '10

Hello, I have installed an instance of Galaxy on our server. I configured it to run the jobs on our cluster (SGE). Everything works just fine. I can run NGS jobs that run on our cluster nodes and return results to Galaxy. But, sometimes, I have a problem with the job status that is not updated! It can be flagged as "waiting" and never run, or, even worst, stay flagged as "running". When I check the logs I can see that the job has finished normally [1]. As the step is not flagged as "done" I cannot go further with my workflow. Any help would be welcomed! Thanks for your great work with Galaxy! Best regards, Tanguy LE CARROUR [1] Galaxy logs sample: galaxy.jobs DEBUG 2010-08-25 11:59:45,727 dispatching job 8 to sge runner galaxy.jobs.runners.sge DEBUG 2010-08-25 11:59:47,935 (8) submitting file /srv/GT/www/htdocs/Galaxy/new_galaxy/database/pbs/galaxy_8.sh galaxy.jobs.runners.sge DEBUG 2010-08-25 11:59:47,936 (8) command is: python /srv/GT/www/htdocs/Galaxy/new_galaxy/tools/samtools/sam_to_bam.py --input1=/srv/GT/www/htdocs/Galaxy/new_galaxy/database/files/000/dataset_9.dat --dbkey=hg19 --ref_file="None" --output1=/srv/GT/www/htdocs/Galaxy/new_galaxy/database/files/000/dataset_10.dat --index_dir=/srv/GT/www/htdocs/Galaxy/new_galaxy/tool-data galaxy.jobs.runners.sge DEBUG 2010-08-25 11:59:47,941 (8) queued in ims.q queue as 202466 galaxy.jobs.runners.sge DEBUG 2010-08-25 11:59:48,590 (8/202466) state change: job is queued and waiting to be scheduled galaxy.jobs.runners.sge DEBUG 2010-08-25 11:59:54,594 (8/202466) state change: job is running galaxy.jobs.runners.sge DEBUG 2010-08-25 12:02:58,979 (8/202466) state change: process status cannot be determined galaxy.jobs.runners.sge DEBUG 2010-08-25 12:02:59,979 (8/202466) state change: job finished normally -- Tanguy LE CARROUR Functional Genomics Center Zurich ETH Zurich / University of Zurich Winterthurerstrasse 190 8057 Zurich Switzerland

2 1

New version for snpEff tool
by Pablo Cingolani 25 Aug '10

25 Aug '10

Hi everyone! I've uploaded a new version of snpEff (SNP effect prediction tool) to the community site. It's still waiting for approval. Yours Pablo

2 1

bulk datatype change
by Davide Cittaro 25 Aug '10

25 Aug '10

Hi all, bigwig and bigbed were recently added to galaxy, but it happens I had implemented those some time ago in my local instance. Fortunately your class definition is not much different from the one I've written (not even the class name). BTW, most of my bigWigs have .bw extension, whereas your implementation assumes they have .bigwig extension; .bw files are not recognized as bigWig by default (they are now "Roadmap" type) and I would like to set the proper type for all of them. Obviously, setting this one by one in the data admin window is a tedious long job... is there a way to do it automatically? It would be nice if one can select multiple datasets in admin and edit some properties (i.e. data type, database...), in addition to "edit permissions" and "delete" operations. d /* Davide Cittaro Cogentech - Consortium for Genomic Technologies via adamello, 16 20139 Milano Italy tel.: +39(02)574303007 e-mail: davide.cittaro(a)ifom-ieo-campus.it */

1 0

custom UCSC browser
by Davide Cittaro 25 Aug '10

25 Aug '10

Hi again, I'm afraid I've lost some configuration to get my own UCSC browser listed in the "display at" for BAM, bed, bigwig files... Can anybody post a check-list to configure this :-) ? I believe I have all pieces in their place but evidently something is wrong: this def is into ini files ucsc_display_sites = main,campus and this is in tool-data/shared/ucsc/ucsc_build_sites.txt campus http://genome.ifom-ieo-campus.it/cgi-bin/hgTracks? hg19,hg18,hg17,mm9,mm8,rn4,danRer6,danRer5,ci2,ce6,ce4,cb3,dm3,sacCer2,sacCer1 thanks! d /* Davide Cittaro Cogentech - Consortium for Genomic Technologies via adamello, 16 20139 Milano Italy tel.: +39(02)574303007 e-mail: davide.cittaro(a)ifom-ieo-campus.it */

1 1

galaxy-dist down?
by Leandro Hermida 24 Aug '10

24 Aug '10

Hi there, For some reason http://bitbucket.org/galaxy/galaxy-dist/ is down, i am getting a 503 Service Temporarily Unavailable, is there a planned maintenance? best, Leandro

3 9