- galaxy-dev - lists.galaxyproject.org

April GalaxyAdmins Meetup: April 16
by Dave Clements 16 Apr '15

16 Apr '15

Hello all, The April 2015 GalaxyAdmins meetup <https://wiki.galaxyproject.org/Community/GalaxyAdmins/Meetups/2015_04_16> will be held online on Thursday, 16 April (a week from today). We'll meet at 5pm Central European Summer Time (see your local time <http://bit.ly/1EFUf0M>). Carrie Ganote <http://www.researchgate.net/profile/Carrie_Ganote> from the National Center for Genome Analysis Support (NCGAS) <http://ncgas.org/> and Pervasive Technology Institute <http://pti.iu.edu/> at Indiana University will talk about her Galaxy work with Trinity, IU Galaxy, and the Open Science Grid. And Sam Guerler <https://wiki.galaxyproject.org/guerler> of the Galaxy Team will also discuss recent work to update Galaxy's tool forms. GalaxyAdmins <https://wiki.galaxyproject.org/Community/GalaxyAdmins> is a discussion group for Galaxy community members who are responsible for Galaxy installations. Please see the meetup page ( http://bit.ly/gxyadm201504) for more details. Hope to see (hear?) you there, Dave C (channeling Hans-Rudolf Hotz) -- http://galaxyproject.org/ http://getgalaxy.org/ http://usegalaxy.org/ https://wiki.galaxyproject.org/

1 2

Geting integer value from InputValueWrapper in plugin xml file
by Christian Brenninkmeijer 16 Apr '15

16 Apr '15

Hi, I am a new galaxy developer playing with writing my first plugins In my plugin xml configaration file: I want to be able to increase the value of one parameter based on another using <command interpreter="python"> #if $rows.option =="header_ignore" #set $data_start = $rows.ignore + 1 but I get: unsupported operand type(s) for +: 'InputValueWrapper' and 'int' A hack workaround I found was: #set $data_start = int(str($rows.ignore)) + 1 I just wondered if there was a cleaner way to get the integer value from a InputValueWrapper object. Which is set to integer by: <param name="ignore" size="4" type="integer" value="1" .... If documentation exist somwere please send me an RTFM link. (I didn't find it in https://wiki.galaxyproject.org/Admin/Tools/ToolConfigSyntax) Thanks in advance Christian Brenninkmeijer University of Manchester Ps. If you want to see exactly what I am playing with see https://github.com/Christian-B/galaxy_tools/tree/master/summary (Note that is subject to change as I learn)

3 2

pushing toolshed directories to our own repo
by Nikhil Joshi 16 Apr '15

16 Apr '15

Hi all, So I am trying to push our toolshed directories to our own repo and I am running into problems. Basically, since the toolshed tools are subrepos, I can't figure out how to push those changes into *our* repo. Also, I have had to change some of the toolshed tools because they don't work properly with our galaxy. So, when I try to do the push, it aborts giving me this error: abort: push creates new remote head b9bd905700fe! (in subrepo toolshed.g2.bx.psu.edu/repos/devteam/tophat2/da1f39fe14bc/tophat2) And, of course, I can't push to that repo, nor do I want to. All I want to do is to push our shed tools directory to our repo, but at the same time keep the mercurial information so that when we clone our repo into a new galaxy install, the toolshed will still work from galaxy. How can I do this? Am I even thinking about this the right way? - Nik. -- Nikhil Joshi Bioinformatics Analyst/Programmer UC Davis Bioinformatics Core http://bioinformatics.ucdavis.edu/ najoshi -at- ucdavis -dot- edu 530.752.2698 (w)

2 1

question about error output
by Roberto Alonso CIPF 16 Apr '15

16 Apr '15

Hello, I am defining some tools for my own galaxy installation and I would like to know if there is a more elegant solution for redirecting error output than the one in the next config file: <tool id="gatk_mio" name="calling with gatk"> <description>calling with gatk</description> <command> ln -s "${input}" input.bam ; samtools index input.bam; java -jar /home/ralonso/software/GenomeAnalysisTK-3.3-0/GenomeAnalysisTK.jar -T UnifiedGenotyper -R /home/ralonso/BiB/Galaxy/data/Cclementina_v1.0_scaffolds.fa -I input.bam -o $output *2>/dev/null;* </command> <inputs> <param format="bam" name="input" type="data" label="bam"/> </inputs> <outputs> <data format="vcf" name="output" /> </outputs> <help> bwa </help> </tool> Best regards many thanks -- Roberto Alonso Functional Genomics Unit Bioinformatics and Genomics Department Prince Felipe Research Center (CIPF) C./Eduardo Primo Yúfera (Científic), nº 3 (junto Oceanografico) 46012 Valencia, Spain Tel: +34 963289680 Ext. 1021 Fax: +34 963289574 E-Mail: ralonso(a)cipf.es

2 1

$REMOTE_USER
by Wang, Yu 15 Apr '15

15 Apr '15

Hi, Is there a way to query the actual name of the user, who is logged into galaxy and submitted the workflow ($REMOTE_USER), from inside a galaxy tool when galaxy is configured for external authentication using an apache server? It seems like galaxy passes this variable to scripts like 'drmaa_external_runner.py' but I could not find it in the environment of a tool which has been started via e.g. python ( using <command interpreter="python"> in the xml-file of the tool)." Cheers, Yu di29her wang(a)lrz.de<mailto:wang@lrz.de> On 13 Apr 2015, at 18:00, galaxy-dev-request(a)lists.galaxyproject.org<mailto:galaxy-dev-request@lists.galaxyproject.org> wrote: Send galaxy-dev mailing list submissions to galaxy-dev(a)lists.galaxyproject.org<mailto:galaxy-dev@lists.galaxyproject.org> To subscribe or unsubscribe via the World Wide Web, visit https://lists.galaxyproject.org/listinfo/galaxy-dev or, via email, send a message with subject or body 'help' to galaxy-dev-request(a)lists.galaxyproject.org You can reach the person managing the list at galaxy-dev-owner(a)lists.galaxyproject.org When replying, please edit your Subject line so it is more specific than "Re: Contents of galaxy-dev digest..." HEY! This is important! If you reply to a thread in a digest, please 1. Change the subject of your response from "Galaxy-dev Digest Vol ..." to the original subject for the thread. 2. Strip out everything else in the digest that is not part of the thread you are responding to. Why? 1. This will keep the subject meaningful. People will have some idea from the subject line if they should read it or not. 2. Not doing this greatly increases the number of emails that match search queries, but that aren't actually informative. Today's Topics: 1. Re: Strange repository dependency behavior with toolshed-installed naive_variant_caller (Martin Čech) ---------------------------------------------------------------------- Message: 1 Date: Mon, 13 Apr 2015 14:27:10 +0000 From: Martin Čech <marten(a)bx.psu.edu> To: Brian Claywell <bclaywel(a)fredhutch.org> Cc: galaxy-dev(a)lists.galaxyproject.org Subject: Re: [galaxy-dev] Strange repository dependency behavior with toolshed-installed naive_variant_caller Message-ID: <CAHKBquFw66cXyss7KjExM4-mpdK0P_TLT_xtCOBEK4pLs3OYOg(a)mail.gmail.com> Content-Type: text/plain; charset="utf-8" Hello Brian, we have made some changes in the past month that might address the issue you are having. Are you still encountering problems? If so could you please try re-installing the tools again? thank you Martin On Tue, Feb 24, 2015 at 5:15 PM Brian Claywell <bclaywel(a)fredhutch.org> wrote: Hi Martin, Thanks for the prompt reply! My responses are inline below. On Tue, Feb 24, 2015 at 8:26 AM, Martin Čech <marten(a)bx.psu.edu> wrote: Are you using Admin UI for installation or API scripts? The admin UI exclusively. Does the 'installed tool shed repos' page show multiple installations of the same package (with the same changesets)? If so what are the states of these? Yes -- the iuc package_numpy_1_7 revision a4bdc17eed4a is listed twice, with both showing the green "Installed" status. Interestingly the installed repo page shows that they're installed in different locations: (...)/shed_tools/ toolshed.g2.bx.psu.edu/repos/iuc/package_numpy_1_7/ef12a3a11d5b/package_num… (...)/shed_tools/ toolshed.g2.bx.psu.edu/repos/iuc/package_numpy_1_7/a4bdc17eed4a/package_num… At one point during the troubleshooting steps I described in my original email, package_pybamparser_0_0_1 and package_pybamtools_0_0_1 showed up in the same way, with two records each having the same revision and a green "Installed" status. If you check on the filesystem in the {{configured_dependency_dir}}/path/to/duplicated/package do you see any strange stuff/duplication? I didn't see anything that struck me as out of the ordinary. Here's a gist of the directory structures for the affected packages under both shed_tools and tool_deps: https://gist.github.com/bcclaywell/23c0b274f2d4bd0d659f How big is your Galaxy in terms of installed tools, complexity of setup and traffic? I don't think it's terribly big -- we have a couple of large tool suites like BEDTools, the gops interval operations suites, GATK 1 and 2, etc, and then maybe 15-20 other tools and their dependencies? Our setup isn't very complex, either; Galaxy is running with one web process and one handler process behind an nginx reverse proxy, all running on a single machine. Jobs are submitted to our slurm cluster via the SSH CLI runner. Traffic is pretty low -- we're just now rolling out of beta. Cheers, Brian -- Brian Claywell | programmer/analyst Matsen Group | http://matsen.fredhutch.org <http://matsen.fhcrc.org/> Fred Hutchinson Cancer Research Center -------------- next part -------------- An HTML attachment was scrubbed... URL: <https://lists.galaxyproject.org/pipermail/galaxy-dev/attachments/20150413/6…> ------------------------------ Subject: Digest Footer _______________________________________________ galaxy-dev mailing list galaxy-dev(a)lists.galaxyproject.org https://lists.galaxyproject.org/listinfo/galaxy-dev To search Galaxy mailing lists use the unified search at: http://galaxyproject.org/search/mailinglists/ ------------------------------ End of galaxy-dev Digest, Vol 106, Issue 12 *******************************************

2 2

Automated Tool Tests w/ Data Tables
by Jeremy Liu 15 Apr '15

15 Apr '15

Galaxy Devs, I've been following this documentation to write auto tests for my tools: https://wiki.galaxyproject.org/Admin/Tools/WritingTests?action=show&redirec… Straightforward enough, but I am not sure how to incorporate input parameters from data tables into this. My tools currently use as input parameters entries/files from a data table. These files were installed using a data manager. Ideally, the tests should also reference the same data table files as the tools do. How can I do this? Thanks, Jeremy Liu jeremy.liu(a)yale.edu

3 2

problems wit upgrading to "latest_15.03" - 'UniverseApplication' object has no attribute 'control_worker'
by Hans-Rudolf Hotz 14 Apr '15

14 Apr '15

Hi I am in the process of updating our development server (from "latest_2014.10.06", including the security fix from January to "latest_15.03" ). and when I restart the server, I get the following error: ... galaxy.jobs.handler INFO 2015-04-14 15:46:05,180 sending stop signal to worker thread galaxy.jobs.handler INFO 2015-04-14 15:46:05,181 job handler stop queue stopped Error in atexit._run_exitfuncs: Traceback (most recent call last): File "/usr/lib64/python2.6/atexit.py", line 24, in _run_exitfuncs func(*targs, **kargs) File "/path_to_galaxy/galaxy_dist/lib/galaxy/app.py", line 167, in shutdown if self.control_worker: AttributeError: 'UniverseApplication' object has no attribute 'control_worker' Error in sys.exitfunc: Traceback (most recent call last): File "/usr/lib64/python2.6/atexit.py", line 24, in _run_exitfuncs func(*targs, **kargs) File "/path_to_galaxy/galaxy_dist/lib/galaxy/app.py", line 167, in shutdown if self.control_worker: AttributeError: 'UniverseApplication' object has no attribute 'control_worker' Any help appreciated Thank you very much Hans-Rudolf -- Hans-Rudolf Hotz, PhD Bioinformatics Support Friedrich Miescher Institute for Biomedical Research Maulbeerstrasse 66 4058 Basel/Switzerland

2 2

problem with revision updates for repositories.
by Anna Terry 14 Apr '15

14 Apr '15

Hi, I have a few installed tool shed repositories which are showing that updates are available. When I click get repository updates, instead of the usual upate page, I get a page that simply says Found The resource was found at http://toolshed.g2.bx.psu.edu/repository/check_for_updates?galaxy_url=https…; you should be redirected automatically. This is for bam_to_sam, but same problem for blast_datatypes, pileup_interval and sam_to_bam too. Anyone have any ideas why I'm seeing this? Cheers Anna

2 9

MySQL InnoDB - Execution Order
by McCully, Dwayne (NIH/NIAMS) [C] 10 Apr '15

10 Apr '15

Hello Everyone, The running Galaxy in a production environment documentation states: "If you are using MySQL<http://dev.mysql.com/> with MyISAM<http://dev.mysql.com/doc/refman/5.1/en/myisam-storage-engine.html> table engine when Galaxy is in multiprocess configuration, workflow steps will get executed out of order<http://dev.list.galaxyproject.org/Job-execution-order-mixed-up-tt4662488.ht…> and fail. Use InnoDB<http://dev.mysql.com/doc/refman/5.1/en/innodb-storage-engine.html> engine instead or switch to PostgreSQL<http://www.postgresql.org/>." I've enabled InnoDB for my MySQL database via the my.cnf file but the default database and database to log all database transactions were created with MyISAM files. If this is normal, when will Galaxy create InnoDB tables? I don't believe you can create a database with InnoDB. Dwayne

2 1

Visualization in anonymous mode ?
by Loraine Guéguen 09 Apr '15

09 Apr '15

Hi, I'd like to use the visualization in anonymous mode, but the visualize icon on the dataset is not available in anonymous mode (although it works fine when connected). Is it possible to activate the dataset visualization in anonymous mode ? Thanks, Loraine -- Loraine Guéguen Plateforme ABiMS (Analyses and Bioinformatics for Marine Sciences) Service Informatique et Bioinformatique Station Biologique de Roscoff FR 2424 CNRS UPMC Place Georges Teissier CS 90074 29688 Roscoff cedex tel: ++33 (0)2 98 29 56 46 (interne : 415) http://abims.sb-roscoff.fr/ http://www.sb-roscoff.fr/

2 5