September 2015 - galaxy-dev - lists.galaxyproject.org

Query in publishing the tool
by Gaurav Kumar 30 Sep '15

30 Sep '15

Hi there, Greetings. I have created a tool and would like to publish it in the galaxy, however I am having problems in doing that. My tool is a kind of pipeline and hence has a combination of several .xml and .py files. Now, ideally I would like to publish the tool in such a way that when somebody installs it should get the all the .xml and .py files right way. However, right now even I have uploaded the tool as a zipped repo, all the files are been uploaded separately and the user will have to download them one by one. I would highly appreciate if you please help me out in guiding the way that I can upload the tool as a single repo file with several files in it instead of uploading several individual files. Many thanks Gaurav

1 0

Question about using dynamic options and refresh_on_change for rendering 2 associated select lists
by Greg Von Kuster 30 Sep '15

30 Sep '15

Hello all, I’m working on adding support to the Galaxy framework for datatypes in the constructive solid geometry (CSG) space and I have several working Galaxy tools and a visualization plugin that deal with 3d shapes in this environment. All of this work will soon be contributed to open source. For one of the tools, I need to provide 2 select lists on the tool form that are associated in such a way that when an option in select list 1 is chosen, the options in select list 2 are altered and re-rendered. This behavior would probably use a combination of dynamic options and refresh_on_change between the 2 associated select lists. I’ve not seen a tool that does this precisely, so I’m hoping that if it is currently possible to do this within Galaxy tools, someone will point me to an example. If it is not currently possible, I will contribute a PR for supporting it, but would like some input as to how it should be done. Dynamic options are currently rendered using 4 approaches; from_file, from_dataset, from_parameter and from_data_table. One or more of several filters can then be applied to the options to alter them if desired. Since these CSG tools involve new datatypes, I have flexibility into how the metadata elements are set up that are needed to render these 2 select lists. A dictionary may work where the metadata element contents look like this: {a: [‘1’, ‘2’], b: [‘3’, ‘4’] } The options in select list 1 would be ‘a’ and ‘b’. When ‘a’ is selected, select list 2 would have options ‘1’ and ‘2’, and when ‘b’ is selected, select list 2 would have options ‘3’ and ‘4’. To support this approach, perhaps dynamic options could be enhanced to include a from_dict option. There would be some complxity involved in associating the lists using refresh_on_change so that select list 2 is refreshed with the correct options when select list one is changed. I haven’t yet worked out these details. Also, using a dictionary will not keep order for the options, so perhaps a list of tuples would be better? [ [ ‘a’, [‘1’, ‘2’]], [‘b’, [‘3’, ‘4’]]] Can someone let me know if this is currently possible, and if so, an example tool that does it? If it’s not possible, does the above approach seem reasonable, or is there a better way? Thanks very much, Greg Von Kuster

2 7

set_user_disk_usage.py as a cron job?
by Jose Juan Almagro Armenteros 28 Sep '15

28 Sep '15

Hello all, I have just encounter a bug with the disk-quota for many users and I run the set_user_disk_usage.py script. It recalculated the disk usage for most of them and now seems that everything is okay. My question is: should I add this script as a cron job or this kind of bugs are just something inusual that happens after upgrading? Best regards, Jose

1 0

Re: [galaxy-dev] validator type="empty_field" is not working within repeat tags
by Anmol Hemrom 25 Sep '15

25 Sep '15

Hi, I was trying to enforce not to allow empty string as an input to text field. It is working outside the repeat tags but not working within repeat tags. 1) Working fine <param name="input" type="text" label="Enter Name"> <validator type="empty_field"/> </param> 2) Not Working within repeat tags. <repeat name="test" title="Test"> <param name="input" type="text" label="Enter Name"> <validator type="empty_field"/> </param> </repeat> Thanks Anmol On Fri, May 29, 2015 at 2:00 PM, Dave Clements <clements(a)galaxyproject.org> wrote: > Hi Anmol, > > The best place to post this question is the Galaxy Dev List < > galaxy-dev(a)lists.galaxyproject.org>. You can also search to see if > anyone has asked a similar question at > https://galaxyproject.org/search/web/ > > Thanks, > > Dave C > > On Fri, May 29, 2015 at 6:56 AM, <anmol.jh(a)gmail.com> wrote: > >> Hi, >> >> I was trying to enforce not to allow empty string as an input to text >> field. It is working outside the repeat tags but not working within repeat >> tags. >> 1) Working fine >> >> <param name="input" type="text" label="Enter Name"> >> <validator type="empty_field"/> >> </param> >> >> 2) Not Working within repeat tags. >> >> <repeat name="test" title="Test"> >> <param name="input" type="text" label="Enter Name"> >> <validator type="empty_field"/> >> </param> >> </repeat> >> >> Thanks >> >> Anmol >> >> _____________________________________ >> Sent from http://dev.list.galaxyproject.org >> >> > > > -- > http://galaxyproject.org/ > http://getgalaxy.org/ > http://usegalaxy.org/ > https://wiki.galaxyproject.org/ >

2 1

Adding data libraries from filesystem path creating duplicates
by Martin Vickers 25 Sep '15

25 Sep '15

Hi All, I've noticed an issue a couple of times now where I've added a directory of fastq's from an NFS mounted filesystem (reference only rather than copying into galaxy) and then galaxy times out. Load average begins to get really high and then consumes all the RAM and sometimes crashes. These are the same symptom as I had before with this issue that was never resolved; http://dev.list.galaxyproject.org/run-sh-segfault-td4667549.html#a4667553 What I've noticed is that in the dataset I'm uploading to galaxy, there are suddenly many duplicates. In this example that's just happened, there are 288 fastq.gz files in the physical folder, but galaxy has created 6 references to each file resulting in 1728 datasets in the folder (see attached images). When this happened before and crashed the galaxy application, whenever it restarted it'd try to resume what it was doing which created an endless loop of retrying and crashing until the job was removed. Does anyone know what may be causing this? Cheers, Martin -- -- Dr. Martin Vickers Data Manager/HPC Systems Administrator Institute of Biological, Environmental and Rural Sciences IBERS New Building Aberystwyth University w: http://www.martin-vickers.co.uk/ e: mjv08(a)aber.ac.uk t: 01970 62 2807

2 3

_JAVA_OPTIONS config parameter in job_conf.xml.sample_advanced
by Dooley, Damion 24 Sep '15

24 Sep '15

Wondering if anyone has reported this for the doc/sample file team: Isn't the java config example line in that file wrong (at least for my java 1.6): <env id="_JAVA_OPTIONS">-Xmx=6GB</env> With a setting of -Xmx=10g, Picard wouldn't run sortSam, instead this stderr text: ***************** Fatal error: Exit code 1 () Picked up _JAVA_OPTIONS: -Xmx=10g Invalid maximum heap size: -Xmx=10g Could not create the Java virtual machine. ***************** I changed the <env> tag to take out "=" so it reads: <env id="_JAVA_OPTIONS">-Xmx6G</env> and now its working fine! Had to lookup -Xmx param format on the net from: http://javahowto.blogspot.ca/2006/06/6-common-errors-in-setting-java-heap.h… Regards, Damion. Hsiao lab, BC Public Health Microbiology & Reference Laboratory, BC Centre for Disease Control 655 West 12th Avenue, Vancouver, British Columbia, V5Z 4R4 Canada

1 0

Advice on Galaxy administration
by Raymond Wan 24 Sep '15

24 Sep '15

Dear all, I'm still new to Galaxy but was wondering if someone could offer some advice. On a local Galaxy instance, if I were the Galaxy administrator but do not have sudo access on the machine itself, is this a problem? Or are the two roles intricately linked so that the Galaxy administrator will have to pester the system administrator frequently? The web interface alone is not sufficient for the Galaxy administrator. (i.e., does a Galaxy administrator need sudo access ... or even just group access to the Galaxy subdirectory to effectively do his/her job? ...I mean making Galaxy owned by a Unix group and putting the Galaxy administrator in that group.) As an aside, I was trying to do some alignment with bwa and realized I needed to prepare the genome by creating the index and an accompanying .loc file. The instructions [1] seem to imply some kind of command-line access.. Thank you for your help! Ray [1] https://wiki.galaxyproject.org/Admin/DataPreparation

4 10

Galaxy on a Cluster -- Active Directory LDAP configuration
by Carlos Lijeron 24 Sep '15

24 Sep '15

Everyone, We are setting up Galaxy to work with our cluster and SLURM as the work manager. The cluster itself authenticates to our local Active Directory, so I’m wondering if the best way to track resource utilization of Galaxy users on the cluster is to also have Galaxy authenticate to the same Active Directory LDAP. Is anyone on this list using the same configuration and tracking resource utilization from Galaxy users submitting jobs to the cluster nodes? Please advise. Thank you all ! Carlos.

3 5

Running Galaxy on a cluster with SLURM ?
by Carlos Lijeron 23 Sep '15

23 Sep '15

Hello everyone, I¹m setting up Galaxy to run on our cluster which uses SLURM as the job manager. I am wondering if any of you have any expertise in this area, ideas to share or lessons learned. I carried out the following steps listed below, but I can¹t make the final connection just yet. Any pointers will be greatly appreciated. 1. Setup Galaxy to run on the head node 2. Setup MySQL and it¹s running well with Galaxy 3. Setup the drmaa-python library inside our Galaxy folder Main questions: What would be the next step to take? Where to setup Galaxy to use an exclusive pool of resources (called partition in SLURM). Thank you all ! Carlos.

2 1

Current directory in the galaxy job file script
by Ping Luo 22 Sep '15

22 Sep '15

I installed the latest Galaxy (v15.07) and tested with a job. I found my local environment setup file was not executed. The line of code that executes the local setup file is [ -f "config/local_env.sh" ] && . config/local_env.sh Further looking into the galaxy_xx.sh file shows the current directory of the script is $working_directory before "cd $working_directory" is executed. This is not the case in previous versions, where the job's current directory is the root of the Galaxy server in the beginning, until "cd $working_directory" is executed. I think making the current directory first at the root of the Galaxy server is better since I don't need to put a full path in galaxy.ini for the environment_setup_file. Will you change this back to it was? Thanks, Ping

1 0