- galaxy-dev - lists.galaxyproject.org

Offering a user-paid NGS analysis pipeline in the cloud
by Sven-Eric Schelhorn 25 Aug '11

25 Aug '11

Dear Community, our lab has developed a NGS analysis pipeline for viral sequence analysis (both genomic resequencing and RNA-Seq, including some novel pathogen detection and viral quasi-species reconstruction approaches) that fulfills various analytical needs of our clinical cooperation partners. Since we believe that the pipeline might be of interest to the broader virological community we decided to integrate our workflow into Galaxy as a set of plugins. However, we do need our in-house computational capacities for our own analyses and are targeting people who do not have time and experience to set up their own Galaxy installation (for example, clinical virologists). Therefore, we would like to provide the finished product as a non-profit service in the cloud (for example, by using Amazon AWS, for which the Galaxy installation is pretty straightforward). We envision (or at least, hope) that the pipeline will be used heavily and would therefore like to transfer the costs for the used resources to the user (e.g., the clinical virologist) in a pay-as-you-go manner. Amazon offers its 'DevPay' service for these purpose, basically an infrastructure to bill users of an AWS application instead of the application provider. Again, we do not want to make any profit with this service, we just want people to pay for the cpu cycles they burn with as few hassles for us as possible. I could well imagine that other academic institutions have similar goals, e.g. being willing to offer their work for free without wanting to cover the costs for analysis resources. Does anyone have experience with similar kinds of setups and would like to offer advice? I am looking for hints about technical (e.g. how to best integrate a Cloud Galaxy with DevPay or similar) as well as legal hurdles that we might have to be careful about (e.g., are we in conflict with Open-Source Software Licenses if billing is involved, even if we do not make a profit etc.). Thanks a bunch! Grüße/Regards Sven-Eric Schelhorn -- Sven-Eric Schelhorn - http://mpi-inf.mpg.de/~sven Max Planck Institute for Informatics, Saarbrücken D3 - Computational Biology & Applied Algorithmics

1 0

Issue with file permissions of uploaded files
by Joern Toedling 25 Aug '11

25 Aug '11

Hi all, we have our own Galaxy server running under Nginx. Recently we changed the 'user' of Nginx in the Nginx configuration file from 'galaxy' to a more general 'www' since we plan to use Nginx for other purposes as well. Now the "Get data -> Upload file" does not work any longer because of file permissions. Files are uploaded correctly to a directory /local/data/galaxy_tmp/upload_store/ but then are owned by the 'www' user and read-writeable by this other only. Thus, the Galaxy user 'galaxy' cannot open them, cannot determine the file type and the whole "Upload file" process fails. How can I set the file permissions of uploaded files? Do I need to enter a matching 'umask' in some Galaxy configuration or in some Nginx configuration file. Any links to where to set such a umask would be greatly appreciated. Thanks, Joern -- Joern Toedling, PhD Core Facility Bioinformatics Institute of Molecular Biology gGmbH (IMB) http://www.imb-mainz.de Tel.: +49 6131 39 21511

3 3

checkboxes bug fix
by Louise-Amélie Schmitt 25 Aug '11

25 Aug '11

Hi, Since I haven't updated Galaxy for a while now I don't know if it was actually fixed but I had issues with my default-selected checkboxes: When I deselected them, the value sent in the query remained as if they were still selected. Even when I re-ran the job, all the checkboxes were selected as if I never deselected them. Therefore, in lib/galaxy/web/form_builder.py I changed: 105 return '<input type="checkbox" id="%s" name="%s" value="true"%s%s><input type="hidden" name="%s%s" value="true"%s>' \ for: 105 return '<input type="checkbox" id="%s" name="%s" value="true"%s%s><input type="hidden" name="%s%s" value="false"%s>' \ And it works fine now :) Cheers, L-A

3 5

Re: [galaxy-dev] Installing local instance hiccup
by Kanwei Li 25 Aug '11

25 Aug '11

Ah, unfortunately we don't have a machine running Lion that can build the bundled eggs. Any chance you could change it to 2.6? "man python" in the command line should give instructions. For 10.6, the command is "defaults write com.apple.versioner.python Version 2.6" On Wed, Aug 24, 2011 at 6:20 PM, Stephen Doyle <S.Doyle(a)latrobe.edu.au>wrote: > Hi Kanwei, > > That would certainly help. Its a new MacBook Pro running OSX 10.7.1 and > Lion. > > Cheers, > Steve > > > > > > --------------------------------- > Dr Stephen R. Doyle > Postdoctoral Researcher > Genetics Department | La Trobe University | Bundoora 3086 > Australia > T: +61 3 9479 3087 | F: +61 3 9479 2480 | E: s.doyle(a)latrobe.edu.au | W: > http://www.latrobe.edu.au/genetics/staff/stephen_doyle.htm > > *La Trobe University - ranked top in Victoria for student satisfaction > (Sweeney Uni Student Report, 2009) > * > CRICOS Provider 00115M > > J Please kindly consider your environment before printing this e-mail > > Warning to recipients: > This email and any attachments are confidential and subject to copyright. > If you are not the intended recipient any use, disclosure or copying is > unauthorised. If you have received this email in error please advise us > immediately by reply email and delete all copies. It is your responsibility > to examine this email and any attachments for viruses. Any personal > information in this email must be handled in accordance with the Information > Privacy Act 2000 (Vic). > > > > > On 25/08/2011, at 1:33 AM, Kanwei Li wrote: > > Hi Stephen, > > What platform are you running on? > > Thanks, > > K > > On Wed, Aug 24, 2011 at 3:53 AM, Stephen Doyle <S.Doyle(a)latrobe.edu.au>wrote: > >> Hello, >> >> I am in the process of installing a local instance, and I can't seem to be >> able to build the bx_python egg, even with scramble.py. Any ideas to get >> around this? >> >> Cheers, >> Steve >> >> >> >> >> >> --------------------------------- >> Dr Stephen R. Doyle >> Postdoctoral Researcher >> Genetics Department | La Trobe University | Bundoora 3086 >> Australia >> T: +61 3 9479 3087 | F: +61 3 9479 2480 | E: s.doyle(a)latrobe.edu.au | >> W: http://www.latrobe.edu.au/genetics/staff/stephen_doyle.htm >> >> *La Trobe University - ranked top in Victoria for student satisfaction >> (Sweeney Uni Student Report, 2009) >> * >> CRICOS Provider 00115M >> >> J Please kindly consider your environment before printing this e-mail >> >> Warning to recipients: >> This email and any attachments are confidential and subject to copyright. >> If you are not the intended recipient any use, disclosure or copying is >> unauthorised. If you have received this email in error please advise us >> immediately by reply email and delete all copies. It is your responsibility >> to examine this email and any attachments for viruses. Any personal >> information in this email must be handled in accordance with the Information >> Privacy Act 2000 (Vic). >> >> >> >> >> >> ___________________________________________________________ >> Please keep all replies on the list by using "reply all" >> in your mail client. To manage your subscriptions to this >> and other Galaxy lists, please use the interface at: >> >> http://lists.bx.psu.edu/ >> > > >

1 0

Sam2interval.py bug
by SHAUN WEBB 25 Aug '11

25 Aug '11

Hi, I've noticed a bug in sam2interval.py. There are a few indentation errors in the final lines of code. I think there should be an indent after: if not ref_name == '*': And this whole if statement should be included in the for loop above. Also, would you be able to add read_name to the truncated output (when not printing all fields). This makes downstream analysis a lot easier, e.g. looking at reads that map multiple times. Thanks Shaun Webb -- The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336.

2 2

Re: [galaxy-dev] Failure to prepare job error
by Woozy 25 Aug '11

25 Aug '11

Hello, I'm running a Python/R tool from my Amazon Galaxy instance. To use R, I import a package I've installed called PypeR. My tool works fine from the command line, but when I try to run it on my Amazon instance, it gives me this error: Traceback (most recent call last): File "/nfs/software/galaxy/lib/galaxy/jobs/runners/local.py", line 61, in run_job job_wrapper.prepare() File "/nfs/software/galaxy/lib/galaxy/jobs/__init__.py", line 371, in prepare self.command_line = self.tool.build_command_line( param_dict ) File "/nfs/software/galaxy/lib/galaxy/tools/__init__.py", line 1543, in build_command_line command_line = fill_template( self.command, context=param_dict ) File "/nfs/software/galaxy/lib/galaxy/util/template.py", line 9, in fill_template return str( Template( source=template_text, searchList=[context] ) ) File "/nfs/software/galaxy/eggs/Cheetah-2.2.2-py2.6-linux-i686-ucs4.egg/Cheetah/Template.py", line 1004, in __str__ return getattr(self, mainMethName)() File "cheetah_DynamicallyCompiledCheetahTemplate_1311891781_86_41894.py", line 83, in respond EOFError: EOF when reading a line With the additional caption "failure to prepare job". I've been struggling with this for days, and I'm pretty sure I don't have a typo in my .xml file. How can I solve this? Thanks, Rafi Torsten Schwab Marketing GmbH Emanuelstr. 3, 10317 Berlin Deutschland Telefon: +49 (33) 5310967 Email: woozydude(a)gmail.com Site: http://flug.prexxis.de/

2 1

latest checkout (today) does not have Help or User
by Joseph Hargitai 25 Aug '11

25 Aug '11

Hi, built a new server today to test a few things. a, Help is not clickable via Apache2 proxy 2, when you use an apache2 proxy is it for granted that local authentication cannot be used? I tired remote-user = False hoping i can use load-balancing and proxy but retain local authentication. But User remains unclickable. 3, Using Nginx anyone has a full nginx config script? The wiki has the snippets which I am not sure where to fit in nginx nomenclature - does it go in conf or virtual sites enabled. I am assuming the local authentication can be done with nginx as is done on the cloud version. Which would be the goal. thanks, joe

2 1

Launching a JAVA or external app
by Bossers, Alex 25 Aug '11

25 Aug '11

Hello all, would it be possible to launch for instance a JAVA app with preloaded parameters and files from galaxy that needs interaction/display? For instance a gui based annotation editor? It necessarily doesn't have to support saving of files back to galaxy. Sort of end stage. Any help or pointers appreciated. thanks Alex

2 1

Installing local instance hiccup
by Stephen Doyle 25 Aug '11

25 Aug '11

Hello, I am in the process of installing a local instance, and I can't seem to be able to build the bx_python egg, even with scramble.py. Any ideas to get around this? Cheers, Steve --------------------------------- Dr Stephen R. Doyle Postdoctoral Researcher Genetics Department | La Trobe University | Bundoora 3086 Australia T: +61 3 9479 3087 | F: +61 3 9479 2480 | E: s.doyle(a)latrobe.edu.au<mailto:s.doyle@latrobe.edu.au> | W: http://www.latrobe.edu.au/genetics/staff/stephen_doyle.htm La Trobe University - ranked top in Victoria for student satisfaction (Sweeney Uni Student Report, 2009) CRICOS Provider 00115M J Please kindly consider your environment before printing this e-mail Warning to recipients: This email and any attachments are confidential and subject to copyright. If you are not the intended recipient any use, disclosure or copying is unauthorised. If you have received this email in error please advise us immediately by reply email and delete all copies. It is your responsibility to examine this email and any attachments for viruses. Any personal information in this email must be handled in accordance with the Information Privacy Act 2000 (Vic).

2 1

How to get tool id in runner file (local.py)
by shashi shekhar 24 Aug '11

24 Aug '11

Hi, I have local instance of Galaxy and i am doing some modification in Galaxy .So i need tool id id in local.py file . How i will get this information in runner file (local.py). Regards shashi shekhar

2 2