September 2011 - galaxy-dev - lists.galaxyproject.org

Regarding display application
by shashi shekhar 06 Sep '11

06 Sep '11

Hi All., I need help in understanding the xml tag for display_application. i don't know how all these xml tags works . can u provide me links for understanding those tags like target_frame type="template" viewable="False <display id="genetrack_interval" version="1.0.0" name="view in"> <link id="genetrack" name="GeneTrack"> <url target_frame="galaxy_main">http://genetrack.g2.bx.psu.edu/galaxy?filename=${encoded_filename.qp}&h…</url> <param type="data" name="bed_file" viewable="False" format="bed6,genetrack"/>  <param type="data" dataset="bed_file" name="genetrack_file" format="genetrack" viewable="False" /> <param type="template" name="galaxy_url" strip="True" > ${BASE_URL}/tool_runner?tool_id=predict2genetrack </param> <param type="template" name="hash_key" strip="True" > #from galaxy.util.hash_util import hmac_new ${hmac_new( $APP.config.tool_secret, $genetrack_file.file_name )} </param> <param type="template" name="encoded_filename" strip="True" > #import binascii ${binascii.hexlify( $genetrack_file.file_name )} </param> </link> </display> Regards shashi shekhar

2 3

Feedback appreciated for new unified tabular format: GTrack
by Sveinung Gundersen 05 Sep '11

05 Sep '11

Dear Galaxy-dev guys! Our research group have the last years been developing the Genomic HyperBrowser (http://hyperbrowser.uio.no) which is a system for statistical analysis of genomic data, built on top of Galaxy. The system currently includes 17 hypothesis tests and 53 descriptional statistics. In the process of developing the HyperBrowser, we have experienced several shortcomings of the usual tabular formats for genomic datasets: BED, WIG, GFF, BedGraph, etc. This has lead us to define (yet another) format for genomic data: the GTrack format (short for Genomic Track). The format will hopefully be published in an article, currently under review (together with an extension of the XML format BioXSD, which supports many of the same properties as the GTrack format). In the process of article review, we would be very interested in the feedback from you guys, in order for the format to be as good as possible. The basic issues handled are the following: 1. The first issue is the very existence of so many formats. We have, in the article, defined 15 different track formats and believe that these track formats are the main reason for the proliferation of tabular formats. The track formats are the usual Segments (as in BED) or Valued Segments (as in BedGraph), but also include other types as Points or Step Function. In addition, we introduce linked track types usable for analysis of three-dimensional data set. The GTrack format handles all 15 track types. 2. Simple to create. Allthough the GTrack format specification document is quite large, the format is still quite simple to handle. It is based on fixed columns (not attributes like GFF), but allows custom columns (unlike BED). If you allready have scripts creating output in a common tabular format, they should require little change to support GTrack. 3. Customizability. GTrack allows any number of custom columns to be added, in any order. Also, GTrack supports a scheme for creating GTrack subtypes. A GTrack subtype is a particular configuration of GTrack files explicitly created for specific uses/tools. All GTrack subtypes can still be handled by generic GTrack parsers. 4. Simple to parse. We have tried to make GTrack as simple as possible to parse. This includes the use of header lines for defining properties of a file. This eases parsing by telling the parses what is coming, plus it allows quick and dirty parsers to explicitly assert what they are able to handle (so as to abort with a clearly stated reason instead of failing silently). Also, the GTrack subtyping scheme allows parsers to limit their support to a subset of the GTrack specification, e.g. files with a fixed number and order of columns. 5. Advanced functionality. GTrack supports more advanced functionality such as networks of track elements and the option of defining the domain of a track (e.g. the genomic regions for which the track is defined). 6. Syntax, not semantics. As with BED or WIG, the GTrack format focuses on the structural elements of the data, e.g. how to represent data mathematically/informatically. We leave the specifics of interpretation to others (who can, for instance, use their definitons to create GTrack subtypes). We have also been in contact with the Galaxy team and have received positive signals regarding future support for GTrack in Galaxy. Note that tools for converting between GTrack and other formats, in addition to a tool to help create GTrack headers, will be available soon. We hope you find the format interesting and welcome all kinds of feedback/suggestions. As the paper is in a review process, we would appreciatee feedback within the next two weeks. Version 1.0b2 of the GTrack specification and an illustration of the 15 track types are available here: http://hyperbrowser.uio.no/hb/static/hyperbrowser/files/gtrack/GTrack_speci… http://hyperbrowser.uio.no/hb/static/hyperbrowser/files/gtrack/track_types.… For the HyperBrowser team, Sveinung Gundersen -- Sveinung Gundersen PhD Student, Bioinformatics, Dept. of Tumor Biology, Inst. for Cancer Research, The Norwegian Radium Hospital, Montebello, 0310 Oslo, Norway E-mail: sveinung.gundersen(a)medisin.uio.no, Phone: +47 93 00 94 54

1 0

installing software for Galaxy
by Mattias de Hollander 05 Sep '11

05 Sep '11

Hello Galaxy-developers and community, I would like to ask your advice on installing software. I used the cloudman scripts to install galaxy on a multi-core server. I use the fabric scripts from cloudman/mi-diployment to install some software but I am also looking at repositories like biolinux and the NBIC RPM repository. There has been a thread about that over here: http://gmod.827538.n3.nabble.com/RPM-repository-for-NGS-tools-in-Galaxy-tp2… As James says in that thread I also prefer to install software in isolated directories to keep track of different version. Did someone use the biolinux repository to install software in a galaxy accepted path: $GALAXY_APPS/package/version/? How does the Galaxy Cloud team does that? (Enis?) I was thinking to use 'sudo apt-get --download-only' to first get the debs and then install them using 'dpkg --instdir' and then specifying the directory. Or is there a smarter way to do this? Any thoughts on this issue are appreciated. Thanks. -- Bioinformatician Netherlands Institute of Ecology (NIOO-KNAW) Wageningen, the Netherlands

3 3

adding display application in local instance of galaxy
by shashi shekhar 05 Sep '11

05 Sep '11

Hi All , i am working in galaxy tool . i want to add one visualization tools in galaxy . i don't understand how the display applications works . tag ox xml file is not clear for display application . can u just explain the meaning of type="template" tag , target_frame tag , &amp tag ,BASE URL , strip tag and viewable tag in this xml? <display id="genetrack_interval" version="1.0.0" name="view in"> <link id="genetrack" name="GeneTrack"> <url target_frame="galaxy_main">http://genetrack.g2.bx.psu.edu/galaxy?filename=${encoded_filename.qp}&h…</url> <param type="data" name="bed_file" viewable="False" format="bed6,genetrack"/>  <param type="data" dataset="bed_file" name="genetrack_file" format="genetrack" viewable="False" /> <param type="template" name="galaxy_url" strip="True" > ${BASE_URL}/tool_runner?tool_id=predict2genetrack </param> <param type="template" name="hash_key" strip="True" > #from galaxy.util.hash_util import hmac_new ${hmac_new( $APP.config.tool_secret, $genetrack_file.file_name )} </param> <param type="template" name="encoded_filename" strip="True" > #import binascii ${binascii.hexlify( $genetrack_file.file_name )} </param> </link> </display> Regards shashi shekhar

1 0

Suggestion / Request for Comments on Galaxy Best Practices - Gradual migration to standard indentation
by Trevor Wennblom 05 Sep '11

05 Sep '11

i've been developing within Galaxy for awhile now and have been enjoying it quite a bit. i've seen portions of similar ideas in the past, but never cohesively assembled and so well realized. i'd like to make some suggestions for further code collaboration / community contributions. my default development environment seems to occasionally be causing havoc within my local repository. upon saving, i normally automatically strip right-sided whitespace to stay compatible with other developers i collaborate with. this also fixes the auto-indentation left by my editor when it occasionally leaves a line consisting of only spaces. given that python has syntactically significant whitespace, i also try to maintain the convention of indentation with four-spaces. i've noticed this isn't consistent within the codebase, but does seem to be the preferred style such as in `lib/galaxy/datatypes/`. python comes packaged with the script `reindent.py`: Change Python (.py) files to use 4-space indents and no hard tab characters. Also trim excess spaces and tabs from ends of lines, and remove empty lines at the end of files. Also ensure the last line ends with a newline. this is recommended practice per PEP 8: http://www.python.org/dev/peps/pep-0008/ Tabs or Spaces? Never mix tabs and spaces. The most popular way of indenting Python is with spaces only. The second-most popular way is with tabs only. Code indented with a mixture of tabs and spaces should be converted to using spaces exclusively. When invoking the Python command line interpreter with the -t option, it issues warnings about code that illegally mixes tabs and spaces. When using -tt these warnings become errors. These options are highly recommended! For new projects, spaces-only are strongly recommended over tabs. Most editors have features that make this easy to do. other comments in regards to collaboration: http://rails-bestpractices.com/posts/60-remove-trailing-whitespace http://blogobaggins.com/2009/03/31/waging-war-on-whitespace.html hooks can be added to the repository for consistency, as i'm sure with the many contributions received this would be easy to miss: http://mercurial.selenic.com/wiki/CheckFilesExtension would anyone be opposed to me fixing up the current codebase to adhere to this? running `reindent.py` on the files is easy enough, i'm willing to step through the files (`opendiff` / `FileMerge.app`) and verify no unlikely syntactic changes have occurred. i can also deliver changes in gradual "chunked" pull requests to ease current developers getting possibly bit by merge issues. would anyone be willing to add the appropriate hooks to the central repository as well? trevor trevor(a)well.com https://github.com/trevor

6 6

Adding an OpenID provider to Galaxy
by Nikolai Vazov 05 Sep '11

05 Sep '11

Hi, I have been trying to add a new OpenID provider to the Galaxy-hardcoded list of providers. I type in my credentials in the new provider's window, but I got the following error (I am giving here only the last five lines) .... Module openid.consumer.consumer:413 in complete Module openid.message:167 in fromPostArgs Module openid.message:200 in _fromOpenIDArgs Module openid.message:240 in setOpenIDNamespace InvalidOpenIDNamespace: Invalid OpenID Namespace u'http%3A%2F%2Fspecs.openid.net%2Fauth%2F2.0' Does anybody have an idea what in my server goes wrong with the OpenID Namspace and how I can fix it? It might be useful to say that my Galaxy database is located on a separate machine with an SSL connection form the Galaxy app server. Thank you in advance Nikolai -- Nikolay Vazov, PhD Research Computing Centre - http://hpc.uio.no USIT, University of Oslo

1 0

Problems with load_workflow_editor
by shashi shekhar 02 Sep '11

02 Sep '11

Hi All, i am not able to create workflow in my local instance of galaxy. it's displaying only loading picture on browser when i am clicking on edit option of workflow . how can we resolve such type of problem ? i am using old version version galaxy. 192.168.60.115, 145.139.1.156 - - [02/Sep/2011:16:13:50 +0600] "GET /workflow/get_datatypes?_=1314940546255 HTTP/1.1" 200 - " http://garu.ac.in/workflow/editor?id=df7a1f0c02a5b08e" "Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.17) Gecko/20110420 Firefox/3.6.17" 192.168.60.115, 145.139.1.156 - - [02/Sep/2011:16:13:51 +0600] "GET /workflow/load_workflow?_=1314940546462&id=df7a1f0c02a5b08e&_=true HTTP/1.1" 200 - "http://garu.ac.in/workflow/editor?id=df7a1f0c02a5b08e" "Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.17) Gecko/20110420 Firefox/3.6.17" Regards shashi shekhar

2 2

deleting files from galaxy database/file system
by Nikhil Joshi 02 Sep '11

02 Sep '11

Hi all, How does galaxy handle deletion of files? I mean when I delete a file from my history, it doesn't seem like it deletes it from the database directory, nor does it delete any associated "files" directories. Is it scheduled for deletion and will be deleted at some point? Is there any way to force the deletion, besides simply deleting the files directly on our server? If I did that, would that be a problem? Any help would be highly appreciated! Thanks! - Nik.

2 1

Re: [galaxy-dev] Modifying OpenID providers
by Nate Coraor 02 Sep '11

02 Sep '11

Hi Nikolai, It's best to send questions directly to the mailing list, so they reach the widest audience and the right people. There are some responses below: Nikolai Vazov wrote: > > Hi, Nate, > > You helped me install Galaxy with a DB hosted on a remote server via > SSL connection. Thanks a lot again for your help. > > I have been struggling to add OpenID providers to Galaxy, but have > not been very successful. I have some questions: > > 1) Where are the variables (OpenID providers) in the dropdown menu > stocked? In a file, the DB? The template (login.mako) has a line > > > <%def name="render_openid_form( referer, auto_associate, > openid_providers )"> > > but the where are the date for openid_providers (I am a newby in > python ...) > > 2) In which files do you configure them? The list is hardcoded in: lib/galaxy/web/controllers/user.py These should ultimately be moved to a configuration file. > 3) The provider I want to add uses SAML 2.0, which is the package I > need for python? pysaml2.0? I haven't worked with SAML before so unfortunately I can't be of much help here. --nate > > Thank you for your help > > Nikolai > > -- > Nikolay Vazov, PhD > Research Computing Centre - http://hpc.uio.no > USIT, University of Oslo

1 0

Problem with workflow
by shashi shekhar 02 Sep '11

02 Sep '11

Hi, i am not able to create workflow in my local instance of galaxy. it's displaying only loading picture on browser. i am using old version version galaxy. Regards shashi shekhar

1 0