May 2011 - galaxy-user - lists.galaxyproject.org

Filter Tool
by Jeremy Goecks 11 May '11

11 May '11

(Starting new thread on galaxy-user.) Jagat, It depends what filter tool you're using and what dataset you're filtering. There is a generic filter tool that can be used to filter Cuffdiff tabular files for either FPKM values and differential expression tests. There is also a tool for filtering GTF files based on a Cuffdiff expr dataset. It sounds like you may be confusing either the tools or the inputs. If after double-checking you're still having problems with filtering, please put together a short list of your analysis steps and share your history with me, and I can take a look. Thanks, J. > Further to my question, It appear that there is some problem with the filter option: > When I use the isoform/gene exp file as such it work fine but when I filter these files with either parameter such as status if test was successful or on p value it return me empty file. The way am saving the file is - expr file filter save as txt file and upload back in Galaxy. > Any suggestion? > > Jagat > > > On Tue, May 3, 2011 at 3:08 AM, shamsher jagat <kanwarjag(a)gmail.com> wrote: > Jeremy, > > I have been trying to follow the steps in filtering Cufflink out put files you have described in one of the previous messages (http://gmod.827538.n3.nabble.com/Re-downstream-analysis-of-cuffdiff-out-put…) > > I have shared histroy with you, but in summary: > > File 35: when Filter GTF data by attributes value list on data 11 (combined GTF) and data 33 (which is gene expr file) . Will not this should have one gene per row. But it is not? > > File 39: Filter GTF file by attribute value list on data 11 and data 38 (Cuffdiff splicing expr) it failed. I would assume that it should filter on the basis of TSSid . The error message is > > Traceback (most recent call last): > File "/var/opt/galaxy/g2test/galaxy_test/tools/filters/gff/gtf_filter_by_attribute_values_list.py", line 67, in > filter( gff_file, attribute_name, ids_file, output_file ) > File "/var/opt/galaxy/g2test/galaxy_test/tools/filters/gff/gtf_filter_by_attribute_values_list.py", line 57, in filter > if attributes[ attribute_name ] in ids_dict: > KeyError: 'tss_id' > > 40 : Filter GTF data by attribute list on data 11 and 34 (tss group exp) failed and error message is: > > Traceback (most recent call last): > File "/var/opt/galaxy/g2test/galaxy_test/tools/filters/gff/gtf_filter_by_attribute_values_list.py", line 67, in > filter( gff_file, attribute_name, ids_file, output_file ) > File "/var/opt/galaxy/g2test/galaxy_test/tools/filters/gff/gtf_filter_by_attribute_values_list.py", line 57, in filter > if attributes[ attribute_name ] in ids_dict: > KeyError: 'tss_id' > > I would consider that if one gene has different Id than there is splicing . > > However in contrast isoform file with transcript Id is working fine (File 20) > > On a different note can I convert GTF file to txt tab delaminated file I tried to convert file 11 in txt (following Edit attributes) but the file is not properly formatted especially col-pid and TSS id. Am I doing something wrong. > > Thanks. > > > > ___________________________________________________________ > Please keep all replies on the list by using "reply all" > in your mail client. To manage your subscriptions to this > and other Galaxy lists, please use the interface at: > > http://lists.bx.psu.edu/

2 2

Galaxy Community Conference Registration Closes May 17
by Dave Clements 09 May '11

09 May '11

Hello all, We are closing registrations for the Galaxy Community Conference at the end of May 17. However, the conference is likely to fill up before that date. So, if you are thinking about attending, *now* is the time to register for the meeting: http://galaxy.psu.edu/gcc2011/Register.html We have also secured some additional rooms on the night of May 24, in a hotel in Lunteren: http://galaxy.psu.edu/gcc2011/Logistics.html Again, it is not necessary to stay in Lunteren the night of May 24, as it is easy to get there from Amsterdam on May 25, before the meeting starts. Finally, a draft schedule is now available at: http://galaxy.psu.edu/gcc2011/Programme.html This is still subject to change, but we are hoping it won't change much. Just 15 days to go! Dave C. -- http://galaxy.psu.edu/gcc2011/ http://getgalaxy.org http://usegalaxy.org/

1 0

galaxy on the cloud - cannot select fastq files when trying to run workflow
by Amit Indap 09 May '11

09 May '11

Hi Galaxy, I am a newbie to Amazon EC2 and have been carefully following the steps in the screencast. I am able to upload two fastq files from the s3 bucket: http://s3.amazonaws.com/heteroplasmy/F4-bM4-1.fastq http://s3.amazonaws.com/heteroplasmy/F4-bM4-2.fastq I am also able import the published workflow http://s3.amazonaws.com/heteroplasmy/Galaxy-Workflow-mt_analysis_0.01_stran… But when it comes to running it, I cannot select the fastq file from the drop down menu. I am able to view them on my GC instance, since I imported them successfully, but am at a loss as to why I can't select them from the drop down menu in the workflow to begin their alignment. Is it something to do with my security group settings in setting up the EC2 instance? Any assistance you can provide would be great! Thanks, Amit -- Amit Indap

2 1

Re: [galaxy-user] question about Filtering Cufflink files
by Jeremy Goecks 09 May '11

09 May '11

Jagat, First, a couple housekeeping issues: (a) the questions you're asking are better suited to the galaxy-user list (questions about using Galaxy and performing analyses) rather than galaxy-dev (questions about installing Galaxy locally and tool development), so I've moved this thread to galaxy-user; (b) please start new threads when appropriate rather than replying to older threads as this makes threads shorter and more focused. Onto your questions: > I have another question when I filter gene list In the filtered list there are multiple rows per gene. I should have one gene per row? I have attached the snap shot of out put, but not sure if galaxy server will take it or not. I did se the discussion on other forum: > http://seqanswers.com/forums/showthread.php?t=8830 GTF files have multiple lines per feature, so your output is reasonable. > which suggest that possible complications in getting one gene per row. My next question is in that scenario what should be the best way of representing one gene per FPKM value? should we take average of FPKM per gene? I think in the gene it is till giving the transcript FPKM value but these values are different from previous file filtered with transcript id. As Vasu noted, this is an ongoing area of research. For some experiments, it may be reasonable to group alternatively-spliced isoforms of the same gene and jointly estimate FPKM, and for others it may not. Fortunately, if you do want to group transcripts to get gene FPKM values, Cuffdiff does this for you: see its gene FPKM expression file. Best, J.

1 0

RNA seq analysis
by puvan001＠umn.edu 07 May '11

07 May '11

Hi I have a couple of questions regarding RNA seq analysis. My questions are 1.I need to use a viral genome (very small, ~2kb ) as a reference genome and it is not available in Galaxy. I guess I can use this data from my history. I have a fasta file but I am not sure whether I have to do some kind of indexing or not. 2. In Tophat, default for "maximum number of alignments to be allowed" is 40. What my understanding is a single read can be aligned maximum 40 different places. I am wondering why this is 40. Is there any specific reason? If I need unique mapping, I have to use 1 instead of 40. Am I correct? Thanks SP

7 17

Megblast GIs
by Douglas Rhoads 07 May '11

07 May '11

We have a local install of Galaxy and are using it for training grad and undergrad students (using the Windshield Splatter data). We have a relatively new install and the Megablast seems to be doing something funny with the output in that column 2 which is supposed to be the GI of the database hit is now two numbers joined with an underline (see below). I need to tell my IT people what is wrong so they can correct the problem. BL1-1-3 157649053_111750 91.30 46 4 0 10 55 58541 58496 2e- 06 60.0 BL1-1-5 161788633_175843 100.00 26 0 0 15 40 48812 48787 4e- 04 52.0 -- Douglas Rhoads, Professor of Biological Sciences Director of Graduate Program in Cell and Molecular Biology 601 SCEN, Dept. of Biological Sciences, 1 University of Arkansas, Fayetteville, AR 72701-1201 drhoads(at)uark.edu, http://www.uark.edu/ua/drhoads phone: 479-575-3251 FAX: 479-575-4010

2 1

Text Manipulation: Filter out duplicates (uniq) from an plain text file ?
by Roman Valls 07 May '11

07 May '11

Hey galaxy users, Thats a fairly good question from one of my colleagues. I've looked through the menus (mainly "Text Manipulation" and "Filter and Sort"(Select)), googled (on the mailing list archives too), but couldn't find an answer: How should I remove duplicates on plain text files without resorting to: "echo file|sort|uniq" before uploading the file/text. or Putting a regexp together to replace the duplicate occurences as in: http://www.regular-expressions.info/duplicatelines.html I'm pretty sure I'm missing some really basic stuff here... is this basic operation something supposed to be done outside galaxy perhaps ? Thanks in advance !

5 5

Galaxy's recent problems
by Dave Clements 06 May '11

06 May '11

Hello all, Galaxy has been ill recently due to disk space on the server filling up. In the short term we are working on freeing up space. In the longer term we are working on adding a quota system to limit how much space any one user can take, and we've also ordered a lot more disk. In the mean time, *please take a look at your saved histories and datasets and delete anything you no longer need*. This will greatly help us get through the current rough patch. In the longer term, you can also consider setting up your own local Galaxy instance, or running Galaxy on the cloud. See: http://getgalaxy.org/ https://bitbucket.org/galaxy/galaxy-central/wiki/cloud Thanks for your patience while we work this out, Dave C and the Galaxy Team -- http://galaxy.psu.edu/gcc2011/ http://getgalaxy.org http://usegalaxy.org/

3 5

Composite Datatypes Q.
by Todd Yilk 06 May '11

06 May '11

I have a program I'm trying to "galaxify" that emits a variable number of result files. I would like the output of my Galaxy tool to show up in Galaxy as an html file with links to the result files. So when you click on the eye, the html file should up in the middle pane ... sorry if I'm not describing this in an elegant way. Creating a composite datatype is the way to go in this situation, correct? I'm creating a class that inherits from Html. How do I get the result returned from my custom "generate_primary_file" function to show up as a tool's output ... if that's the right way to go about this? Thanks!

1 0

Composite Datatypes Q.
by Todd Yilk 06 May '11

06 May '11

I have a program I'm trying to "galaxify" that emits a variable number of result files. I would like the output of my Galaxy tool to show up in Galaxy as an html file with links to the result files. So when you click on the eye, the html file should up in the middle pane ... sorry if I'm not describing this in an elegant way. Creating a composite datatype is the way to go in this situation, correct? I'm creating a class that inherits from Html. How do I get the result returned from my custom "generate_primary_file" function to show up as a tool's output ... if that's the right way to go about this? Thanks!

1 0