- galaxy-user - lists.galaxyproject.org

default data for a tool
by alex 10 May '12

10 May '12

Hi, Is there a way to specify default data for a tool, maybe inside an xml? Alex

2 1

Help!!! cuffdiff log2 value
by 杨继文 10 May '12

10 May '12

Hi, I am analyzing my RNA-Seq data. After running cuffdiff, I got a list of differentially expressed transcrpts or genes. As far as I know, log2 value = fold change. However, there are minus values. Is this possible?? log2 value can not be minus. Did I miss something?? Looking forward to your help. Thanks in advance. Best Jiwen

3 3

Re: [galaxy-user] operate on genomic intervals
by Jennifer Jackson 08 May '12

08 May '12

Hi Jose, That's great news! A tool tip in the wiki or UI would probably be helpful - your question was a good one. Meanwhile, I'll post your results to back to the list, it may help others who are also working to optimize. Glad that it worked out so well, Jen Galaxy team On 5/8/12 2:57 PM, Xianrong Wong wrote: > Thank you Jennifer! I swapped the order of the input datasets which > reduced the running time from 2 hrs to 10 min! > Jose > > On Mon, May 7, 2012 at 12:03 PM, Jennifer Jackson <jen(a)bx.psu.edu > <mailto:jen@bx.psu.edu>> wrote: > > Hi Jose, > > Very glad to know that you have this working. > > You question is difficult to address with specificity, as these are > completely different algorithms. But in general, any alignment > algorithm (Bowtie included) has some sort of indexing strategy (some > are better than others) to minimize what is held in memory and > process bulk data through. See the Bowtie documentation for how this > is achieved. > > The interval operations tools also have an indexing strategy, > specifically, the second input file is the portion loaded memory and > the first file is processed against it. So, if you want use an > extremely large dataset (or just want to the job to run quicker) try > to use it as the first input file if possible. > > These tools are designed to be used together and with other tools to > create workflows, so there should pretty much always be some way to > break jobs up (as you did) to get them through the tools, on even > modest systems: > http://wiki.g2.bx.psu.edu/__Learn/Interval%20Operations > <http://wiki.g2.bx.psu.edu/Learn/Interval%20Operations> > > Take care, > > Jen > Galaxy team > > > > On 5/7/12 8:30 AM, Xianrong Wong wrote: > > Hello Jennifer, thanks for the advise. It worked when I did it a > chromosome at a time. Is there a reason why this is so much more > computationally heavy as compared to bowtie? (mapping 190 > million reads > took only 3-4 hours for me) > Jose > > On Fri, May 4, 2012 at 7:55 PM, Jennifer Jackson <jen(a)bx.psu.edu > <mailto:jen@bx.psu.edu> > <mailto:jen@bx.psu.edu <mailto:jen@bx.psu.edu>>> wrote: > > Hello Jose, > > It sounds as if the job is running out of memory. Since you are > already working on a cloud, I am going to make the > assumption that > you have explored the server options with high-capacity memory > there. But if not, that is one place to start, in particular > your > EC2 Instance type, as described on this wiki: > http://wiki.g2.bx.psu.edu/____Admin/Cloud/CapacityPlanning > <http://wiki.g2.bx.psu.edu/__Admin/Cloud/CapacityPlanning> > > <http://wiki.g2.bx.psu.edu/__Admin/Cloud/CapacityPlanning > <http://wiki.g2.bx.psu.edu/Admin/Cloud/CapacityPlanning>> > > However, even if that was an option, you may want to consider > running your in data through in another way - by running smaller > jobs, then merging results, to avoid the large jobs. For > example, in > the last step where you join to the "full BamHI delimited > bin file", > instead join to groups of bins in that file (perhaps grouped by > chromosome), then combine the results to produce the full > output. > > Hopefully this helps provide some options, > > Jen > Galaxy team > > > On 5/4/12 2:18 PM, Xianrong Wong wrote: > > Hello, > I have binned the mouse genome into fragments > based on > restriction enzyme cut sites. So each bin is a fragment > flanked > by say > BamHI. The output file is in the interval format: chr# > start > and end > coordinates of each bin. I want to count how many times > each > bin has > reads that align to it. I mapped my reads using bowtie and > generated a > dataset (interval format) for the aligned reads. I then > used > join in > "operate on genomic intervals" and asked it to return intervals that > innerjoin the "bin file". The subsequent steps involve > grouping and > counting and then joining back to the 1st dataset (BamHI > delimited > bins). I have tried this workflow on small datasets and > it worked. > However when I subject my full alignment file and full BamHI > delimited > bin file, the tool fails. I am doing this on cloud. > Any advice > would > be appreciated! > > Jose > > > > _________________________________________________________________ > > The Galaxy User list should be used for the discussion of > Galaxy analysis and other features on the public server > at usegalaxy.org <http://usegalaxy.org> > <http://usegalaxy.org>. Please keep all > > replies on the list by > using "reply all" in your mail client. For discussion of > local Galaxy instances and the Galaxy source code, please > use the Galaxy Development list: > > http://lists.bx.psu.edu/____listinfo/galaxy-dev > <http://lists.bx.psu.edu/__listinfo/galaxy-dev> > > <http://lists.bx.psu.edu/__listinfo/galaxy-dev > <http://lists.bx.psu.edu/listinfo/galaxy-dev>> > > To manage your subscriptions to this and other Galaxy lists, > please use the interface at: > > http://lists.bx.psu.edu/ > > > -- > Jennifer Jackson > http://galaxyproject.org > > > > -- > Jennifer Jackson > http://galaxyproject.org > > -- Jennifer Jackson http://galaxyproject.org

1 0

Help on installing cutadapt
by Tilahun Abebe 08 May '12

08 May '12

Hi Galaxy users, I tried to install cutadapt for sequence trimming on a local Galaxy instance. I successfully installed Galaxy as an administrator. However, when Galaxy starts, I don't see the administrator option in the top menu bar with the "Analyze Data, Workflow, Shared Data, Visualization, Help, and User". It looks like the only way I can install cutadapt is with an administrator option. Any suggestion how I can include the administrator option in the menu? Thanks for your help. Tilahun

2 1

Filtering a VCF file
by Laura Reinholdt 07 May '12

07 May '12

I’m using a local instance of Galaxy. I’d like to filter a VCF file for SNPs that have passed filter (as indicated in the VCF file as “PASS” under column 7, FILTER). I can use the basic tab file filter tool (c7==’PASS’), but the resulting file has lost the VCF header and that’s causing a problem with the annotation tool that I want to use. Any advice on how to get around this? Thanks, Laura Laura Reinholdt, PhD Research Scientist Genetic Resource Science The Jackson Laboratory 600 Main Street Bar Harbor, ME 04609-1500 (207) 288-6000, ext. 6693 http://research.jax.org/grs/ http://research.jax.org/faculty/laura-reinholdt.html The information in this email, including attachments, may be confidential and is intended solely for the addressee(s). If you believe you received this email by mistake, please notify the sender by return email as soon as possible.

2 1

Re: [galaxy-user] operate on genomic intervals
by Jennifer Jackson 07 May '12

07 May '12

Hi Jose, Very glad to know that you have this working. You question is difficult to address with specificity, as these are completely different algorithms. But in general, any alignment algorithm (Bowtie included) has some sort of indexing strategy (some are better than others) to minimize what is held in memory and process bulk data through. See the Bowtie documentation for how this is achieved. The interval operations tools also have an indexing strategy, specifically, the second input file is the portion loaded memory and the first file is processed against it. So, if you want use an extremely large dataset (or just want to the job to run quicker) try to use it as the first input file if possible. These tools are designed to be used together and with other tools to create workflows, so there should pretty much always be some way to break jobs up (as you did) to get them through the tools, on even modest systems: http://wiki.g2.bx.psu.edu/Learn/Interval%20Operations Take care, Jen Galaxy team On 5/7/12 8:30 AM, Xianrong Wong wrote: > Hello Jennifer, thanks for the advise. It worked when I did it a > chromosome at a time. Is there a reason why this is so much more > computationally heavy as compared to bowtie? (mapping 190 million reads > took only 3-4 hours for me) > Jose > > On Fri, May 4, 2012 at 7:55 PM, Jennifer Jackson <jen(a)bx.psu.edu > <mailto:jen@bx.psu.edu>> wrote: > > Hello Jose, > > It sounds as if the job is running out of memory. Since you are > already working on a cloud, I am going to make the assumption that > you have explored the server options with high-capacity memory > there. But if not, that is one place to start, in particular your > EC2 Instance type, as described on this wiki: > http://wiki.g2.bx.psu.edu/__Admin/Cloud/CapacityPlanning > <http://wiki.g2.bx.psu.edu/Admin/Cloud/CapacityPlanning> > > However, even if that was an option, you may want to consider > running your in data through in another way - by running smaller > jobs, then merging results, to avoid the large jobs. For example, in > the last step where you join to the "full BamHI delimited bin file", > instead join to groups of bins in that file (perhaps grouped by > chromosome), then combine the results to produce the full output. > > Hopefully this helps provide some options, > > Jen > Galaxy team > > > On 5/4/12 2:18 PM, Xianrong Wong wrote: > > Hello, > I have binned the mouse genome into fragments based on > restriction enzyme cut sites. So each bin is a fragment flanked > by say > BamHI. The output file is in the interval format: chr# start > and end > coordinates of each bin. I want to count how many times each > bin has > reads that align to it. I mapped my reads using bowtie and > generated a > dataset (interval format) for the aligned reads. I then used > join in > "operate on genomic intervals" and asked it to return intervals that > innerjoin the "bin file". The subsequent steps involve grouping and > counting and then joining back to the 1st dataset (BamHI delimited > bins). I have tried this workflow on small datasets and it worked. > However when I subject my full alignment file and full BamHI > delimited > bin file, the tool fails. I am doing this on cloud. Any advice > would > be appreciated! > > Jose > > > _____________________________________________________________ > The Galaxy User list should be used for the discussion of > Galaxy analysis and other features on the public server > at usegalaxy.org <http://usegalaxy.org>. Please keep all > replies on the list by > using "reply all" in your mail client. For discussion of > local Galaxy instances and the Galaxy source code, please > use the Galaxy Development list: > > http://lists.bx.psu.edu/__listinfo/galaxy-dev > <http://lists.bx.psu.edu/listinfo/galaxy-dev> > > To manage your subscriptions to this and other Galaxy lists, > please use the interface at: > > http://lists.bx.psu.edu/ > > > -- > Jennifer Jackson > http://galaxyproject.org > > -- Jennifer Jackson http://galaxyproject.org

1 0

operate on genomic intervals
by Xianrong Wong 04 May '12

04 May '12

Hello, I have binned the mouse genome into fragments based on restriction enzyme cut sites. So each bin is a fragment flanked by say BamHI. The output file is in the interval format: chr# start and end coordinates of each bin. I want to count how many times each bin has reads that align to it. I mapped my reads using bowtie and generated a dataset (interval format) for the aligned reads. I then used join in "operate on genomic intervals" and asked it to return intervals that innerjoin the "bin file". The subsequent steps involve grouping and counting and then joining back to the 1st dataset (BamHI delimited bins). I have tried this workflow on small datasets and it worked. However when I subject my full alignment file and full BamHI delimited bin file, the tool fails. I am doing this on cloud. Any advice would be appreciated! Jose

2 1

Get flanks (version 1.0.0)
by Fabricia Nascimento 04 May '12

04 May '12

HI, I am very new to genomic data analysis and I need to get some upstream and downstream of some chromosome regions of the pig genome. I have about 70 blat hits of a query of ca 100aa. I need to get 7000 nucleotides both upstream and downstream of this 100aa region. I have tried to use Get flanks to get the "new" coordinates... bus instead of generating coordinates which would correspond to about 14000 nucleotides, it generates one coordinate for the upstream region and them another one for the downstream region. Is there a way of doing what I need using Galaxy? I would appreciate any help! Thanks a lot! All the best, Fabricia.

2 3

GMOD 2013 meeting location survey
by Scott Cain 04 May '12

04 May '12

Hello, As we are trying to plan for next years GMOD meeting, we would like to decide between two venues as soon as possible. To help us decide, we've put together a simple survey. We are asking your help in deciding between: * San Diego, California in January before or after the Plant and Animal Genomes meeting * Cambridge, England in April before or after the International Society of Biocurators meeting. Each option has its upsides: the Plant and Animal Genomes is a large meeting attended by several members of the GMOD community, so it would likely have a fairly high attendance. On the other hand, having a meeting in Cambridge would make it easier for European members of the GMOD community to attend. Please share your thoughts with us and take this survey. http://www.surveymonkey.com/s/CPC25P5 Thanks, Scott -- ------------------------------------------------------------------------ Scott Cain, Ph. D. scott at scottcain dot net GMOD Coordinator (http://gmod.org/) 216-392-3087 Ontario Institute for Cancer Research

1 0

Problem with executing larger files
by Dhanushki Samaranayake 02 May '12

02 May '12

Hi, Earlier I tried to upload larger bam files (3.5GB, 3.4GB and 4GB) to Galaxy account, but failed. Your advice was to use FTP upload at http://wiki.g2.bx.psu.edu/FTPUpload. I followed the screencast in the website and did exactly as it has advised. I used FileZilla ftp client, uploaded the files to Galaxy account and executed. Now the problem is at the execution step. For example, my 3.5GB file is accurately uploaded, but once I execute the file I get is 2.5GB. The file seems to be somehow truncated. Please advice! Thanks Dhanushki

4 5