Fwd: Intersect Tool
by Alexander Kurze
Dear All,
I am running my own galaxy instance and I have been using the tool
intersect (under the tab operate on genomic intervals) a few times
successfully. However, recently I get following error message:
/home/galaxy/galaxy-dist/lib/galaxy/__init__.py:79: UserWarning:
Module markupsafe was already imported from
/usr/local/lib/python2.7/dist-packages/markupsafe/__init__.pyc, but
/home/galaxy/galaxy-dist/eggs/MarkupSafe-0.12-py2.7-linux-x86_64-ucs4.egg
is being added to sys.path
self.check_version_conflict()
I googled it and there was never a straight answer. Could anyon explain how
to fix it or at least tell me what it means.
Thank you for your help in advance.
Keep up the great work!
Best wishes,
Alex
--
Alexander Kurze, DPhil
University of Oxford
Department of Biochemistry
South Parks Road
Oxford, OX1 3QU
United Kingdom
Tel: +44 1865 613 230
Fax:+44 1865 613 341
8 years, 10 months
Regarding FTP configuration
by Patra, Jibesh
Hello all:
I am setting up a local instance of galaxy server. I have followed the steps mentioned in the galaxy wiki regarding the setup. I have setup a proftpd server with postgresql authentication. But, I am getting 530 login incorrect error when trying to connect using a FTP client.
I followed the solution of a similar problem given here: http://dev.list.galaxyproject.org/ProFTPD-integration-with-Galaxy-td46602... without any success.
In the last post of the given link Mr. Tobias has posted some thing like this: "I followed the advice you offered back-channel and backed off the galaxy changes to support pbkdf2". I am unable to follow this part.
For reference-
My proftpd configuration: http://pastebin.com/LUjAyHvh
proftpd SQL log: http://pastebin.com/2psTtnZv
proftpd -l
Compiled-in modules:
mod_core.c
mod_xfer.c
mod_rlimit.c
mod_auth_unix.c
mod_auth.c
mod_ls.c
mod_log.c
mod_site.c
mod_delay.c
mod_facts.c
mod_auth_pam.c
mod_sql.c
mod_sql_postgres.c
mod_sql_passwd.c
mod_cap.c
A solution will be appreciated.
Thank you,
--
Jibesh Patra
8 years, 10 months
BWA missing index on reference genome
by Moritz Juchler
Hey,
1 I installed Galaxy locally.
2 I also have BWA installed and then used the
3 shed repository to get the bwa wrapper.
4 I have the reference genome:
> -rw-r--r-- 1 trr users 10509 2013-07-25 11:31 human_g1k_v37.dict
> -rw-r--r-- 1 trr users 3153506519 2013-07-25 11:28 human_g1k_v37.fasta
> -rw-r--r-- 1 trr users 6597 2013-07-25 19:41 human_g1k_v37.fasta.amb
> -rw-r--r-- 1 trr users 6844 2013-07-25 19:41 human_g1k_v37.fasta.ann
> -rw-r--r-- 1 trr users 3101804844 2013-07-25 19:41 human_g1k_v37.fasta.bwt
> -rw-r--r-- 1 trr users 2746 2013-07-25 11:32 human_g1k_v37.fasta.fai
> -rw-r--r-- 1 trr users 775451186 2013-07-25 19:41 human_g1k_v37.fasta.pac
> -rw-r--r-- 1 trr users 1550902424 2013-07-25 20:02 human_g1k_v37.fasta.sa
5 and I changed the bwa_index and bw_index_color.loc to the path
/genedata/human_genome_GRCh37/hg19.fa
6 This is my *$PATH*
> trr@portalmoritz:~> echo $PATH
>
> /home/trr/bin:/usr/local/bin:/usr/bin:/bin:/usr/bin/X11:/usr/X11R6/bin:/usr/games:/home/trr/bpipe-0.9.8/bin:/home/trr/bwa-0.7.5a:/home/trr/samtools-0.1.19
Is there anything I am missing? I would be glad about some help.
Best
Moritz
8 years, 10 months
Galaxy ego fetching error (Mac OS X 10.8)
by Iry Witham
Hi Team,
I am attempting to rebuild my local instance of galaxy on my Mac since having been upgraded to Mountain Lion. I have installed Mercurial, postgres, python2.7. I have cloned the latest galaxy-dist. However, when I attempted to launch galaxy with sh run.sh it fails to complete the fetch. Here is what I get:
milkyway:galaxy-dist itw$ sh run.sh
Initializing datatypes_conf.xml from datatypes_conf.xml.sample
Initializing external_service_types_conf.xml from external_service_types_conf.xml.sample
Initializing migrated_tools_conf.xml from migrated_tools_conf.xml.sample
Initializing reports_wsgi.ini from reports_wsgi.ini.sample
Initializing shed_tool_conf.xml from shed_tool_conf.xml.sample
Initializing tool_conf.xml from tool_conf.xml.sample
Initializing shed_tool_data_table_conf.xml from shed_tool_data_table_conf.xml.sample
Initializing tool_data_table_conf.xml from tool_data_table_conf.xml.sample
Initializing tool_sheds_conf.xml from tool_sheds_conf.xml.sample
Initializing data_manager_conf.xml from data_manager_conf.xml.sample
Initializing shed_data_manager_conf.xml from shed_data_manager_conf.xml.sample
Initializing openid_conf.xml from openid_conf.xml.sample
Initializing universe_wsgi.ini from universe_wsgi.ini.sample
Initializing tool-data/shared/ncbi/builds.txt from builds.txt.sample
Initializing tool-data/shared/ensembl/builds.txt from builds.txt.sample
Initializing tool-data/shared/ucsc/builds.txt from builds.txt.sample
Initializing tool-data/shared/ucsc/publicbuilds.txt from publicbuilds.txt.sample
Initializing tool-data/shared/igv/igv_build_sites.txt from igv_build_sites.txt.sample
Initializing tool-data/shared/rviewer/rviewer_build_sites.txt from rviewer_build_sites.txt.sample
Initializing tool-data/add_scores.loc from add_scores.loc.sample
Initializing tool-data/alignseq.loc from alignseq.loc.sample
Initializing tool-data/all_fasta.loc from all_fasta.loc.sample
Initializing tool-data/annotation_profiler_options.xml from annotation_profiler_options.xml.sample
Initializing tool-data/annotation_profiler_valid_builds.txt from annotation_profiler_valid_builds.txt.sample
Initializing tool-data/bfast_indexes.loc from bfast_indexes.loc.sample
Initializing tool-data/binned_scores.loc from binned_scores.loc.sample
Initializing tool-data/blastdb.loc from blastdb.loc.sample
Initializing tool-data/blastdb_p.loc from blastdb_p.loc.sample
Initializing tool-data/bowtie2_indices.loc from bowtie2_indices.loc.sample
Initializing tool-data/ccat_configurations.loc from ccat_configurations.loc.sample
Initializing tool-data/codingSnps.loc from codingSnps.loc.sample
Initializing tool-data/encode_datasets.loc from encode_datasets.loc.sample
Initializing tool-data/faseq.loc from faseq.loc.sample
Initializing tool-data/funDo.loc from funDo.loc.sample
Initializing tool-data/gatk_annotations.txt from gatk_annotations.txt.sample
Initializing tool-data/gatk_sorted_picard_index.loc from gatk_sorted_picard_index.loc.sample
Initializing tool-data/liftOver.loc from liftOver.loc.sample
Initializing tool-data/maf_index.loc from maf_index.loc.sample
Initializing tool-data/maf_pairwise.loc from maf_pairwise.loc.sample
Initializing tool-data/microbial_data.loc from microbial_data.loc.sample
Initializing tool-data/mosaik_index.loc from mosaik_index.loc.sample
Initializing tool-data/ngs_sim_fasta.loc from ngs_sim_fasta.loc.sample
Initializing tool-data/perm_base_index.loc from perm_base_index.loc.sample
Initializing tool-data/perm_color_index.loc from perm_color_index.loc.sample
Initializing tool-data/phastOdds.loc from phastOdds.loc.sample
Initializing tool-data/picard_index.loc from picard_index.loc.sample
Initializing tool-data/quality_scores.loc from quality_scores.loc.sample
Initializing tool-data/regions.loc from regions.loc.sample
Initializing tool-data/sam_fa_indices.loc from sam_fa_indices.loc.sample
Initializing tool-data/sam_fa_new_indices.loc from sam_fa_new_indices.loc.sample
Initializing tool-data/sequence_index_base.loc from sequence_index_base.loc.sample
Initializing tool-data/sequence_index_color.loc from sequence_index_color.loc.sample
Initializing tool-data/sift_db.loc from sift_db.loc.sample
Initializing tool-data/srma_index.loc from srma_index.loc.sample
Initializing tool-data/twobit.loc from twobit.loc.sample
Initializing static/welcome.html from welcome.html.sample
Some eggs are out of date, attempting to fetch...
Fetched http://eggs.galaxyproject.org/Mako/Mako-0.4.1-py2.7.egg
Fetched http://eggs.galaxyproject.org/Fabric/Fabric-1.4.2-py2.7.egg
Fetched http://eggs.galaxyproject.org/Babel/Babel-0.9.4-py2.7.egg
Fetched http://eggs.galaxyproject.org/Whoosh/Whoosh-0.3.18-py2.7.egg
Fetched http://eggs.galaxyproject.org/Parsley/Parsley-1.1-py2.7.egg
Fetched http://eggs.galaxyproject.org/lrucache/lrucache-0.2-py2.7.egg
Fetched http://eggs.galaxyproject.org/sqlalchemy_migrate/sqlalchemy_migrate-0.7.2...
Fetched http://eggs.galaxyproject.org/NoseHTML/NoseHTML-0.4.1-py2.7.egg
Fetched http://eggs.galaxyproject.org/pexpect/pexpect-2.4-py2.7.egg
Fetched http://eggs.galaxyproject.org/amqplib/amqplib-0.6.1-py2.7.egg
Fetched http://eggs.galaxyproject.org/PasteDeploy/PasteDeploy-1.5.0-py2.7.egg
Fetched http://eggs.galaxyproject.org/WebHelpers/WebHelpers-0.2-py2.7.egg
Fetched http://eggs.galaxyproject.org/docutils/docutils-0.7-py2.7.egg
Fetched http://eggs.galaxyproject.org/raven/raven-3.1.8-py2.7.egg
Fetched http://eggs.galaxyproject.org/Beaker/Beaker-1.4-py2.7.egg
Fetched http://eggs.galaxyproject.org/SVGFig/SVGFig-1.1.6-py2.7.egg
Fetched http://eggs.galaxyproject.org/NoseTestDiff/NoseTestDiff-0.1-py2.7.egg
Fetched http://eggs.galaxyproject.org/wchartype/wchartype-0.1-py2.7.egg
Fetched http://eggs.galaxyproject.org/Tempita/Tempita-0.5.1-py2.7.egg
Fetched http://eggs.galaxyproject.org/ssh/ssh-1.7.14-py2.7.egg
Fetched http://eggs.galaxyproject.org/Routes/Routes-1.12.3-py2.7.egg
Fetched http://eggs.galaxyproject.org/elementtree/elementtree-1.2.6_20050316-py2....
Fetched http://eggs.galaxyproject.org/decorator/decorator-3.1.2-py2.7.egg
Fetched http://eggs.galaxyproject.org/GeneTrack/GeneTrack-2.0.0_beta_1_dev_48da9e...
Fetched http://eggs.galaxyproject.org/WebOb/WebOb-0.8.5-py2.7.egg
Fetched http://eggs.galaxyproject.org/boto/boto-2.5.2-py2.7.egg
Fetched http://eggs.galaxyproject.org/python_daemon/python_daemon-1.5.5-py2.7.egg
Traceback (most recent call last):
File "./scripts/fetch_eggs.py", line 37, in <module>
c.resolve() # Only fetch eggs required by the config
File "/Users/itw/work/Galaxy/galaxy-dist/lib/galaxy/eggs/__init__.py", line 345, in resolve
egg.resolve()
File "/Users/itw/work/Galaxy/galaxy-dist/lib/galaxy/eggs/__init__.py", line 195, in resolve
return self.version_conflict( e.args[0], e.args[1] )
File "/Users/itw/work/Galaxy/galaxy-dist/lib/galaxy/eggs/__init__.py", line 226, in version_conflict
r = pkg_resources.working_set.resolve( ( dist.as_requirement(), ), env, egg.fetch )
File "/Users/itw/work/Galaxy/galaxy-dist/lib/pkg_resources.py", line 565, in resolve
raise DistributionNotFound(req) # XXX put more info here
pkg_resources.DistributionNotFound: mercurial==2.2.3
Fetch failed.
I have also tried to run python ./scripts/fetch_eggs.py and get the following:
milkyway:galaxy-dist itw$ python ./scripts/fetch_eggs.py
Warning: MarkupSafe (a dependent egg of Mako) cannot be fetched
Warning: pycrypto (a dependent egg of Fabric) cannot be fetched
Warning: setuptools (a dependent egg of sqlalchemy-migrate) cannot be fetched
Warning: simplejson (a dependent egg of WebHelpers) cannot be fetched
Fetched http://eggs.galaxyproject.org/ssh/ssh-1.7.14-py2.7.egg
One of Galaxy's managed eggs depends on something which is missing, this is almost certainly a bug in the egg distribution.
Dependency "ssh" requires "pycrypto>=2.1,!=2.4"
Traceback (most recent call last):
File "./scripts/fetch_eggs.py", line 37, in <module>
c.resolve() # Only fetch eggs required by the config
File "/Users/itw/work/Galaxy/galaxy-dist/lib/galaxy/eggs/__init__.py", line 345, in resolve
egg.resolve()
File "/Users/itw/work/Galaxy/galaxy-dist/lib/galaxy/eggs/__init__.py", line 168, in resolve
dists = pkg_resources.working_set.resolve( ( self.distribution.as_requirement(), ), env, self.fetch )
File "/Users/itw/work/Galaxy/galaxy-dist/lib/pkg_resources.py", line 569, in resolve
raise VersionConflict(dist,req) # XXX put more info here
pkg_resources.VersionConflict: (ssh 1.7.14 (/Users/itw/work/Galaxy/galaxy-dist/eggs/ssh-1.7.14-py2.7.egg), Requirement.parse('pycrypto>=2.1,!=2.4'))
I have looked through the Dev site and have found nothing that helps. Any ideas are welcome.
Thanks,
Iry Witham
The information in this email, including attachments, may be confidential and is intended solely for the addressee(s). If you believe you received this email by mistake, please notify the sender by return email as soon as possible.
8 years, 10 months
Problems with tophat in local instance
by Rainy Luo
Hi,all,
I am a beginner of Galaxy.Because I need to analyze large-scale NGS data
and the pubic Galaxy serve did not work out,I installed linux(the first
time to use linux) and set up the local galaxy instance in my computer. It
seemed everything worked fine until I tried to use Tophat to align the
reads to the reference genome.The problem is although I have already
downloaded the Refgenome from UCSC,when I use the Tophat,"select a
reference genome"option is empty(please see the attached file).
is there anybody having similar problem?How to deal with it?
Thanks!
Rainy
8 years, 10 months
Trouble using enumerate within <command>
by Shafer, Christina
Hello,
I'm trying to incorporate a pipeline tool into our instance of Galaxy. My tool xml uses the <repeat> tag to allow an end-user to enter a number of different fasta/fastq files with information about each of those files so that RSEM<http://deweylab.biostat.wisc.edu/rsem/> can be run on all of the files one at a time with minimal end-user input. My repeat name is Files.
To do this, I need the tool xml to loop over each file and its input parameters to put together a string of input to a perl wrapper (file is in same directory as the xml). I tried using 'enumerate' to do this within the <command> tag with perl as the interpreter, but I'm noticing some some strange behavior with ordering of statements in the tag.
Here's what I have for the tool xml's command tag (aforementioned perl wrapper is run-rsem-1.2.3.pl).
<command interpreter="perl">
#for $i, $s in enumerate( $Files )
#if $s.input.fastqmatepair.matepair=="single" #/opt/galaxy/galaxy-dist-dev/tools/ngs_rna/run-rsem-1.2.3.pl
--seed-length $s.seedlength --forward-prob $s.fprob -p $s.cpus --single_fastq $s.input.fastqmatepair.singlefastq /opt/galaxy/references/rhesus/rheMac2_ensembl_1.64/RSEM_rheMac2_ensembl_1.64
#if $s.need_bam.yes_bamfile=="yes":
--output-genome-bam
--bamfile $s.bam_res
#end if
#if $s.dostats.stat==1:
--fragment-length-mean $s.dostats.fraglenmean
--fragment-length-sd $s.dostats.fraglensd
#end if
#if $s.dorspd.rspd==1:
--estimate-rspd
--num-rspd-bins $s.dorspd.rspd_num
#end if
#end if
#end for
</command>
I must be missing something above because it does not call run-rsem-1.2.3 for each loop iteration. Do I need a break or pause or something within the tag to make this enumerate loop work correctly?
FWIW, to debug I added a print statement between the last '#end if' and the '#end for' above:
'print "loop iteration $i.\n";'
and this correctly resulted in a number of separate calls to run-rsem-1.2.3, but the literal statement "print loop iteration #.\n" was also added as an argument to the perl wrapper that caused it to quit early because too many input arguments were received.
Please let me know if anything needs clarification. Any help is much appreciated - thanks!
Christina Shafer, Ph.D
Bioinformatics Analyst
Regenerative Biology Laboratory
Morgridge Institute for Research
8 years, 10 months
Re: [galaxy-dev] HTML output with external Javascrip
by Stewart, Andrew
>>The file that Gift is producing is already an html file and there's
>>already an html datatype in Galaxy by default. The output file in
>>question just invokes remote javascript libraries inside <script> tags,
>>and this seems to be tripping up Galaxy's data viewer.
>
>Setting up relative paths to images and scripts inside your HTML output
>should work; this is done in FastQC and other similar tools.
>
>>We've tried downloading and referencing the
>>javascript libraries in /static/js as well.
>
>This should work as well and is the approach used by the rGenetics tools,
>but the path you want is /static/scripts/ Note that Galaxy already >has
>many jQuery libraries in /static/scripts/libs/jquery, which could
>simplify development.
>
>>I know that the new visualization platform in Galaxy uses a lot of
>>external javascript libraries like D3? does anyone know how that is being
>>handled differently?
>
>For now, the viz framework is a different code base that's not relevant
>for displaying datasets.
>
>Best,
>J.
Thanks Jeremy, we'll give this a shot.
-Andrew
--
Andrew Stewart
Office of Research Information Services (ORIS),
Office of the Chief Information Officer (OCIO),
Smithsonian Institution
202-633-2840
On 7/25/13 12:00 PM, "galaxy-dev-request(a)lists.bx.psu.edu"
<galaxy-dev-request(a)lists.bx.psu.edu> wrote:
>>The file that Gift is producing is already an html file and there's
>>already an html datatype in Galaxy by default. The output file in
>>question just invokes remote javascript libraries inside <script> tags,
>>and this seems to be tripping up Galaxy's data viewer.
>
>Setting up relative paths to images and scripts inside your HTML output
>should work; this is done in FastQC and other similar tools.
>
>>We've tried downloading and referencing the
>>javascript libraries in /static/js as well.
>
>This should work as well and is the approach used by the rGenetics tools,
>but the path you want is /static/scripts/ Note that Galaxy already has
>many jQuery libraries in /static/scripts/libs/jquery, which could
>simplify development.
>
>>I know that the new visualization platform in Galaxy uses a lot of
>>external javascript libraries like D3? does anyone know how that is being
>>handled differently?
>
>For now, the viz framework is a different code base that's not relevant
>for displaying datasets.
>
>Best,
>J.
>
8 years, 10 months
plain text output format
by mark.rose＠syngenta.com
Hi All
I'm trying to format one of the three outputs of my galaxy tool as plain text. Thus far no matter how I specify my output format in the tool xml file I have the same problem. When I click the eye icon it opens a save dialog rather that displaying the text output in the central frame. The preview shows the text output and if I follow through and save the output and open with wordpad it is fine. Also if I edit the attributes of the output and change it to "txt" (which is one of the formats I had tried specifying in the xml) it will render in the central frame but I would rather not have to do that. Both of my other outputs (a vcf and a tab-delimited file are rendered in the central frame properly). What can I do to fix this?
Thanks
Mark
This message may contain confidential information. If you are not the designated recipient, please notify the sender immediately, and delete the original and any copies. Any use of the message by you is prohibited.
8 years, 10 months
Re: [galaxy-dev] HTML output with external Javascript
by Stewart, Andrew
Hi Gromobir,
The file that Gift is producing is already an html file and there's
already an html datatype in Galaxy by default. The output file in
question just invokes remote javascript libraries inside <script> tags,
and this seems to be tripping up Galaxy's data viewer. We've tried
turning off the the html sanitizer, as mentioned below, but this doesn't
seem to have any effect. We've tried downloading and referencing the
javascript libraries in /static/js as well.
I know that the new visualization platform in Galaxy uses a lot of
external javascript libraries like D3Š does anyone know how that is being
handled differently?
Thanks,
Andrew
--
Andrew Stewart
Office of Research Information Services (ORIS),
Office of the Chief Information Officer (OCIO),
Smithsonian Institution
202-633-2840
On 7/23/13 12:00 PM, "galaxy-dev-request(a)lists.bx.psu.edu"
<galaxy-dev-request(a)lists.bx.psu.edu> wrote:
>On 07/23/2013 05:14 PM, Sinthong, Phanwadee wrote:
>>Hi galaxy-dev,
>>
>>I have a tool that generates a HTML output file which uses some
>>javascript library. I cannot view the output file with the eye button in
>>Galaxy, but it still works fine from the HTML file opened out of the
>>file directory.
>>I changed the sanitize_all_html = False and restarted the galaxy server
>>as some earlier post suggested but still couldn't view the output file.
>>What else can I do to execute Javascript in the Galaxy browser?
>>
>Which library are you trying to use?
>You may have to define your own datatype and add something like the
>following to the file "datatypes_conf.xml"afterwards:
>
><datatype extension="html" type="galaxay.datatypes.xml:Html"
>mimetype="application/html">
8 years, 10 months
Lumi wrapper for Galaxy
by Sachit Adhikari
Hello group,
I am trying to write lumi wrapper for Galaxy. Is anyone is writing or
already have written lumi wrapper for Galaxy. I couldn't find in both
galaxy main tool shed and test tool shed.
Regards
Sachit
8 years, 10 months
