August 2012 - galaxy-dev - lists.galaxyproject.org

Re: [galaxy-dev] [galaxy-user] LimitInternalRecursion
by Nate Coraor 22 Aug '12

22 Aug '12

On Aug 21, 2012, at 4:44 PM, Adhemar wrote: > Hi, > There's this error message in my apache log: > > [error] Request exceeded the limit of 10 subrequest nesting levels due to probable confguration error. Use 'LimitInternalRecursion' to increase the limit if necessary. Use 'LogLevel debug' to get a backtrace., referer: ... > > > When I turn the apache debug log on it also shows: > > > [debug] core.c(3072): r->uri = /galaxy/proxy:http://localhost:8080/proxy:http://localhost:8080/proxy:http://localhost:8080/proxy:http://localhost:8080/proxy:http://localhost:8080/proxy:http://localhost:8080/proxy:http://localhost:8080/proxy:http://localhost:8080/proxy:http://localhost:8080/proxy:http://localhost:8080/root/history_item_updates, referer: ... > > > It seems like mod_rewrite is somehow misconfigured, but I couldb't figure out what it is. > > Here is my httpd.con mod_rewrite conf: > > > RewriteEngine on > RewriteRule ^/galaxy$ /galaxy/ [R] > RewriteRule ^/galaxy/static/style/(.*) /opt/bioinformatics/share/galaxy-central/static/june_2007_style/blue/$1 [L] > RewriteRule ^/galaxy/static/scripts/(.*) /opt/bioinformatics/share/galaxy-central/static/scripts/packed/$1 [L] > RewriteRule ^/galaxy/static/(.*) /opt/bioinformatics/share/galaxy-central/static/$1 [L] > RewriteRule ^/galaxy/favicon.ico /opt/bioinformatics/share/galaxy-central/static/favicon.ico [L] > RewriteRule ^/galaxy/robots.txt /opt/bioinformatics/share/galaxy-central/static/robots.txt [L] > RewriteRule ^/galaxy(.*) http://localhost:8080$1 [P] Hi Adhemar, I've moved this over to the galaxy-dev list since it's concerning a local installation. Are there any other RewriteRules defined? Are these directives inside another block, or just inside a <VirtualHost>? It would be useful to see your entire VirtualHost config. --nate > > > Could you please help me to debug this? > > Thank you, > Adhemar > ___________________________________________________________ > The Galaxy User list should be used for the discussion of > Galaxy analysis and other features on the public server > at usegalaxy.org. Please keep all replies on the list by > using "reply all" in your mail client. For discussion of > local Galaxy instances and the Galaxy source code, please > use the Galaxy Development list: > > http://lists.bx.psu.edu/listinfo/galaxy-dev > > To manage your subscriptions to this and other Galaxy lists, > please use the interface at: > > http://lists.bx.psu.edu/

3 4

Re: [galaxy-dev] galaxy-dev Digest, Vol 74, Issue 21
by Adhemar 22 Aug '12

22 Aug '12

Here is a copy of the whole VirtualHost section. Thanks, Adhemar <VirtualHost lbas046.cnptia.embrapa.br:443> ServerName lbas046.cnptia.embrapa.br ErrorLog logs/galaxy_ssl_error_log TransferLog logs/galaxy_ssl_access_log LogLevel warn SSLEngine on SSLCertificateFile /etc/pki/tls/certs/lbas046.cnptia.embrapa.br.crt SSLCertificateKeyFile /etc/pki/tls/private/lbas046.cnptia.embrapa.br.key.insecure SSLCACertificateFile /etc/pki/tls/certs/cacert.pem RewriteEngine on RewriteRule ^/galaxy$ /galaxy/ [R] RewriteRule ^/galaxy/static/style/(.*) /opt/bioinformatics/share/galaxy-central/static/june_2007_style/blue/$1 [L] RewriteRule ^/galaxy/static/scripts/(.*) /opt/bioinformatics/share/galaxy-central/static/scripts/packed/$1 [L] RewriteRule ^/galaxy/static/(.*) /opt/bioinformatics/share/galaxy-central/static/$1 [L] RewriteRule ^/galaxy/favicon.ico /opt/bioinformatics/share/galaxy-central/static/favicon.ico [L] RewriteRule ^/galaxy/robots.txt /opt/bioinformatics/share/galaxy-central/static/robots.txt [L] RewriteRule ^/galaxy(.*) http://localhost:8080$1 [P] <Location "/galaxy"> AuthType Basic AuthName Galaxy_pam AuthPAM_Enabled on Require valid-user RewriteEngine On RewriteCond %{LA-U:REMOTE_USER} (.+) RewriteRule . - [E=RU:%1] RequestHeader set REMOTE_USER "%{RU}e" env=RU </Location> </VirtualHost> 9. Re: [galaxy-user] LimitInternalRecursion (Nate Coraor) ------------------------------ > > Message: 9 > Date: Wed, 22 Aug 2012 10:46:30 -0400 > From: Nate Coraor <nate(a)bx.psu.edu> > To: azneto(a)gmail.com > Cc: galaxy-dev(a)lists.bx.psu.edu > Subject: Re: [galaxy-dev] [galaxy-user] LimitInternalRecursion > Message-ID: <BD7E4946-0184-4887-9E3D-17946ADCE79A(a)bx.psu.edu> > Content-Type: text/plain; charset=iso-8859-1 > > On Aug 21, 2012, at 4:44 PM, Adhemar wrote: > > > Hi, > > There's this error message in my apache log: > > > > [error] Request exceeded the limit of 10 subrequest nesting levels due > to probable confguration error. Use 'LimitInternalRecursion' to increase > the limit if necessary. Use 'LogLevel debug' to get a backtrace., referer: > ... > > > > > > When I turn the apache debug log on it also shows: > > > > > > [debug] core.c(3072): r->uri = /galaxy/proxy: > http://localhost:8080/proxy:http://localhost:8080/proxy:http://localhost:80…, > referer: ... > > > > > > It seems like mod_rewrite is somehow misconfigured, but I couldb't > figure out what it is. > > > > Here is my httpd.con mod_rewrite conf: > > > > > > RewriteEngine on > > RewriteRule ^/galaxy$ /galaxy/ [R] > > RewriteRule ^/galaxy/static/style/(.*) > /opt/bioinformatics/share/galaxy-central/static/june_2007_style/blue/$1 [L] > > RewriteRule ^/galaxy/static/scripts/(.*) > /opt/bioinformatics/share/galaxy-central/static/scripts/packed/$1 [L] > > RewriteRule ^/galaxy/static/(.*) > /opt/bioinformatics/share/galaxy-central/static/$1 [L] > > RewriteRule ^/galaxy/favicon.ico > /opt/bioinformatics/share/galaxy-central/static/favicon.ico [L] > > RewriteRule ^/galaxy/robots.txt > /opt/bioinformatics/share/galaxy-central/static/robots.txt [L] > > RewriteRule ^/galaxy(.*) http://localhost:8080$1 [P] > > Hi Adhemar, > > I've moved this over to the galaxy-dev list since it's concerning a local > installation. > > Are there any other RewriteRules defined? Are these directives inside > another block, or just inside a <VirtualHost>? It would be useful to see > your entire VirtualHost config. > > --nate > > > > > > > Could you please help me to debug this? > > > > Thank you, > > Adhemar

1 0

Re: [galaxy-dev] admin_user not being seen
by Paul-Michael Agapow 22 Aug '12

22 Aug '12

> A peculiar quirk - I'm configuring a new Galaxy system for production > use and can't get it to recognise my account as an admin, i.e. the admin > menu doesn't appear after I've added my email address to the admin_user > line in the universe file. Of course, I've restarted the instance > multiple times, checked spelling and so forth. It's just not happening. > Complication: we're using one Galaxy instance as the webserver with > another as a job runner. I don't know if this might cause issues. Thanks to Hans-Rudolf & Peter for possible solutions. The answer actually turned out to be my fault - as said, we're running Galaxy as a one db / two installation with a webserver/job runner ... and I was putting the admin_user in the wrong universe file. Mea culpa, mea maxima culpa. ------ Paul Agapow (paul-michael.agapow(a)hpa.org.uk) Bioinformatics, Health Protection Agency (UK) ************************************************************************** The information contained in the EMail and any attachments is confidential and intended solely and for the attention and use of the named addressee(s). It may not be disclosed to any other person without the express authority of the HPA, or the intended recipient, or both. If you are not the intended recipient, you must not disclose, copy, distribute or retain this message or any part of it. This footnote also confirms that this EMail has been swept for computer viruses by Symantec.Cloud, but please re-sweep any attachments before opening or saving. HTTP://www.HPA.org.uk **************************************************************************

1 0

FTP upload - symlink to uploaded data
by Joachim Jacob 22 Aug '12

22 Aug '12

Dear devs, Question about FTP upload: is it correct that Galaxy copies the data from the FTP upload directory to galaxy database instead of symlinking? Can I set somewhere the option to symlink instead of copying? I run galaxy in a small virtual machine. The Galaxy database is on a network share. With 'get data' - 'Upload file', when importing the files I have uploaded with FTP, there is a process filling up the /tmp directory with the file I want to import. Kind regards, Joachim -- Joachim Jacob, PhD Rijvisschestraat 120, 9052 Zwijnaarde Tel: +32 9 244.66.34 Bioinformatics Training and Services (BITS) http://www.bits.vib.be @bitsatvib

2 5

Unable to read builds file: publicbuilds.txt
by Andrew Warren 21 Aug '12

21 Aug '12

Hello all, With recent additions to lib/galaxy/util/__init__.py I have started getting the following in the std out of bowtie and cufflinks (and probably other tools as well): ERROR: Unable to read builds file: [Errno 2] No such file or directory: '/mnt/galaxyTools/galaxy-central/lib/galaxy/util/../../../tool-data/shared/ucsc/publicbuilds.txt' ERROR: Unable to read builds file: [Errno 2] No such file or directory: '/mnt/galaxyTools/galaxy-central/lib/galaxy/util/../../../tool-data/shared/ensembl/builds.txt' Indeed I do not have files for publicbuilds.txt or builds.txt created. Is the best way to deal with this just to create these files (even though I am not using them)? Are these files being read every time a web transaction goes down due to the property in lib/galaxy/web/framework/__init__.py ? @property def ucsc_builds( self ): Thanks, Andrew Warren

1 0

Re: [galaxy-dev] [galaxy-user] Aggregate collections of files (example: Heatmaps)
by Peter Cock 21 Aug '12

21 Aug '12

On Tue, Aug 21, 2012 at 4:46 PM, Ted Goldstein <ted(a)soe.ucsc.edu> wrote: > I am developing several tools that will need to read and write multiple > data files at once. For example, Eisen Cluster produces a heatmap > which consists of three files: a .cdt file, .atr file and a gtr file which are > the underlying heatmap and the array tree and the gene tree. All three > files need to be kept together. I guess I could wrap them in a zip file > and pack and unpack them. The heatmap is not just a view only > object. Some tools, such as cuttree, would extract one tree and then > aggregate genes (or arrays) below a certain depth and create a new > trio of files. Is there support for (or plans for creating) any aggregate > data types? Hi Ted, There is support for composite datatypes, so this should be possible. http://wiki.g2.bx.psu.edu/Admin/Datatypes/Composite%20Datatypes This kind of discussion is normally directed to the galaxy-dev list (CC'd) Peter

1 0

Fwd: Re: [galaxy-user] Linking to Compressed Data
by Hans-Rudolf Hotz 21 Aug '12

21 Aug '12

moving to dev...... Hi Jen and Brandon well, I don't agree (or maybe I misunderstood the question/answer): we work a lot with compressed data (ie g'zipped fastq files from the sequencer), and link them as a Galaxy data library. We preselect 'fastq' as file format. And then, the first tool in our NGS analysis expects a gzipped fastq file. Regards, Hans -------- Original Message -------- Subject: Re: [galaxy-user] Linking to Compressed Data Date: Mon, 20 Aug 2012 10:32:26 -0700 From: Jennifer Jackson <jen(a)bx.psu.edu> To: Branden Timm <btimm(a)wisc.edu> CC: <galaxy-user(a)lists.bx.psu.edu> Hi Branden, Data in a library needs to be uncompressed in order for Galaxy to index and have access to it correctly. I updated our wiki for the "upload by filesystem link" option: http://wiki.g2.bx.psu.edu/Admin/Data%20Libraries/Uploading%20Library%20Files Good question! Jen Galaxy team On 8/15/12 9:09 AM, Branden Timm wrote: > Hi All, > Is it possible to link to compressed files in a Galaxy data library? > We receive all of our NGS data in bz2 or gzip format for obvious > reasons, just wondering if I have to decompress it on the filesystem > before I link to it or not. Thanks! > > -- > Branden Timm > btimm(a)glbrc.wisc.edu > ___________________________________________________________ > The Galaxy User list should be used for the discussion of > Galaxy analysis and other features on the public server > at usegalaxy.org. Please keep all replies on the list by > using "reply all" in your mail client. For discussion of > local Galaxy instances and the Galaxy source code, please > use the Galaxy Development list: > > http://lists.bx.psu.edu/listinfo/galaxy-dev > > To manage your subscriptions to this and other Galaxy lists, > please use the interface at: > > http://lists.bx.psu.edu/ -- Jennifer Jackson http://galaxyproject.org ___________________________________________________________ The Galaxy User list should be used for the discussion of Galaxy analysis and other features on the public server at usegalaxy.org. Please keep all replies on the list by using "reply all" in your mail client. For discussion of local Galaxy instances and the Galaxy source code, please use the Galaxy Development list: http://lists.bx.psu.edu/listinfo/galaxy-dev To manage your subscriptions to this and other Galaxy lists, please use the interface at: http://lists.bx.psu.edu/

4 5

Backup_strategies_for_Galaxy
by Rodolfo Aramayo 21 Aug '12

21 Aug '12

Hi, We are in the process of deploying a small Galaxy server here at Texas A&M University I am a GNU/Linux kind of guy My IT people want to use an SMB-mounted drive share as a backup destination I am concerned that this might impact the performance of the server as in my mind the equation is as follows: SMB=Microsoft=windows=not_GNU/Linux=bad_Idea But then again I am a geneticist Any comments and/or other ideas?? Thanks --Rodolfo

2 1

admin_user not being seen
by Paul-Michael Agapow 21 Aug '12

21 Aug '12

A peculiar quirk - I'm configuring a new Galaxy system for production use and can't get it to recognise my account as an admin, i.e. the admin menu doesn't appear after I've added my email address to the admin_user line in the universe file. Of course, I've restarted the instance multiple times, checked spelling and so forth. It's just not happening. Complication: we're using one Galaxy instance as the webserver with another as a job runner. I don't know if this might cause issues. Okay, any ideas what I might have missed? ------ Paul Agapow (paul-michael.agapow(a)hpa.org.uk<mailto:paul-michael.agapow@hpa.org.uk>) Bioinformatics, Health Protection Agency (UK) ************************************************************************** The information contained in the EMail and any attachments is confidential and intended solely and for the attention and use of the named addressee(s). It may not be disclosed to any other person without the express authority of the HPA, or the intended recipient, or both. If you are not the intended recipient, you must not disclose, copy, distribute or retain this message or any part of it. This footnote also confirms that this EMail has been swept for computer viruses by Symantec.Cloud, but please re-sweep any attachments before opening or saving. HTTP://www.HPA.org.uk **************************************************************************

3 2

Rsync error to datacache.g2.bx.psu.edu/indexes
by Joachim Jacob 21 Aug '12

21 Aug '12

Hi all, I'm having issues rsync'ing the reference data of Galaxy $ rsync -avvvzP rsync://datacache.g2.bx.psu.edu/indexes/phiX . opening tcp connection to datacache.g2.bx.psu.edu port 873 rsync: failed to connect to datacache.g2.bx.psu.edu (128.118.201.89): Connection timed out (110) rsync error: error in socket IO (code 10) at clientserver.c(122) [Receiver=3.0.9] [Receiver] _exit_cleanup(code=10, file=clientserver.c, line=122): about to call exit(10) Does anybody has this same issue? Or am I missing something? I have opened my firewall from any port on my laptop to the datacache site port 873 over TCP. Thanks, Joachim -- Joachim Jacob, PhD Rijvisschestraat 120, 9052 Zwijnaarde Tel: +32 9 244.66.34 Bioinformatics Training and Services (BITS) http://www.bits.vib.be @bitsatvib

1 0