- galaxy-dev - lists.galaxyproject.org

Setting up Galaxy without e-mail
by Raymond Wan 29 Jul '15

29 Jul '15

Dear all, I just started setting up a galaxy instance and I'm a bit stuck with user account activation without e-mail. Is it possible to run Galaxy without an SMTP server set? For example, for the administrator user, I set: admin_users = <my e-mail> in galaxy.ini . I'd also like to require login (i.e., require_login = True) but it seems that I can't do that from the outset. That has to be False and allow_user_creation has to be True. Then I can create a user with the same account as above, who will then become an administrator. But, the account has to be validated some how and I can't seem to figure out how to do that without enabling an SMTP server. Am I doing something that wasn't intended? Perhaps I must have an SMTP server set? Or are there other steps I should do to activate the administrator? The web page https://wiki.galaxyproject.org/Admin/GetGalaxy makes it look easy...so I am concerned I'm doing it all wrong... Also, if this instance will be a production system some day, should I start using a database (Postgres or MySQL) right away and not bother with the default SQLite? Otherwise, I will have to port the data over, which the documentation implies is not an easy thing to do... Thank you! Ray

2 2

tool with multiple undefined output datasets
by Sabrina Legoueix Rodriguez 29 Jul '15

29 Jul '15

Hi, I am trying to develop a tool to untar, unzip... an archive file in order to obtain each file contained in the archive as a dataset in the current history. My problem is about the unknown various number of files contained within the archive file. I was thinking about having an output variable in my .xml that would be fed by my wrapper and returned in order to filter the number of outputs in my .xml ; but the <output> section in the .xml can only get "files" not numbers, right? In my tool, I ask the user to fill the number of files he wants from the archive ; in .xml I have put 10 outputs for files contained in the archive (out1, out2...) precised in my command and in the output section (for now I can retrieve maximum 10 outputs from my archive). In the output section, I would like to use <filter> tag in order to select only the output number inferior than the number specified by the user: <outputs> <data name="output_uncomp1" format="${uncompressed_files_format}" label="${input_compressed.name}_1"/> <data name="output_uncomp2" format="${uncompressed_files_format}" label="${input_compressed.name}_2"> <filter>num_uncompressed_files >= "2"</filter> </data> <data name="output_uncomp3" format="${uncompressed_files_format}" label="${input_compressed.name}_3"> <filter>num_decompressed_files>= "3"</filter> </data> It does not seem to work well. Could you please tell me if it is possible to use the filter tag as such? If so, how? Would you have a better idea to implement that tool? Thanks in advance, best regards, -- Signature e-mail TWB Sabrina *Attention changement de coordonnées à partir du 15 Juin 2015:* **Sabrina LEGOUEIX RODRIGUEZ** Responsable Plateau Bioinformatique Tél. : +33 (0) 5 61 28 57 92 sabrina.legoueix(a)toulouse.inra.fr <mailto:[MAIL]> www.toulouse-white-biotechnology.com <http://www.toulouse-white-biotechnology.com/> LinkedIn <https://www.linkedin.com/company/2757525h> Twitter <https://twitter.com/TWB_Biotech> TWB - Parc technologique du canal • Bâtiment NAPA CENTER B • 3, rue Ariane • 31520 Ramonville Saint-Agne Ce message et ses pièces jointes sont strictement personnels. Ils peuvent contenir des informations confidentielles. Si vous avez reçu ce message par erreur, merci d'en avertir l'expéditeur et de détruire le message et les documents joints. Toute utilisation des informations reçues par erreur est interdite. This message and the attachments are strictly personal. They may contain confidential information. If you have received this message in error, please notify the sender and delete the message and the attachments. Any use of this communication received in error is prohibited.

2 1

Galaxy Torque
by Benjamin Datko 29 Jul '15

29 Jul '15

Hello all, I am trying to config a cluster galaxy server using PBS torque. I have gone through the documentation but it is not clear to me how the job_conf.xml should be set up. Are there detailed documents on how galaxy works with the resource manger and how galaxy submits jobs? My current problem jobs can be created and submitted but within the history tab I have "this job is waiting to run". The job never gets submitted to PBS torque queue and cannot be seen using qstat. My job_conf.xml is shown below. If anyone can give a sample to a working configuration file for job_conf.xml using PBS torque that will be most appreciated. Ben <?xml version="1.0"?>  <job_conf> <plugins> <plugin id="pbs" type="runner" load="galaxy.jobs.runners.pbs:PBSJobRunner"/> </plugins> <handlers> <handler id="main"/> </handlers> <destinations default="Core2"> <destination id="Core2" runner="pbs"> <param id="Resource_List">-l walltime=24:00:00,nodes=1:ppn=2</param> </destination> </destinations> </job_conf>

2 3

I need some advice on what type of Galaxy server to implement
by Shane Kelly 29 Jul '15

29 Jul '15

Hi I have been tasked with getting a Galaxy server up and running for a group at work. 1. No-one can tell me how many users (concurrent or otherwise) there will be 2. Most of the analyses will be NGS. 3. Tools will be developed in-house but we will use public domain tools also. 4. There will be a guy running the server/developing tools pretty much full time. I have two favoured solutions at the moment: 1. A pipeline processor ( 64 Core, 512G Ram, with DAS of about 150TB ), and a Web server to act as frontend and database server, and another, smaller box for a total install of galaxy, but doing only the development work. 2. An all-in-one server with 128 Cores, 1TB ram, DAS storage of 150TB, and development work done on a VM. Any input would be hepfull. Thanks Shane

3 4

Cannot import or download workflow
by Jeltje van Baren 28 Jul '15

28 Jul '15

Hi, I'm running the bgruening/galaxy-stable docker image. After making some changes to the tools, I can no longer upload workflows. How do I debug? What I get from the server is Internal Server Error Galaxy was unable to successfully complete your request An error occurred. This may be an intermittent problem due to load or other unpredictable factors, reloading the page may address the problem. *The error has been logged to our team.* Since I am 'our team', I'd like to find out how to see the log! None of the logs under /home/galaxy indicate a problem (that I notice), but uwsgi.log does list a GET command for the workflow: [28/Jul/2015:16:31:50 +0000] "GET /api/datatypes?extension_only=False& HTTP/1.1" 200 - "http://128.114.61.147:8080/workflow/import_workflow" "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:39.0) Gecko/20100101 Firefox/39.0" I figured it was an issue with the workflow, so I created a simple workflow on the same galaxy instance. When I tried to download the workflow file, I got the exact same error. Restarting the instance (several times) didn't help. How do I get more info on these errors? Thanks, -Jeltje

1 0

Re: [galaxy-dev] problems installing htseq in local Galaxy
by Lance Parsons 28 Jul '15

28 Jul '15

Hi Ramon, I'm sorry your' having problems with the htseq-count tool. Could you elaborate a bit on an error messages you see for the missing tool dependencies? You should be able to click on those repositories that show missing dependencies and see which ones are not properly installed and then clicking on those get to an error message. I know there has been an issue with the freetype_2_4 package, at least for me, I am unable to download the file from sourceforge at the moment. Also, there has been a bug that can cause some fairly tough to trace errors during installation that was recently patched: https://github.com/galaxyproject/galaxy/pull/403. I've also copied this message to the galaxy-dev mailing list in case anyone there has additional insight. - Lance > Garcia Escudero, Ramon <mailto:ramon.garcia@ciemat.es> > July 28, 2015 at 7:17 AM > Dear Lance, > > I'm having problems installing "htseq-count wrapper for Galaxy" in my > local galaxy from the Galaxy Toolshed at > https://toolshed.g2.bx.psu.edu/repository?repository_id=2df7e24ce6c1f224 > > Main problems include missing tool dependencies for > > htseq > package freetype > package imaging > package matplotlib > > I'm runing ubuntu 14.04 LTS > > Coul you help me with this problem? > > Many thanks > > Ramon > ---------------------------- > Confidencialidad: > Este mensaje y sus ficheros adjuntos se dirige exclusivamente a su > destinatario y puede contener informaci?n privilegiada o confidencial. > Si no es vd. el destinatario indicado, queda notificado de que la > utilizaci?n, divulgaci?n y/o copia sin autorizaci?n est? prohibida en > virtud de la legislaci?n vigente. Si ha recibido este mensaje por > error, le rogamos que nos lo comunique inmediatamente respondiendo al > mensaje y proceda a su destrucci?n. > > Disclaimer: > This message and its attached files is intended exclusively for its > recipients and may contain confidential information. If you received > this e-mail in error you are hereby notified that any dissemination, > copy or disclosure of this communication is strictly prohibited and > may be unlawful. In this case, please notify us by a reply and delete > this email and its contents immediately. > ---------------------------- > -- Lance Parsons - Scientific Programmer 134 Carl C. Icahn Laboratory Lewis-Sigler Institute for Integrative Genomics Princeton University

1 0

Reasons to choose psql over mysql or not
by Eric Kuyt 28 Jul '15

28 Jul '15

Hi All, We are thinking of putting our galaxy instance in a new more powerful environment. Galaxy is now on a single server containing a psql database which is migrated from mysql a few years ago. The new environment already houses a really nice backupped highly available mysql server. as galaxy admin I am quite reluctant of migrating back to mysql, the system admin is quite reluctant of installing this psql database with the same grade of backup and availability just for galaxy. I could only come up with the line "*PostgreSQL is much preferred since we've found it works better with our DB abstraction layer, SQLAlchemy <http://www.sqlalchemy.org/>.*" from the galaxy wiki, which is a rather slim argument. My question now is. Is Postgres still the preferred database or is Mysql now also a safe bet. For mysql we would have to migrate back, system management would have a lot of experience tuning databases and a high quality instance is already running. For Psql a new database instance would have to be installed, less knowledge of the database system is available but it is the preferred database. Could someone point out some more pros and cons in this question? Thanks, Eric -- Central Veterinary Institute of Wageningen UR (CVI) Department of Infection Biology PO box 65, 8200 AB Lelystad, NL Visiting address: ASG, Edelhertweg 15, 8219 PH Lelystad Tel: +31-(0)320-293391 Fax: +31-(0)320-238153 E-mail: eric.kuijt(a)wur.nl Web: http://www.cvi.wur.nl

3 2

bwa mem index builder error
by Stef van Lieshout 27 Jul '15

27 Jul '15

Hi all, Maybe someone can help with a question I posted at biostars about a week ago but have no solution yet.. https://biostar.usegalaxy.org/p/13206/ Its about a bwa mem index builder error. If anyone could help me out on this...! Stef

1 0

Re: [galaxy-dev] Reasons to choose psql over mysql or not
by Eric Kuyt 27 Jul '15

27 Jul '15

Hi Hans-Rudolf Thanks for the swift reply. So the (Psql > Mysql ) still stands in 2015 that's kind of a pity, installing psql is not a problem but fixing a crashed database (which never happened to us on our mysql -> psql migrated database) would still be me pushing some buttons to fix everything and I know for sure that these sysadmins are better in documenting stuff and following SLA's But a perfect running galaxy server would be concern nr 1. For your concerns about your migration. If "sh manage_db.sh upgrade" works on your new or test psql database after a galaxy upgrade I think you're safe. Eric On 27 July 2015 at 15:35, Hans-Rudolf Hotz <hrh(a)fmi.ch> wrote: > Hi Eric > > Well, there is no official statement besides the one you have quoted > below, but anyone in the Galaxy team I have spoken to recently told me > to move to PostgreSQL. > > And that's why, I've been through the painful process of migrating our > MySQL database to a PostgreSQl database. Actually, the switch for our > production server just happened this morning - and I am still anxious > whether I have done everything correctly. > > Our system admin also prefers MySQl. Hence I had to set up my own > PostgreSQL server. And now, I am running the back-ups myself. > > > For your case: why not moving the Galaxy server to the "new more > powerful environment" but still connected to the old PostgreSQL server? > I don't think the database server (unless it is sqlite) is ever the > bottleneck, is-it? > > > Regards, Hans-Rudolf > > > On 07/27/2015 02:35 PM, Eric Kuyt wrote: > > Hi All, > > > > We are thinking of putting our galaxy instance in a new more powerful > > environment. Galaxy is now on a single server containing a psql database > > which is migrated from mysql a few years ago. > > The new environment already houses a really nice backupped highly > > available mysql server. > > > > as galaxy admin I am quite reluctant of migrating back to mysql, the > > system admin is quite reluctant of installing this psql database with > > the same grade of backup and availability just for galaxy. > > > > I could only come up with the line "/PostgreSQL is much preferred since > > we've found it works better with our DB abstraction layer, SQLAlchemy > > <http://www.sqlalchemy.org/>./" from the galaxy wiki, which is a rather > > slim argument. > > > > My question now is. > > > > Is Postgres still the preferred database or is Mysql now also a safe bet. > > > > For mysql we would have to migrate back, system management would have a > > lot of experience tuning databases and a high quality instance is > > already running. > > > > For Psql a new database instance would have to be installed, less > > knowledge of the database system is available but it is the preferred > > database. > > > > Could someone point out some more pros and cons in this question? > > > > Thanks, > > > > Eric > > > > -- > > Central Veterinary Institute of Wageningen UR (CVI) > > Department of Infection Biology > > PO box 65, 8200 AB Lelystad, NL > > Visiting address: ASG, Edelhertweg 15, 8219 PH Lelystad > > > > Tel: +31-(0)320-293391 > > Fax: +31-(0)320-238153 > > E-mail: eric.kuijt(a)wur.nl <mailto:eric.kuijt@wur.nl> > > Web:http://www.cvi.wur.nl <http://www.cvi.wur.nl> > > > > > > ___________________________________________________________ > > Please keep all replies on the list by using "reply all" > > in your mail client. To manage your subscriptions to this > > and other Galaxy lists, please use the interface at: > > https://lists.galaxyproject.org/ > > > > To search Galaxy mailing lists use the unified search at: > > http://galaxyproject.org/search/mailinglists/ > > > -- Central Veterinary Institute of Wageningen UR (CVI) Department of Infection Biology PO box 65, 8200 AB Lelystad, NL Visiting address: ASG, Edelhertweg 15, 8219 PH Lelystad Tel: +31-(0)320-293391 Fax: +31-(0)320-238153 E-mail: eric.kuijt(a)wur.nl Web: http://www.cvi.wur.nl

1 0

ERROR in Galaxy
by Stephanie Beck Roth 27 Jul '15

27 Jul '15

I have been receiving the following error for over an hour: The server could not complete the request. Please contact the Galaxy Team if this error persists. { "outputs": [], "implicit_collections": [], "jobs": [], "output_collections": [] } ____________________________________________________________________ Stephanie R Beck Roth, PhD Assistant Professor of Mathematics Potomac State College of WVU 101 Fort Ave. Keyser, WV 26726 (304) 788 – 7118 Stephanie.BeckRoth(a)mail.wvu.edu<mailto:Stephanie.BeckRoth@mail.wvu.edu> “If you come to a fork in the road, take it.” ~ Yogi Berra “Nothing will work unless you do.” ~Maya Angelou

2 1