galaxy-dev December 2012

galaxy-dev@lists.galaxyproject.org

103 participants
181 discussions

How to modify "save" icon
by Sarah Maman 10 Dec '12

10 Dec '12

Hello, The tool "SAM to BAM" generates a dataset from which it is possible to download two files (instead of one) from the icon "save". As my script generates an output result and another txt output containing information about linux command, I will wish not to generate two datasets in history but only one dataset with two files downloaded from the icon "save". Do you know how to encode the corresponding xml? Moreover, I would like to add file formats of file which can be opened in the central window central of Galaxy (thanks to "eye" icon). Do you know, please, how to add more files formats ? Thanks in advance, Sarah Mom

1 0

let galaxy use more hardware resouses
by 泽蔡 10 Dec '12

10 Dec '12

Hi all, I run a local instance of galaxy. Today, I take a look at the system monitor, I found the galaxy just use 4% of a CPU and a little bit of the memory of the PC. But the PC has twelve CPUs and 126G memory. So, how to configure the galaxy to use more hardware resouces to calculate quickly?

2 1

postgres connection
by Coldren, Christopher D 10 Dec '12

10 Dec '12

Galaxy dev: I'm installing a local galaxy instance (Dec 4, 2012 vintage) and it is running well under mySQL, but I'm having trouble getting it to work with a postgres database. I've done the following to create the db and provide permissions: $ whoami galaxy $ createdb galaxy_prod4 $ psql galaxy_prod4 psql (8.4.13) Type "help" for help. galaxy_prod4=# CREATE ROLE galaxy_prod_role4 WITH PASSWORD 'milkweed'; CREATE ROLE galaxy_prod4=# GRANT ALL PRIVILEGES ON DATABASE galaxy_prod4 to galaxy_prod_role4; GRANT galaxy_prod4=# ALTER ROLE galaxy_prod_role4 LOGIN; ALTER ROLE galaxy_prod4=# \du List of roles Role name | Attributes | Member of -------------------+--------------+----------- galaxy | Superuser | {} : Create role : Create DB galaxy_prod_role | Cannot login | {} galaxy_prod_role4 | | {} mydb_role | Cannot login | {} mydb_user | | {} postgres | Superuser | {} : Create role : Create DB galaxy_prod4=# \l List of databases Name | Owner | Encoding | Collation | Ctype | Access privileges --------------+----------+----------+-------------+-------------+------------------------------ galaxy_prod3 | galaxy | UTF8 | en_US.UTF-8 | en_US.UTF-8 | =Tc/galaxy : galaxy=CTc/galaxy : galaxy_prod_role=CTc/galaxy galaxy_prod4 | galaxy | UTF8 | en_US.UTF-8 | en_US.UTF-8 | =Tc/galaxy : galaxy=CTc/galaxy : galaxy_prod_role4=CTc/galaxy postgres | postgres | UTF8 | en_US.UTF-8 | en_US.UTF-8 | template0 | postgres | UTF8 | en_US.UTF-8 | en_US.UTF-8 | =c/postgres : postgres=CTc/postgres template1 | postgres | UTF8 | en_US.UTF-8 | en_US.UTF-8 | =c/postgres : postgres=CTc/postgres (5 rows) Looks promising, right? My universe_wsgi.ini has the following entry: database_connection = postgres:///galaxy_prod_role4:milkweed@127.0.0.1:5432/galaxy_prod4 and started the application, but it failed with: OperationalError: (OperationalError) FATAL: database "galaxy_prod_role4:milkweed@127.0.0.1<mailto:milkweed@127.0.0.1>:5432/galaxy_prod4" does not exist commenting the database_connection line out allows galaxy to start, using mySQL I presume. Any ideas? This is my first time configuring something like this. Thank you! Chris

2 1

Update some tools
by 泽蔡 09 Dec '12

09 Dec '12

Hi all, I need to deal with fastq encoding 1.8+ data, so I need the FASTX-Toolkit v0.0.13. So how to update the FASTX-Toolkit in the galaxy? By the way, I run a local instance of galaxy.

1 0

file upload/unzip issues
by Michael Moore 08 Dec '12

08 Dec '12

Hello, I and other members of my lab are encountering issues uploading (some) files to the Main public Galaxy server. We routinely upload from our local server to main.g2.bx.psu.edu via ftp using Cyberduck. In my case, on 12/6/12 I uploaded 12 zipped fastq files. Of these, 9 were completely fine. For the remaining 3 files, the transfer through Cyberduck appeared to work fine, and the files appeared (with the correct file size) on the upload screen under "Get data" as usual. However, once the files were uploaded into a Galaxy history, they were empty with a message saying "Problem decompressing gzipped data." An example is entry #45: '1PositiveRFP92112Pool41_ATCACG_L002_R1_001.fastq.gz' in my history called "Tcell_120812." My account uses this email address as the login ID (mmoore(a)rockefeller.edu). All of these files are pretty large (from 5 to 10 GB once unzipped), but the failure/success did not appear to correlate to the size of the file. I am not exceeding my space quota. In addition, I was able to successfully upload the file listed above (1PositiveRFP92112Pool41_ATCACG_L002_R1_001.fastq.gz) to our local Galaxy installation, so I don't think there is anything wrong with the file itself. However, it has failed to upload to the public galaxy server multiple times. The experience of my lab mates is similar; some of their files are uploading correctly, and others are having the same problem I described above. We can't seem to find anything common among the files that are failing to upload. For instance, they span different sequencing runs and were deposited on our local server at different times Has anyone else been encountering similar issues ? Please let me know if I should direct this question elsewhere or if I can provide any further information. Thanks very much for your time. Michael Moore Rockefeller University

1 0

counting number of dataset files on the file system
by Shantanu Pavgi (Campus) 07 Dec '12

07 Dec '12

I am recovering lost dataset files from the file system and I need to verify number of recovered files with corresponding dataset records count in the database. Should number of dataset files on the file system match count obtained using following query? $ select count(*) from dataset where deleted='f'; Appreciate any help on further improving this check. -- Thanks, Shantanu

1 0

FW: newbie uploader
by Banday, Abdul 07 Dec '12

07 Dec '12

________________________________________ From: Banday, Abdul Sent: Friday, December 07, 2012 2:57 PM To: nate(a)bx.psu.edu Subject: RE: [galaxy-dev] newbie uploader Hi Nate, I appreciate your response. I just loaded the file named s_6_1_sequence.txt.gz under the login name abdul.banday(a)uconn.edu. Could you check the file and reply me back about the concerns if any? Regards Rouf ________________________________________ From: Smith, Therese [tms08012(a)engr.uconn.edu] Sent: Friday, December 07, 2012 11:59 AM To: Nate Coraor Subject: RE: [galaxy-dev] newbie uploader Hi Nate, Will do. Thank you. ________________________________________ From: Nate Coraor [nate(a)bx.psu.edu] Sent: Friday, December 07, 2012 11:39 AM To: Smith, Therese Cc: galaxy-dev(a)bx.psu.edu Subject: Re: [galaxy-dev] newbie uploader On Dec 6, 2012, at 7:16 PM, Smith, Therese wrote: > Dear Sir or Madam, > We are using DOS prompt ftp, we connected, we sent (8Gbytes), and we received a succcessful completion message from ftp, we saw the file appearing on your page as having been ftp'd to you, however, we received an upload error message, namely: > > 34: s_8_1_sequence.txt.gz > error > An error occurred running this job: Traceback (most recent call last): File "/galaxy/home/g2main/galaxy_main/tools/data_source/upload.py", line 384, in__main__() File "/galaxy/home/g2main/galaxy_main/tools/data_source/upload.py", line 373, in __main__ add_file( dataset > > We are trying again, with binary channel in ftp,and also would be glad of your advice. > > Our Galaxy login is: abdul.banday(a)uconn.edu Hi Therese, If you could send back an email after your file has finished uploading, but not run the upload tool on it, we can check to make sure it's okay on our filesystem before you attempt to import, and also test importing it ourselves. Thanks, --nate > > Sincerely, > Rouf and Therese > > ___________________________________________________________ > Please keep all replies on the list by using "reply all" > in your mail client. To manage your subscriptions to this > and other Galaxy lists, please use the interface at: > > http://lists.bx.psu.edu/

1 0

Cannot see data when selecting "Display Data in Browser"
by Dave Walton 07 Dec '12

07 Dec '12

I'm seeing some weird behavior in our local galaxy instance and am wondering if anyone has seen anything similar. I have a custom tool that I've written that generates a tab-delimted file. When I click on the item name in the history, I can see the contents in the "preview" window. However, when I click on the eye (Display Data in Browser), it comes up empty. Same thing if I download the file. However, if I go to the database directory to examine the file on disk, the content is exactly what I would expect. The permissions on the file are galaxy user/group and the file has permissions of 644. I don't see any reason why I shouldn't be able to view or download this file through galaxy. Any ideas? Thanks, Dave --- Dave Walton Manager Scientific Computing The Jackson Laboratory Bar Harbor, Maine Dave.walton(a)jax.org The information in this email, including attachments, may be confidential and is intended solely for the addressee(s). If you believe you received this email by mistake, please notify the sender by return email as soon as possible.

2 1

Defunct munge processes using Torque PBS
by Matthew Shirley 07 Dec '12

07 Dec '12

I am fairly new to PBS management, so I can't rule out some misconfiguration, but I have a strange issue when running Galaxy with the PBS job runner. It seems that munge spawns a bunch of defunct processes after running Galaxy on my cluster: `ps axjf`: 1 25992 25991 25991 ? -1 Sl 77777 8:48 python ./scripts/paster.py serve universe_wsgi.ini --daemon 25992 26032 25991 25991 ? -1 Z 77777 0:00 \_ [munge] <defunct> 25992 26034 25991 25991 ? -1 Z 77777 0:00 \_ [munge] <defunct> 25992 26036 25991 25991 ? -1 Z 77777 0:00 \_ [munge] <defunct> Now, these processes are being spawned by Galaxy, and I can't figure out why. Can anyone provide some insight or clues about where to start debugging this? Thanks, Matt

2 2

error when looking at tool error
by Andreas Kuntzagk 07 Dec '12

07 Dec '12

If I click on the small "bug" icon for a dataset in error state, I get this message in the log: URL: http://bbc.mdc-berlin.de/galaxy/dataset/errors?id=e96c6ce43a3d239a File '/data/galaxy/galaxy-dist/eggs/Paste-1.6-py2.6.egg/paste/exceptions/errormiddleware.py', line 143 in __call__ app_iter = self.application(environ, start_response) File '/data/galaxy/galaxy-dist/eggs/Paste-1.6-py2.6.egg/paste/recursive.py', line 80 in __call__ return self.application(environ, start_response) File '/data/galaxy/galaxy-dist/eggs/Paste-1.6-py2.6.egg/paste/httpexceptions.py', line 632 in __call__ return self.application(environ, start_response) File '/data/galaxy/galaxy-dist/lib/galaxy/web/framework/base.py', line 160 in __call__ body = method( trans, **kwargs ) File '/data/galaxy/galaxy-dist/lib/galaxy/webapps/galaxy/controllers/dataset.py', line 171 in errors hda = trans.sa_session.query( model.HistoryDatasetAssociation ).get( id ) File '/data/galaxy/galaxy-dist/eggs/SQLAlchemy-0.5.6_dev_r6498-py2.6.egg/sqlalchemy/orm/query.py', line 507 in get return self._get(key, ident) File '/data/galaxy/galaxy-dist/eggs/SQLAlchemy-0.5.6_dev_r6498-py2.6.egg/sqlalchemy/orm/query.py', line 1500 in _get return q.all()[0] File '/data/galaxy/galaxy-dist/eggs/SQLAlchemy-0.5.6_dev_r6498-py2.6.egg/sqlalchemy/orm/query.py', line 1267 in all return list(self) File '/data/galaxy/galaxy-dist/eggs/SQLAlchemy-0.5.6_dev_r6498-py2.6.egg/sqlalchemy/orm/query.py', line 1361 in __iter__ return self._execute_and_instances(context) File '/data/galaxy/galaxy-dist/eggs/SQLAlchemy-0.5.6_dev_r6498-py2.6.egg/sqlalchemy/orm/query.py', line 1364 in _execute_and_instances result = self.session.execute(querycontext.statement, params=self._params, mapper=self._mapper_zero_or_none()) File '/data/galaxy/galaxy-dist/eggs/SQLAlchemy-0.5.6_dev_r6498-py2.6.egg/sqlalchemy/orm/session.py', line 755 in execute clause, params or {}) File '/data/galaxy/galaxy-dist/eggs/SQLAlchemy-0.5.6_dev_r6498-py2.6.egg/sqlalchemy/engine/base.py', line 824 in execute return Connection.executors[c](self, object, multiparams, params) File '/data/galaxy/galaxy-dist/eggs/SQLAlchemy-0.5.6_dev_r6498-py2.6.egg/sqlalchemy/engine/base.py', line 874 in _execute_clauseelement return self.__execute_context(context) File '/data/galaxy/galaxy-dist/eggs/SQLAlchemy-0.5.6_dev_r6498-py2.6.egg/sqlalchemy/engine/base.py', line 896 in __execute_context self._cursor_execute(context.cursor, context.statement, context.parameters[0], context=context) File '/data/galaxy/galaxy-dist/eggs/SQLAlchemy-0.5.6_dev_r6498-py2.6.egg/sqlalchemy/engine/base.py', line 950 in _cursor_execute self._handle_dbapi_exception(e, statement, parameters, cursor, context) File '/data/galaxy/galaxy-dist/eggs/SQLAlchemy-0.5.6_dev_r6498-py2.6.egg/sqlalchemy/engine/base.py', line 931 in _handle_dbapi_exception raise exc.DBAPIError.instance(statement, parameters, e, connection_invalidated=is_disconnect) DataError: (DataError) invalid input syntax for integer: "e96c6ce43a3d239a" 'SELECT history_dataset_association.id AS history_dataset_association_id, history_dataset_association.history_id AS history_dataset_association_history_id, history_dataset_association.dataset_id AS history_dataset_association_dataset_id, history_dataset_association.create_time AS history_dataset_association_create_time, history_dataset_association.update_time AS history_dataset_association_update_time, history_dataset_association.state AS history_dataset_association_state, history_dataset_association.copied_from_history_dataset_association_id AS history_dataset_association_copied_from_history_dataset_a_1, history_dataset_association.copied_from_library_dataset_dataset_association_id AS history_dataset_association_copied_from_library_dataset_d_2, history_dataset_association.hid AS history_dataset_association_hid, history_dataset_association.name AS history_dataset_association_name, history_dataset_association.info AS history_dataset_association_info, history_dataset_association.blurb AS history_dataset_association_blurb, history_dataset_association.peek AS history_dataset_association_peek, history_dataset_association.tool_version AS history_dataset_association_tool_version, history_dataset_association.extension AS history_dataset_association_extension, history_dataset_association.metadata AS history_dataset_association_metadata, history_dataset_association.parent_id AS history_dataset_association_parent_id, history_dataset_association.designation AS history_dataset_association_designation, history_dataset_association.deleted AS history_dataset_association_deleted, history_dataset_association.purged AS history_dataset_association_purged, history_dataset_association.visible AS history_dataset_association_visible, dataset_1.id AS dataset_1_id, dataset_1.create_time AS dataset_1_create_time, dataset_1.update_time AS dataset_1_update_time, dataset_1.state AS dataset_1_state, dataset_1.deleted AS dataset_1_deleted, dataset_1.purged AS dataset_1_purged, dataset_1.purgable AS dataset_1_purgable, dataset_1.object_store_id AS dataset_1_object_store_id, dataset_1.external_filename AS dataset_1_external_filename, dataset_1._extra_files_path AS dataset_1__extra_files_path, dataset_1.file_size AS dataset_1_file_size, dataset_1.total_size AS dataset_1_total_size \nFROM history_dataset_association LEFT OUTER JOIN dataset AS dataset_1 ON dataset_1.id = history_dataset_association.dataset_id \nWHERE history_dataset_association.id = %(param_1)s' {'param_1': u'e96c6ce43a3d239a'} Looks like the id for the dataset is wrong. How can this happen and how can I fix this? regards, Andreas -- Andreas Kuntzagk SystemAdministrator Berlin Institute for Medical Systems Biology at the Max-Delbrueck-Center for Molecular Medicine Robert-Roessle-Str. 10, 13125 Berlin, Germany http://www.mdc-berlin.de/en/bimsb/BIMSB_groups/Dieterich

2 1

← Newer
1
...
10
11
12
13
14
15
16
...
19
Older →

Jump to page:

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

galaxy-dev December 2012