transferring sample datasets stuck in 'In queue' status
Hi, I set up the rabbitmq-server and created an exchange and queue with a routing key. My setup is allowing the dataset status to change to 'In queue' from 'Not started' without any error messages. However the dataset doesn't seem to actually be transferred. It is just left in the queue. Is there something else that I need to be doing? Any ideas to what the problem might be are appreciated. Thanks, Natalie
Follow the following steps before you start transferring datasets. 1. Open transfer_datasets.ini (should be in Galaxy root directory) and fill out the 'data_transfer_user_login_info' section with a new admin user which will be used by Galaxy to programmatically login to Galaxy to upload the datasets. Fill out the user email and password. Then copy the 'host', 'port', 'database_connection' & 'library_import_dir' config variables from your universe_wsgi.ini file and fill the universe_wsgi_config section. 2. Add the admin user email used above and add it to the 'admin_users' variable in universe_wsgi.ini 3. Start Galaxy 4. On a separate terminal start the listener script: $ nohup sh run_galaxy_listener.sh This script listens to any data transfer messages received through RabbitMQ and starts another process to transfer the datasets. You can monitor its log in galaxy_listener.log and the data_transfer.log. 5. It is advised that you create password-less login to the sequencer from the Galaxy server. Here is a helpful howto: http://www.freebsdwiki.net/index.php/Ssh,_passwordless_authentication Now you should be able to transfer datasets. Let me know if it worked for you. rc On Sep 15, 2010, at 10:11 AM, nsfox@uwaterloo.ca wrote:
Hi,
I set up the rabbitmq-server and created an exchange and queue with a routing key. My setup is allowing the dataset status to change to 'In queue' from 'Not started' without any error messages. However the dataset doesn't seem to actually be transferred. It is just left in the queue. Is there something else that I need to be doing? Any ideas to what the problem might be are appreciated.
Thanks, Natalie
_______________________________________________ galaxy-dev mailing list galaxy-dev@lists.bx.psu.edu http://lists.bx.psu.edu/listinfo/galaxy-dev
Thanks, My problem was that I did not run the listener. I'm having a little trouble with the listener/step 4. I start up the listener and it runs until the I actually try to transfer something. Then it stops running. From nohup.out: Traceback (most recent call last): File "scripts/galaxy_messaging/server/amqp_consumer.py", line 159, in <module> main() File "scripts/galaxy_messaging/server/amqp_consumer.py", line 153, in main chan.wait() File "build/bdist.linux-x86_64-ucs4/egg/amqplib/client_0_8/abstract_channel.py", line 107, in wait File "build/bdist.linux-x86_64-ucs4/egg/amqplib/client_0_8/channel.py", line 1973, in _basic_deliver File "scripts/galaxy_messaging/server/amqp_consumer.py", line 88, in recv_callback config.get("app:main", "id_secret") ) File "/System/Library/Frameworks/Python.framework/Versions/2.5/lib/python2.5/ConfigParser.py", line 520, in get raise NoOptionError(option, section) ConfigParser.NoOptionError: No option 'id_secret' in section: 'app:main' galaxy_listener.log just says: 2010-09-15 14:02:26,140 - GalaxyAMQP - {'exchange': 'galaxy_exchange', 'userid': 'galaxy', 'routing_key': 'bar_code_scanner', 'queue': 'galaxy_queue', 'host': '0.0.0.0', 'virtual_host': 'galaxy_messaging_engine', 'password': 'galaxy', 'port': '5672'} 2010-09-15 14:06:27,351 - GalaxyAMQP - MESSAGE RECVD: data_transfer 2010-09-15 14:06:27,352 - GalaxyAMQP - DATA TRANSFER and the data_transfer.log doesn't seem to be created yet. Any idea what is wrong? Natalie Quoting Ramkrishna Chakrabarty <rc@bx.psu.edu>:
Follow the following steps before you start transferring datasets.
1. Open transfer_datasets.ini (should be in Galaxy root directory) and fill out the 'data_transfer_user_login_info' section with a new admin user which will be used by Galaxy to programmatically login to Galaxy to upload the datasets. Fill out the user email and password. Then copy the 'host', 'port', 'database_connection' & 'library_import_dir' config variables from your universe_wsgi.ini file and fill the universe_wsgi_config section.
2. Add the admin user email used above and add it to the 'admin_users' variable in universe_wsgi.ini
3. Start Galaxy
4. On a separate terminal start the listener script: $ nohup sh run_galaxy_listener.sh This script listens to any data transfer messages received through RabbitMQ and starts another process to transfer the datasets. You can monitor its log in galaxy_listener.log and the data_transfer.log.
5. It is advised that you create password-less login to the sequencer from the Galaxy server. Here is a helpful howto: http://www.freebsdwiki.net/index.php/Ssh,_passwordless_authentication
Now you should be able to transfer datasets. Let me know if it worked for you.
rc
On Sep 15, 2010, at 10:11 AM, nsfox@uwaterloo.ca wrote:
Hi,
I set up the rabbitmq-server and created an exchange and queue with a routing key. My setup is allowing the dataset status to change to 'In queue' from 'Not started' without any error messages. However the dataset doesn't seem to actually be transferred. It is just left in the queue. Is there something else that I need to be doing? Any ideas to what the problem might be are appreciated.
Thanks, Natalie
_______________________________________________ galaxy-dev mailing list galaxy-dev@lists.bx.psu.edu http://lists.bx.psu.edu/listinfo/galaxy-dev
participants (2)
-
nsfox@uwaterloo.ca
-
Ramkrishna Chakrabarty