Hi everyone, I'd like to upload my sequencing data file, 36 GB, onto galaxy. My data is on a computer cluster in my institute. So I use ssh shell ftp commands to connect to galaxy and upload the data(ftp> put filename). And the connection appears to be fine as far as I can tell. I tried few times. Every time the uploading is fine in the beginning. However, when about 12 GB of my dataset is uploaded (according to Galaxy upload file page), the upload stops, and an error message pop up in the terminal on my Mac saying "a broken pipeline". I never had this problem before when I was using FTP programs like CyberDuck. Has anyone have similar problems using ssh command lines to upload data? What's the correct way to upload data from a computer cluster? Thanks in advance for your help. -Eric
On Dec 28, 2011, at 10:36 AM, Eric Guo wrote:
Hi everyone,
I'd like to upload my sequencing data file, 36 GB, onto galaxy. My data is on a computer cluster in my institute. So I use ssh shell ftp commands to connect to galaxy and upload the data(ftp> put filename). And the connection appears to be fine as far as I can tell.
I tried few times. Every time the uploading is fine in the beginning. However, when about 12 GB of my dataset is uploaded (according to Galaxy upload file page), the upload stops, and an error message pop up in the terminal on my Mac saying "a broken pipeline".
I never had this problem before when I was using FTP programs like CyberDuck. Has anyone have similar problems using ssh command lines to upload data? What's the correct way to upload data from a computer cluster?
Thanks in advance for your help.
Hi Eric, I'm not sure what's causing the connection to die, but I'd suggest using rsync so at least it can be resumed. --nate
-Eric ___________________________________________________________ The Galaxy User list should be used for the discussion of Galaxy analysis and other features on the public server at usegalaxy.org. Please keep all replies on the list by using "reply all" in your mail client. For discussion of local Galaxy instances and the Galaxy source code, please use the Galaxy Development list:
http://lists.bx.psu.edu/listinfo/galaxy-dev
To manage your subscriptions to this and other Galaxy lists, please use the interface at:
participants (2)
-
Eric Guo
-
Nate Coraor