Reposted to the Development list for the benefit of those not on the User list.
Hello,
With the continued advancement of sequencing technology, we've seen the size of files uploaded to Galaxy grow quite large. Although our current file upload methods have worked fine for years, they are not well suited for the extremely large files in common use today. Uploading directly from the browser can be unreliable and browsers don't provide feedback on upload progress and state like they do for downloads.
Because of this, we have implemented file uploads to Galaxy via FTP. FTP will allow you to monitor as mentioned above, as well as resume interrupted transfers. To get started using FTP, you'll need to have registered a regular Galaxy account on our public server at:
Once registered, you can initiate an FTP connection in your preferred FTP client to the same host (main.g2.bx.psu.edu) using your registered email address and password for the login details.
Files uploaded to this server won't automatically be imported to Galaxy - rather, you will be presented with a list of the contents of your FTP directory on the standard "Upload File" tool interface. Files not imported within 3 days will be cleaned up from the FTP site.
We hope that this service solves a crucial problem in data transfer speed and reliability. Please report any problems or suggestions with the service to us at:
galaxy-bugs@bx.psu.edu
Please note that it may not always be practical to use the public Galaxy servers. If you're routinely working with very large data and having to wait for it to upload, a local Galaxy server could be a more practical solution. Instructions on installing your own server can be found at:
http://getgalaxy.org/ http://usegalaxy.org/production
In addition, with the recent announcement of Amazon's parallel upload capability for the Simple Storage Service (S3), we are investigating incorporating easy access to S3 buckets for Galaxy instances on the Amazon Elastic Compute Cloud (EC2). But you don't need to wait for the pretty interface, you can already access contents of S3 buckets by pasting links to their contents in the "URL/Text:" field of the "Upload File" tool. For an example of how to do this, see the "Watch how the complete analysis can be performed on the Amazon Cloud" screencast at:
http://usegalaxy.org/heteroplasmy
Thanks, --nate Galaxy Team