I have a custom module that gets BAM files via HTTP web services. It appears to work perfectly for smaller BAM files, but when I jump up to the 10's of gigs, Galaxy displays some aggravating behavior.
I am able to get the data just fine and wholly intact. However, when the transfer is done, Galaxy does not appear to recognize it. It just continues to run the download job, not realizing the file is done. If I try and do anything with the job still in progress (View in browser or view details), Galaxy seems to crash and I see the following errors:
Proxy Error
The proxy server received an invalid response from an upstream server. The proxy server could not handle the request GET /galaxy/datasets/4ff6f47412c3e65e/display/.
Reason: Error reading from remote server
-And-
python26: ./Modules/cStringIO.c:419: O_cwrite: Assertion `oself->pos + l < 2147483647' failed. run.sh: line 49: 8801 Aborted python26 ./scripts/paster.py serve universe_wsgi.ini $@
And then finally when I try and refresh Galaxy:
Service Temporarily Unavailable The server is temporarily unable to service your request due to maintenance downtime or capacity problems. Please try again later.
I have to reboot it in order for it to work again.
One time (and I have not been able to replicate this), the file, after causing Galaxy to crash, showed up in my Datasets history, intact. I can see each file I've attempted to download in the file system, but only the one time have I had access to it in Galaxy.
Anyone have any ideas what's going on and how to fix this?
Thanks! Brian Luerman Intrepid Bioinformatics (502) 212-2699 (ext 3) http://intrepidbio.com/