fastx reverse compliment failed - gzip: stdout: Broken pipe
I'm reposting over here from the user side, since this is a local instance, and it was recommended. Hi all, We are running Galaxy on an Ubuntu 11.10 computer (5 TB, stripped, etc.). We are assembling a small genome (110 Gb). Our dataset isn't directly uploaded, but is accessed from a directory (if that matters). Everything went fine through the FASTQ Groomer, but when we ran Reverse-Compliment, we got the following error: fastx_reverse_complement: writing quality scores failed: File too large gzip: stdout: Broken pipe Any help that you might have would be greatly appreciated! Thanks! As a follow up, the file that we're trying to reverse compliment is ~26 Gb. The files seem to work fine until 2.1 Gb. There is plenty of memory (we have 3.4 Tb free on this system) and it doesn't seem to be an issue with the permissions or partitions. I also made sure that the Gzip and connectors to perl are up to date. And I have set everything in ulimit to be unlimited (so there are no issues for Ubuntu for the file size creation). This is a local instance, btw, though I'm sure that's obvious... We were able to groom the files to create the 26Gb file that we want to work with, so it seems like the computer should be able to do all of this... Any thoughts?
Lucinda Lawson wrote, On 11/03/11 17:51:
[...] but when we ran Reverse-Compliment, we got the following error:
fastx_reverse_complement: writing quality scores failed: File too large
gzip: stdout: Broken pipe
You are very likely using a 32-bit executable version of "fastx_reverse_complement". The 32-bit version can't handle files larger than 2 GB. Use the 64-bit version to work with larger files. -gordon
participants (2)
-
Assaf Gordon
-
Lucinda Lawson