Auto delete dataset after workflow run?
Hello All, Is there a way to set "auto delete" some datafiles at the end of workflow run? I'm asking this because it is sometimes useful to delete some outputs (say intermediate files, .logs, etc), for example "auto delete" .sam file after executing sam-to-bam tool, which would free-up lot of space. This is especially useful when work with large number of samples. Look forward to any comments/suggestions. Best, Raj. ________________________________ This e-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended solely for the use of the addressee(s). If you are not the intended recipient, please notify the sender by e-mail and delete the original message. Further, you are not to copy, disclose, or distribute this e-mail or its contents to any other person and any such actions that are unlawful. This e-mail may contain viruses. Ocimum Biosolutions has taken every reasonable precaution to minimize this risk, but is not liable for any damage you may sustain as a result of any virus in this e-mail. You should carry out your own virus checks before opening the e-mail or attachment. The information contained in this email and any attachments is confidential and may be subject to copyright or other intellectual property protection. If you are not the intended recipient, you are not authorized to use or disclose this information, and we request that you notify us by reply mail or telephone and delete the original message from your mail system. OCIMUMBIO SOLUTIONS (P) LTD
On Wed, Apr 4, 2012 at 12:30 PM, Praveen Raj Somarajan <Praveen.s@ocimumbio.com> wrote:
Hello All,
Is there a way to set "auto delete" some datafiles at the end of workflow run? I'm asking this because it is sometimes useful to delete some outputs (say intermediate files, .logs, etc), for example "auto delete" .sam file after executing sam-to-bam tool, which would free-up lot of space. This is especially useful when work with large number of samples.
Look forward to any comments/suggestions.
Best,
Raj.
You're not the first to ask, e.g. http://lists.bx.psu.edu/pipermail/galaxy-dev/2011-September/006801.html It would be quite a popular feature I think - perhaps replacing the current "auto hide" feature in workflows with "auto delete" or is that too drastic? Peter
exactly, something similar to "auto-hide" feature. This would be a nice option to have, as the intermediate files consume huge amount of memory, especially in case of NGS analysis. - Raj -----Original Message----- From: Peter Cock [mailto:p.j.a.cock@googlemail.com] Sent: Wednesday, April 04, 2012 5:09 PM To: Praveen Raj Somarajan Cc: galaxy-dev@lists.bx.psu.edu Subject: Re: [galaxy-dev] Auto delete dataset after workflow run? On Wed, Apr 4, 2012 at 12:30 PM, Praveen Raj Somarajan <Praveen.s@ocimumbio.com> wrote:
Hello All,
Is there a way to set "auto delete" some datafiles at the end of workflow run? I'm asking this because it is sometimes useful to delete some outputs (say intermediate files, .logs, etc), for example "auto delete" .sam file after executing sam-to-bam tool, which would free-up lot of space. This is especially useful when work with large number of samples.
Look forward to any comments/suggestions.
Best,
Raj.
You're not the first to ask, e.g. http://lists.bx.psu.edu/pipermail/galaxy-dev/2011-September/006801.html It would be quite a popular feature I think - perhaps replacing the current "auto hide" feature in workflows with "auto delete" or is that too drastic? Peter This e-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended solely for the use of the addressee(s). If you are not the intended recipient, please notify the sender by e-mail and delete the original message. Further, you are not to copy, disclose, or distribute this e-mail or its contents to any other person and any such actions that are unlawful. This e-mail may contain viruses. Ocimum Biosolutions has taken every reasonable precaution to minimize this risk, but is not liable for any damage you may sustain as a result of any virus in this e-mail. You should carry out your own virus checks before opening the e-mail or attachment. The information contained in this email and any attachments is confidential and may be subject to copyright or other intellectual property protection. If you are not the intended recipient, you are not authorized to use or disclose this information, and we request that you notify us by reply mail or telephone and delete the original message from your mail system. OCIMUMBIO SOLUTIONS (P) LTD
Is "auto-delete" feature available in Galaxy now? Or Is there an alternate way to delete (or flag to delete) a dataset automatically after a workflow? Best Raj -----Original Message----- From: galaxy-dev-bounces@lists.bx.psu.edu [mailto:galaxy-dev-bounces@lists.bx.psu.edu] On Behalf Of Praveen Raj Somarajan Sent: Wednesday, April 04, 2012 5:25 PM To: Peter Cock Cc: galaxy-dev@lists.bx.psu.edu Subject: Re: [galaxy-dev] Auto delete dataset after workflow run? exactly, something similar to "auto-hide" feature. This would be a nice option to have, as the intermediate files consume huge amount of memory, especially in case of NGS analysis. - Raj -----Original Message----- From: Peter Cock [mailto:p.j.a.cock@googlemail.com] Sent: Wednesday, April 04, 2012 5:09 PM To: Praveen Raj Somarajan Cc: galaxy-dev@lists.bx.psu.edu Subject: Re: [galaxy-dev] Auto delete dataset after workflow run? On Wed, Apr 4, 2012 at 12:30 PM, Praveen Raj Somarajan <Praveen.s@ocimumbio.com> wrote:
Hello All,
Is there a way to set "auto delete" some datafiles at the end of workflow run? I'm asking this because it is sometimes useful to delete some outputs (say intermediate files, .logs, etc), for example "auto delete" .sam file after executing sam-to-bam tool, which would free-up lot of space. This is especially useful when work with large number of samples.
Look forward to any comments/suggestions.
Best,
Raj.
You're not the first to ask, e.g. http://lists.bx.psu.edu/pipermail/galaxy-dev/2011-September/006801.html It would be quite a popular feature I think - perhaps replacing the current "auto hide" feature in workflows with "auto delete" or is that too drastic? Peter This e-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended solely for the use of the addressee(s). If you are not the intended recipient, please notify the sender by e-mail and delete the original message. Further, you are not to copy, disclose, or distribute this e-mail or its contents to any other person and any such actions that are unlawful. This e-mail may contain viruses. Ocimum Biosolutions has taken every reasonable precaution to minimize this risk, but is not liable for any damage you may sustain as a result of any virus in this e-mail. You should carry out your own virus checks before opening the e-mail or attachment. The information contained in this email and any attachments is confidential and may be subject to copyright or other intellectual property protection. If you are not the intended recipient, you are not authorized to use or disclose this information, and we request that you notify us by reply mail or telephone and delete the original message from your mail system. OCIMUMBIO SOLUTIONS (P) LTD ___________________________________________________________ Please keep all replies on the list by using "reply all" in your mail client. To manage your subscriptions to this and other Galaxy lists, please use the interface at: http://lists.bx.psu.edu/ This e-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended solely for the use of the addressee(s). If you are not the intended recipient, please notify the sender by e-mail and delete the original message. Further, you are not to copy, disclose, or distribute this e-mail or its contents to any other person and any such actions that are unlawful. This e-mail may contain viruses. Ocimum Biosolutions has taken every reasonable precaution to minimize this risk, but is not liable for any damage you may sustain as a result of any virus in this e-mail. You should carry out your own virus checks before opening the e-mail or attachment. The information contained in this email and any attachments is confidential and may be subject to copyright or other intellectual property protection. If you are not the intended recipient, you are not authorized to use or disclose this information, and we request that you notify us by reply mail or telephone and delete the original message from your mail system. OCIMUMBIO SOLUTIONS (P) LTD
On Wed, Apr 4, 2012 at 7:38 AM, Peter Cock <p.j.a.cock@googlemail.com> wrote:
It would be quite a popular feature I think - perhaps replacing the current "auto hide" feature in workflows with "auto delete" or is that too drastic?
I think a workflow level option to set whether non-output datasets are hidden or deleted (defaulting to deleted).
participants (3)
-
James Taylor
-
Peter Cock
-
Praveen Raj Somarajan