Fwd: How to Clean up Old Data
(I'm resending this, it didn't seem to go through) ---------- Forwarded message ---------- From: greg <margeemail@gmail.com> Date: Thu, Jun 13, 2013 at 9:29 AM Subject: Re: [galaxy-dev] How to Clean up Old Data To: Björn Grüning <bjoern.gruening@pharmazie.uni-freiburg.de> Cc: "galaxy-dev@lists.bx.psu.edu" <galaxy-dev@lists.bx.psu.edu> Hi Bjorn, Could I have a look at your cron job for this? I'm not completely sure what to schedule. Thanks, Greg On Mon, Mar 11, 2013 at 1:17 PM, greg <margeemail@gmail.com> wrote:
Thanks. Could I have a look at what your cron job looks like?
-Greg
On Mon, Mar 11, 2013 at 11:58 AM, Björn Grüning <bjoern.gruening@pharmazie.uni-freiburg.de> wrote:
Hi Greg,
I'm trying to figure out how to reduce the data stored on the galaxy server.
I came across this page and it looks like data will get deleted if the history element gets deleted but I can't tell if this happens automatically or if I need to cron these scripts: http://wiki.galaxyproject.org/Admin/Config/Performance/Purge%20Histories%20a...
Is there anything else I can do to clean up unused data?
No that should be sufficient. You need to run
python cleanup_datasets.py universe_wsgi.ini -d 60
with the different parameters ... -1 -2 -3 .... It will not happen automatically, i recommend you to set up a cron job that runs every week. You also may want to change the -d 60 to something less than 60.
Also is there a way a user can keep her history around as a record of what was done and be able to rerun it later, but still delete the actual data?
I don't think that is possible at the moment. Cheers, Bjoern
Thanks,
Greg ___________________________________________________________ Please keep all replies on the list by using "reply all" in your mail client. To manage your subscriptions to this and other Galaxy lists, please use the interface at:
Hi Greg, sorry, for my late response. I'm currently not in my lab with access to the server. I will mail you an example when I'm back, after GCC. Which cron service are you using? Cheers, Bjoern
(I'm resending this, it didn't seem to go through)
---------- Forwarded message ---------- From: greg <margeemail@gmail.com> Date: Thu, Jun 13, 2013 at 9:29 AM Subject: Re: [galaxy-dev] How to Clean up Old Data To: Björn Grüning <bjoern.gruening@pharmazie.uni-freiburg.de> Cc: "galaxy-dev@lists.bx.psu.edu" <galaxy-dev@lists.bx.psu.edu>
Hi Bjorn,
Could I have a look at your cron job for this? I'm not completely sure what to schedule.
Thanks,
Greg
On Mon, Mar 11, 2013 at 1:17 PM, greg <margeemail@gmail.com> wrote:
Thanks. Could I have a look at what your cron job looks like?
-Greg
On Mon, Mar 11, 2013 at 11:58 AM, Björn Grüning <bjoern.gruening@pharmazie.uni-freiburg.de> wrote:
Hi Greg,
I'm trying to figure out how to reduce the data stored on the galaxy server.
I came across this page and it looks like data will get deleted if the history element gets deleted but I can't tell if this happens automatically or if I need to cron these scripts: http://wiki.galaxyproject.org/Admin/Config/Performance/Purge%20Histories%20a...
Is there anything else I can do to clean up unused data?
No that should be sufficient. You need to run
python cleanup_datasets.py universe_wsgi.ini -d 60
with the different parameters ... -1 -2 -3 .... It will not happen automatically, i recommend you to set up a cron job that runs every week. You also may want to change the -d 60 to something less than 60.
Also is there a way a user can keep her history around as a record of what was done and be able to rerun it later, but still delete the actual data?
I don't think that is possible at the moment. Cheers, Bjoern
Thanks,
Greg ___________________________________________________________ Please keep all replies on the list by using "reply all" in your mail client. To manage your subscriptions to this and other Galaxy lists, please use the interface at:
___________________________________________________________ Please keep all replies on the list by using "reply all" in your mail client. To manage your subscriptions to this and other Galaxy lists, please use the interface at: http://lists.bx.psu.edu/
To search Galaxy mailing lists use the unified search at: http://galaxyproject.org/search/mailinglists/
Hello, Regards your comment about keeping history but deleting data, I suggest you convert your history into a Workflow. You could then delete the history and therefore all files attached to it but keep a copy of the protocol for future use. Hope it helps Best Jean-François
Also is there a way a user can keep her history around as a record of what was done and be able to rerun it later, but still delete the actual data? I don't think that is possible at the moment. Cheers, Bjoern
-- ##################################### Jean-François Taly Bioinformatician Bioinformatics Core Facility http://biocore.crg.cat CRG - Centre de Regulació Genòmica (Room 439) Parc de Recerca Biomèdica de Barcelona (PRBB) Doctor Aiguader, 88 08003 Barcelona Spain email: jean-francois.taly@crg.eu phone: +34 93 316 0202 fax: +34 93 316 0099 #####################################
participants (3)
-
Björn Grüning
-
greg
-
jean-François Taly